Jul 08 22:28:05.943147 ip-10-0-136-6 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 08 22:28:05.943159 ip-10-0-136-6 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 08 22:28:05.943169 ip-10-0-136-6 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 08 22:28:05.943484 ip-10-0-136-6 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 08 22:28:16.177272 ip-10-0-136-6 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 08 22:28:16.177290 ip-10-0-136-6 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d96eb02a19c64a4d8dfe010aac44695a --
Jul 08 22:29:56.110086 ip-10-0-136-6 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 22:29:56.505663 ip-10-0-136-6 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 22:29:56.505663 ip-10-0-136-6 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 22:29:56.505663 ip-10-0-136-6 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 22:29:56.505663 ip-10-0-136-6 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 22:29:56.505663 ip-10-0-136-6 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 22:29:56.506604 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.505716    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 22:29:56.514458 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514427    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 22:29:56.514458 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514451    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 22:29:56.514458 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514456    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 22:29:56.514458 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514460    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 22:29:56.514458 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514465    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 22:29:56.514752 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514469    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 22:29:56.514752 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514474    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 22:29:56.514752 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514478    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 22:29:56.514752 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514482    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 22:29:56.514752 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514486    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 22:29:56.514752 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514494    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 22:29:56.514752 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514498    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 22:29:56.514752 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514502    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 22:29:56.514752 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514506    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 22:29:56.514752 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514510    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 22:29:56.514752 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514515    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 22:29:56.514752 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514523    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 22:29:56.514752 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514527    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 22:29:56.514752 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514531    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 22:29:56.514752 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514535    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 22:29:56.514752 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514539    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 22:29:56.514752 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514543    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 22:29:56.514752 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514552    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 22:29:56.514752 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514555    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 22:29:56.514752 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514559    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 22:29:56.515592 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514563    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 22:29:56.515592 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514567    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 22:29:56.515592 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514571    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 22:29:56.515592 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514575    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 22:29:56.515592 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514579    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 22:29:56.515592 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514583    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 22:29:56.515592 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514587    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 22:29:56.515592 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514591    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 22:29:56.515592 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514608    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 22:29:56.515592 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514613    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 22:29:56.515592 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514622    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 22:29:56.515592 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514627    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 22:29:56.515592 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514631    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 22:29:56.515592 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514636    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 22:29:56.515592 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514640    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 22:29:56.515592 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514645    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 22:29:56.515592 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514658    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 22:29:56.515592 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514663    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 22:29:56.515592 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514667    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 22:29:56.515592 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514671    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 22:29:56.516561 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514676    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 22:29:56.516561 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514686    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 22:29:56.516561 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514695    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 22:29:56.516561 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514699    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 22:29:56.516561 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514704    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 22:29:56.516561 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514708    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 22:29:56.516561 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514714    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 22:29:56.516561 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514719    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 22:29:56.516561 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514723    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 22:29:56.516561 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514728    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 22:29:56.516561 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514732    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 22:29:56.516561 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514736    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 22:29:56.516561 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514741    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 22:29:56.516561 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514745    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 22:29:56.516561 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514753    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 22:29:56.516561 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514757    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 22:29:56.516561 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514761    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 22:29:56.516561 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514765    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 22:29:56.516561 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514770    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 22:29:56.517381 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514774    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 22:29:56.517381 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514778    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 22:29:56.517381 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514794    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 22:29:56.517381 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514822    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 22:29:56.517381 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514827    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 22:29:56.517381 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514832    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 22:29:56.517381 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514838    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 22:29:56.517381 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514847    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 22:29:56.517381 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514857    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 22:29:56.517381 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514863    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 22:29:56.517381 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514867    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 22:29:56.517381 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514872    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 22:29:56.517381 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514876    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 22:29:56.517381 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514880    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 22:29:56.517381 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514885    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 22:29:56.517381 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514889    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 22:29:56.517381 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514894    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 22:29:56.517381 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514898    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 22:29:56.517381 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514902    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 22:29:56.518188 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514914    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 22:29:56.518188 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514918    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 22:29:56.518188 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514923    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 22:29:56.518188 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514927    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 22:29:56.518188 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514931    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 22:29:56.518188 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514938    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 22:29:56.518188 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514945    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 22:29:56.518188 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514951    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 22:29:56.518188 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514957    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 22:29:56.518188 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514962    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 22:29:56.518188 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514967    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 22:29:56.518188 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514972    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 22:29:56.518188 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514981    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 22:29:56.518188 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514987    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 22:29:56.518188 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514992    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 22:29:56.518188 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.514996    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 22:29:56.518188 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517255    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 22:29:56.518188 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517272    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 22:29:56.518188 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517278    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 22:29:56.518188 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517283    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 22:29:56.519064 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517292    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 22:29:56.519064 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517304    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 22:29:56.519064 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517309    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 22:29:56.519064 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517314    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 22:29:56.519064 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517321    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 22:29:56.519064 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517328    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 22:29:56.519064 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517332    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 22:29:56.519064 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517337    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 22:29:56.519064 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517342    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 22:29:56.519064 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517346    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 22:29:56.519064 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517351    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 22:29:56.519064 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517355    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 22:29:56.519064 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517359    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 22:29:56.519064 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517364    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 22:29:56.519064 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517372    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 22:29:56.519064 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517376    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 22:29:56.519064 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517380    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 22:29:56.519064 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517385    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 22:29:56.519064 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517389    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 22:29:56.519912 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517393    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 22:29:56.519912 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517397    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 22:29:56.519912 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517401    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 22:29:56.519912 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517405    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 22:29:56.519912 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517409    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 22:29:56.519912 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517416    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 22:29:56.519912 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517427    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 22:29:56.519912 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517438    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 22:29:56.519912 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517442    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 22:29:56.519912 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517447    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 22:29:56.519912 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517460    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 22:29:56.519912 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517466    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 22:29:56.519912 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517471    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 22:29:56.519912 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517476    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 22:29:56.519912 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517480    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 22:29:56.519912 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517485    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 22:29:56.519912 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517505    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 22:29:56.519912 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517510    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 22:29:56.519912 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517514    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 22:29:56.520739 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517523    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 22:29:56.520739 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517528    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 22:29:56.520739 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517532    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 22:29:56.520739 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517536    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 22:29:56.520739 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517540    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 22:29:56.520739 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517545    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 22:29:56.520739 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517550    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 22:29:56.520739 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517554    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 22:29:56.520739 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517558    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 22:29:56.520739 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517563    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 22:29:56.520739 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517567    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 22:29:56.520739 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517571    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 22:29:56.520739 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517585    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 22:29:56.520739 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517593    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 22:29:56.520739 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517597    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 22:29:56.520739 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517601    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 22:29:56.520739 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517605    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 22:29:56.520739 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517610    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 22:29:56.520739 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517614    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 22:29:56.520739 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517618    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 22:29:56.521362 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517623    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 22:29:56.521362 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517627    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 22:29:56.521362 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517632    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 22:29:56.521362 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517636    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 22:29:56.521362 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517652    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 22:29:56.521362 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517657    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 22:29:56.521362 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517662    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 22:29:56.521362 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517666    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 22:29:56.521362 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517670    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 22:29:56.521362 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517675    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 22:29:56.521362 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517679    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 22:29:56.521362 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517683    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 22:29:56.521362 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517687    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 22:29:56.521362 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517692    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 22:29:56.521362 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517696    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 22:29:56.521362 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517700    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 22:29:56.521362 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517704    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 22:29:56.521362 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517713    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 22:29:56.521362 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517718    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 22:29:56.521362 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517722    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 22:29:56.522000 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517727    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 22:29:56.522000 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517731    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 22:29:56.522000 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517735    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 22:29:56.522000 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517745    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 22:29:56.522000 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517750    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 22:29:56.522000 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517754    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 22:29:56.522000 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517758    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 22:29:56.522000 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517762    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 22:29:56.522000 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517767    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 22:29:56.522000 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517775    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 22:29:56.522000 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517780    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 22:29:56.522000 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517784    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 22:29:56.522000 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517788    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 22:29:56.522000 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517793    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 22:29:56.522000 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517822    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 22:29:56.522000 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517826    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 22:29:56.522000 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.517831    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 22:29:56.522000 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518772    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 22:29:56.522000 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518784    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 22:29:56.522000 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518789    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 22:29:56.522613 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518794    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 22:29:56.522613 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518821    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 22:29:56.522613 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518825    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 22:29:56.522613 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518829    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 22:29:56.522613 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518833    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 22:29:56.522613 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518838    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 22:29:56.522613 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518842    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 22:29:56.522613 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518868    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 22:29:56.522613 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518874    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 22:29:56.522613 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518882    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 22:29:56.522613 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518890    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 22:29:56.522613 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518895    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 22:29:56.522613 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518900    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 22:29:56.522613 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518905    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 22:29:56.522613 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518910    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 22:29:56.522613 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518914    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 22:29:56.522613 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518920    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 22:29:56.522613 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518925    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 22:29:56.522613 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518929    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 22:29:56.523108 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518933    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 22:29:56.523108 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518939    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 22:29:56.523108 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518945    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 22:29:56.523108 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518951    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 22:29:56.523108 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518955    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 22:29:56.523108 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518960    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 22:29:56.523108 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518964    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 22:29:56.523108 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518970    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 22:29:56.523108 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518975    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 22:29:56.523108 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518979    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 22:29:56.523108 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518983    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 22:29:56.523108 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518987    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 22:29:56.523108 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518991    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 22:29:56.523108 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.518996    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 22:29:56.523108 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519000    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 22:29:56.523108 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519004    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 22:29:56.523108 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519008    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 22:29:56.523108 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519015    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 22:29:56.523108 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519020    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 22:29:56.523669 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519026    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 22:29:56.523669 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519030    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 22:29:56.523669 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519035    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 22:29:56.523669 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519039    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 22:29:56.523669 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519044    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 22:29:56.523669 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519049    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 22:29:56.523669 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519054    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 22:29:56.523669 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519058    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 22:29:56.523669 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519062    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 22:29:56.523669 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519067    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 22:29:56.523669 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519071    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 22:29:56.523669 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519075    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 22:29:56.523669 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519079    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 22:29:56.523669 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519083    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 22:29:56.523669 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519088    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 22:29:56.523669 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519093    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 22:29:56.523669 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519098    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 22:29:56.523669 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519102    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 22:29:56.523669 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519106    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 22:29:56.523669 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519111    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 22:29:56.524191 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519117    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 22:29:56.524191 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519121    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 22:29:56.524191 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519125    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 22:29:56.524191 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519129    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 22:29:56.524191 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519133    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 22:29:56.524191 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519137    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 22:29:56.524191 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519141    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 22:29:56.524191 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519146    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 22:29:56.524191 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519150    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 22:29:56.524191 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519154    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 22:29:56.524191 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519160    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 22:29:56.524191 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519166    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 22:29:56.524191 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519171    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 22:29:56.524191 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519175    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 22:29:56.524191 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519180    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 22:29:56.524191 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519184    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 22:29:56.524191 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519189    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 22:29:56.524191 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519193    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 22:29:56.524191 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519197    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 22:29:56.524645 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519201    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 22:29:56.524645 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519205    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 22:29:56.524645 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519211    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 22:29:56.524645 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519215    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 22:29:56.524645 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519219    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 22:29:56.524645 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519224    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 22:29:56.524645 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519228    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 22:29:56.524645 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519234    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 22:29:56.524645 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519238    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 22:29:56.524645 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519242    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 22:29:56.524645 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519246    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 22:29:56.524645 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519251    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 22:29:56.524645 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519255    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 22:29:56.524645 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519260    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 22:29:56.524645 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519265    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 22:29:56.524645 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519269    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 22:29:56.524645 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519273    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 22:29:56.524645 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519277    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 22:29:56.524645 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.519281    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 22:29:56.524645 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519381    2558 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 22:29:56.524645 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519393    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519402    2558 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519408    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519414    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519419    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519426    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519433    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519438    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519442    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519447    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519453    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519457    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519462    2558 flags.go:64] FLAG: --cgroup-root=""
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519467    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519471    2558 flags.go:64] FLAG: --client-ca-file=""
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519477    2558 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519482    2558 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519489    2558 flags.go:64] FLAG: --cluster-domain=""
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519493    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519500    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519505    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519510    2558 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519516    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 22:29:56.525194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519521    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519526    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519533    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519537    2558 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519542    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519546    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519551    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519555    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519561    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519566    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519571    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519575    2558 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519580    2558 flags.go:64] FLAG: --enable-server="true"
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519585    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519591    2558 flags.go:64] FLAG: --event-burst="100"
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519596    2558 flags.go:64] FLAG: --event-qps="50"
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519600    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519605    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519609    2558 flags.go:64] FLAG: --eviction-hard=""
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519615    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519620    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519624    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519629    2558 flags.go:64] FLAG: --eviction-soft=""
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519633    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519638    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 22:29:56.525745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519643    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519647    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519652    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519658    2558 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519662    2558 flags.go:64] FLAG: --feature-gates=""
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519669    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519693    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519700    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519705    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519711    2558 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519717    2558 flags.go:64] FLAG: --help="false"
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519721    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-136-6.ec2.internal"
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519726    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519731    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519736    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519741    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519746    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519751    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519755    2558 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519759    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519763    2558 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519768    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519773    2558 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519778    2558 flags.go:64] FLAG: --kube-reserved=""
Jul 08 22:29:56.526371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519782    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519787    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519791    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519813    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519820    2558 flags.go:64] FLAG: --lock-file=""
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519824    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519828    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519833    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519842    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519847    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519852    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519858    2558 flags.go:64] FLAG: --logging-format="text"
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519862    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519868    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519872    2558 flags.go:64] FLAG: --manifest-url=""
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519876    2558 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519883    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519889    2558 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519896    2558 flags.go:64] FLAG: --max-pods="110"
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519900    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519905    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519909    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519913    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519918    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519922    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 22:29:56.527042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519927    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519937    2558 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519942    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519947    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519952    2558 flags.go:64] FLAG: --pod-cidr=""
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519956    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519964    2558 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519968    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519973    2558 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519977    2558 flags.go:64] FLAG: --port="10250"
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519981    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519986    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-019f39953b8028220"
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519991    2558 flags.go:64] FLAG: --qos-reserved=""
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.519996    2558 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520000    2558 flags.go:64] FLAG: --register-node="true"
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520005    2558 flags.go:64] FLAG: --register-with-taints=""
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520010    2558 flags.go:64] FLAG: --registry-burst="10"
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520016    2558 flags.go:64] FLAG: --registry-qps="5"
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520022    2558 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520027    2558 flags.go:64] FLAG: --reserved-memory=""
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520040    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520044    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520049    2558 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520054    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520058    2558 flags.go:64] FLAG: --runonce="false"
Jul 08 22:29:56.527659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520063    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520068    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520073    2558 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520077    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520082    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520086    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520090    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520095    2558 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520099    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520104    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520109    2558 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520113    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520118    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520122    2558 flags.go:64] FLAG: --system-cgroups=""
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520127    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520135    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520139    2558 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520144    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520151    2558 flags.go:64] FLAG: --tls-min-version=""
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520155    2558 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520160    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520165    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520170    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520174    2558 flags.go:64] FLAG: --v="2"
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520180    2558 flags.go:64] FLAG: --version="false"
Jul 08 22:29:56.528273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520189    2558 flags.go:64] FLAG: --vmodule=""
Jul 08 22:29:56.528940 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520194    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 22:29:56.528940 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520200    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 22:29:56.528940 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520402    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 22:29:56.528940 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520410    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 22:29:56.528940 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520415    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 22:29:56.528940 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520419    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 22:29:56.528940 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520423    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 22:29:56.528940 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520427    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 22:29:56.528940 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520431    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 22:29:56.528940 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520436    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 22:29:56.528940 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520440    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 22:29:56.528940 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520446    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 22:29:56.528940 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520452    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 22:29:56.528940 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520457    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 22:29:56.528940 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520461    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 22:29:56.528940 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520465    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 22:29:56.528940 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520469    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 22:29:56.528940 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520473    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 22:29:56.528940 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520478    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 22:29:56.529399 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520481    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 22:29:56.529399 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520486    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 22:29:56.529399 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520490    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 22:29:56.529399 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520494    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 22:29:56.529399 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520499    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 22:29:56.529399 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520502    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 22:29:56.529399 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520507    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 22:29:56.529399 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520511    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 22:29:56.529399 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520515    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 22:29:56.529399 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520519    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 22:29:56.529399 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520523    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 22:29:56.529399 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520527    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 22:29:56.529399 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520532    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 22:29:56.529399 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520537    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 22:29:56.529399 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520542    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 22:29:56.529399 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520546    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 22:29:56.529399 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520550    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 22:29:56.529399 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520554    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 22:29:56.529399 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520561    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 22:29:56.529399 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520566    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 22:29:56.529911 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520571    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 22:29:56.529911 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520576    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 22:29:56.529911 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520580    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 22:29:56.529911 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520585    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 22:29:56.529911 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520589    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 22:29:56.529911 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520593    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 22:29:56.529911 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520597    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 22:29:56.529911 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520601    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 22:29:56.529911 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520605    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 22:29:56.529911 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520610    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 22:29:56.529911 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520613    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 22:29:56.529911 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520617    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 22:29:56.529911 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520621    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 22:29:56.529911 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520626    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 22:29:56.529911 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520630    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 22:29:56.529911 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520634    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 22:29:56.529911 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520639    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 22:29:56.529911 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520643    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 22:29:56.529911 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520647    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 22:29:56.529911 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520651    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 22:29:56.530421 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520655    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 22:29:56.530421 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520659    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 22:29:56.530421 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520663    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 22:29:56.530421 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520667    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 22:29:56.530421 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520672    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 22:29:56.530421 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520676    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 22:29:56.530421 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520681    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 22:29:56.530421 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520687    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 22:29:56.530421 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520693    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 22:29:56.530421 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520697    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 22:29:56.530421 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520702    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 22:29:56.530421 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520707    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 22:29:56.530421 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520711    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 22:29:56.530421 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520716    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 22:29:56.530421 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520720    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 22:29:56.530421 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520724    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 22:29:56.530421 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520728    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 22:29:56.530421 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520732    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 22:29:56.530421 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520736    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 22:29:56.530895 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520740    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 22:29:56.530895 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520744    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 22:29:56.530895 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520748    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 22:29:56.530895 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520752    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 22:29:56.530895 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520756    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 22:29:56.530895 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520760    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 22:29:56.530895 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520763    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 22:29:56.530895 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520767    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 22:29:56.530895 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520771    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 22:29:56.530895 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520775    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 22:29:56.530895 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520780    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 22:29:56.530895 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520784    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 22:29:56.530895 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520788    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 22:29:56.530895 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520792    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 22:29:56.530895 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520814    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 22:29:56.530895 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520818    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 22:29:56.530895 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520823    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 22:29:56.530895 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520829    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 22:29:56.530895 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520832    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 22:29:56.530895 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520836    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 22:29:56.531377 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520841    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 22:29:56.531377 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520847    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 22:29:56.531377 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.520852    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 22:29:56.531377 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.520860    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 22:29:56.531377 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.528269    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 22:29:56.531377 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.528285    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 22:29:56.531377 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.529141    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 22:29:56.531377 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.529152    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 22:29:56.531377 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529213    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 22:29:56.531377 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529218    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 22:29:56.531377 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529221    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 22:29:56.531377 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529224    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 22:29:56.531377 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529227    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 22:29:56.531377 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529230    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 22:29:56.531377 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529232    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 22:29:56.531755 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529235    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 22:29:56.531755 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529238    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 22:29:56.531755 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529240    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 22:29:56.531755 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529243    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 22:29:56.531755 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529245    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 22:29:56.531755 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529248    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 22:29:56.531755 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529250    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 22:29:56.531755 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529253    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 22:29:56.531755 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529256    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 22:29:56.531755 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529258    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 22:29:56.531755 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529260    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 22:29:56.531755 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529263    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 22:29:56.531755 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529265    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 22:29:56.531755 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529268    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 22:29:56.531755 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529271    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 22:29:56.531755 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529273    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 22:29:56.531755 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529275    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 22:29:56.531755 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529278    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 22:29:56.531755 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529280    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 22:29:56.531755 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529283    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 22:29:56.532259 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529285    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 22:29:56.532259 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529288    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 22:29:56.532259 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529292    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 22:29:56.532259 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529295    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 22:29:56.532259 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529297    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 22:29:56.532259 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529300    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 22:29:56.532259 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529302    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 22:29:56.532259 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529305    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 22:29:56.532259 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529308    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 22:29:56.532259 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529311    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 22:29:56.532259 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529313    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 22:29:56.532259 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529316    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 22:29:56.532259 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529318    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 22:29:56.532259 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529320    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 22:29:56.532259 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529323    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 22:29:56.532259 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529327    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 22:29:56.532259 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529330    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 22:29:56.532259 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529333    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 22:29:56.532259 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529336    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 22:29:56.532726 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529338    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 22:29:56.532726 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529341    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 22:29:56.532726 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529344    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 22:29:56.532726 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529346    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 22:29:56.532726 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529350    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 22:29:56.532726 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529354    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 22:29:56.532726 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529356    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 22:29:56.532726 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529359    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 22:29:56.532726 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529361    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 22:29:56.532726 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529364    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 22:29:56.532726 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529366    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 22:29:56.532726 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529369    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 22:29:56.532726 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529372    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 22:29:56.532726 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529375    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 22:29:56.532726 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529377    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 22:29:56.532726 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529380    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 22:29:56.532726 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529383    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 22:29:56.532726 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529386    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 22:29:56.532726 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529388    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 22:29:56.532726 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529390    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 22:29:56.533226 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529393    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 22:29:56.533226 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529395    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 22:29:56.533226 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529398    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 22:29:56.533226 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529402    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 22:29:56.533226 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529405    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 22:29:56.533226 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529408    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 22:29:56.533226 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529410    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 22:29:56.533226 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529413    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 22:29:56.533226 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529416    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 22:29:56.533226 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529418    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 22:29:56.533226 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529421    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 22:29:56.533226 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529423    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 22:29:56.533226 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529425    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 22:29:56.533226 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529428    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 22:29:56.533226 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529430    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 22:29:56.533226 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529433    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 22:29:56.533226 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529435    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 22:29:56.533226 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529438    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 22:29:56.533226 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529440    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 22:29:56.533666 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529443    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 22:29:56.533666 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529445    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 22:29:56.533666 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529447    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 22:29:56.533666 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529450    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 22:29:56.533666 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529452    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 22:29:56.533666 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529455    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 22:29:56.533666 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529458    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 22:29:56.533666 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529461    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 22:29:56.533666 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529463    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 22:29:56.533666 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529466    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 22:29:56.533666 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529469    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 22:29:56.533666 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529472    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 22:29:56.533666 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529474    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 22:29:56.533666 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529477    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 22:29:56.533666 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.529482    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 22:29:56.534069 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529592    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 22:29:56.534069 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529596    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 22:29:56.534069 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529598    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 22:29:56.534069 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529601    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 22:29:56.534069 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529603    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 22:29:56.534069 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529606    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 22:29:56.534069 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529608    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 22:29:56.534069 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529611    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 22:29:56.534069 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529614    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 22:29:56.534069 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529616    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 22:29:56.534069 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529618    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 22:29:56.534069 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529621    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 22:29:56.534069 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529623    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 22:29:56.534069 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529625    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 22:29:56.534069 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529628    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 22:29:56.534069 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529630    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 22:29:56.534069 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529632    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 22:29:56.534069 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529635    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 22:29:56.534069 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529637    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 22:29:56.534069 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529639    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 22:29:56.534571 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529644    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 22:29:56.534571 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529647    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 22:29:56.534571 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529650    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 22:29:56.534571 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529653    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 22:29:56.534571 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529655    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 22:29:56.534571 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529658    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 22:29:56.534571 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529660    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 22:29:56.534571 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529663    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 22:29:56.534571 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529666    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 22:29:56.534571 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529668    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 22:29:56.534571 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529670    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 22:29:56.534571 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529673    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 22:29:56.534571 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529675    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 22:29:56.534571 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529678    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 22:29:56.534571 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529680    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 22:29:56.534571 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529682    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 22:29:56.534571 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529685    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 22:29:56.534571 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529687    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 22:29:56.534571 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529690    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 22:29:56.535041 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529692    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 22:29:56.535041 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529694    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 22:29:56.535041 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529697    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 22:29:56.535041 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529699    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 22:29:56.535041 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529701    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 22:29:56.535041 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529704    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 22:29:56.535041 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529706    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 22:29:56.535041 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529708    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 22:29:56.535041 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529710    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 22:29:56.535041 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529713    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 22:29:56.535041 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529715    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 22:29:56.535041 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529717    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 22:29:56.535041 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529720    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 22:29:56.535041 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529722    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 22:29:56.535041 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529725    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 22:29:56.535041 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529727    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 22:29:56.535041 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529730    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 22:29:56.535041 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529732    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 22:29:56.535041 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529734    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 22:29:56.535491 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529737    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 22:29:56.535491 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529739    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 22:29:56.535491 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529741    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 22:29:56.535491 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529745    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 22:29:56.535491 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529749    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 22:29:56.535491 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529752    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 22:29:56.535491 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529754    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 22:29:56.535491 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529757    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 22:29:56.535491 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529759    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 22:29:56.535491 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529762    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 22:29:56.535491 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529764    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 22:29:56.535491 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529766    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 22:29:56.535491 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529769    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 22:29:56.535491 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529771    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 22:29:56.535491 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529773    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 22:29:56.535491 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529775    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 22:29:56.535491 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529778    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 22:29:56.535491 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529780    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 22:29:56.535491 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529783    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 22:29:56.535491 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529785    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 22:29:56.535979 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529787    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 22:29:56.535979 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529790    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 22:29:56.535979 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529792    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 22:29:56.535979 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529795    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 22:29:56.535979 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529816    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 22:29:56.535979 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529819    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 22:29:56.535979 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529823    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 22:29:56.535979 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529826    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 22:29:56.535979 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529828    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 22:29:56.535979 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529831    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 22:29:56.535979 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529833    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 22:29:56.535979 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529836    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 22:29:56.535979 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529838    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 22:29:56.535979 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529841    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 22:29:56.535979 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529843    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 22:29:56.535979 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529846    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 22:29:56.535979 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529849    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 22:29:56.535979 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529852    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 22:29:56.535979 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529854    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 22:29:56.536465 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529856    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 22:29:56.536465 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:56.529859    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 22:29:56.536465 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.529864    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 22:29:56.536465 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.529963    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 22:29:56.536465 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.532180    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 22:29:56.536465 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.533754    2558 server.go:1019] "Starting client certificate rotation"
Jul 08 22:29:56.536465 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.533859    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 22:29:56.536465 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.533888    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 22:29:56.536667 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.536640    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 22:29:56.540585 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.540567    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 22:29:56.557621 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.557600    2558 log.go:25] "Validated CRI v1 runtime API"
Jul 08 22:29:56.560077 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.560060    2558 log.go:25] "Validated CRI v1 image API"
Jul 08 22:29:56.561184 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.561170    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 22:29:56.563982 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.563967    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 22:29:56.564558 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.564537    2558 fs.go:135] Filesystem UUIDs: map[208dce6e-953b-4fad-8cf0-65275ba82bc9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 cea1a99e-0ba6-4ab4-a5fc-ad264f76d06c:/dev/nvme0n1p3]
Jul 08 22:29:56.564630 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.564557    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 22:29:56.572161 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.572053    2558 manager.go:216] Machine: {Timestamp:2026-07-08 22:29:56.57065928 +0000 UTC m=+0.347394661 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110272 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24748c68217572c9c962e28f27d400 SystemUUID:ec24748c-6821-7572-c9c9-62e28f27d400 BootID:d96eb02a-19c6-4a4d-8dfe-010aac44695a Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:55:44:52:6c:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:55:44:52:6c:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:98:b1:ef:fe:2c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 22:29:56.572161 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.572152    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 22:29:56.572327 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.572231    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 22:29:56.576065 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.576038    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 22:29:56.576224 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.576069    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-6.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 22:29:56.576906 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.576895    2558 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 22:29:56.576960 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.576911    2558 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 22:29:56.576960 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.576921    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 22:29:56.577856 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.577845    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 22:29:56.579682 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.579670    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 22:29:56.583165 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.583152    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 22:29:56.583292 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.583281    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 22:29:56.583357 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.583320    2558 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 22:29:56.583357 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.583334    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 22:29:56.583357 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.583349    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 22:29:56.583471 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.583363    2558 kubelet.go:398] "Adding apiserver pod source"
Jul 08 22:29:56.583471 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.583375    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 22:29:56.583846 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.583833    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 22:29:56.583938 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.583859    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 22:29:56.586463 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.586445    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 22:29:56.587812 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.587770    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-76pqs"
Jul 08 22:29:56.588946 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.588933    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 22:29:56.588994 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.588963    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 22:29:56.590382 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.590370    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 22:29:56.590425 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.590386    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 22:29:56.590425 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.590392    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 22:29:56.590425 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.590397    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 22:29:56.590425 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.590405    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 22:29:56.590425 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.590410    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 22:29:56.590425 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.590418    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 22:29:56.590425 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.590422    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 22:29:56.590610 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.590429    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 22:29:56.590610 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.590435    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 22:29:56.590610 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.590443    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 22:29:56.590610 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.590449    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 22:29:56.592175 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.592161    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 22:29:56.592175 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.592175    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 22:29:56.592311 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:56.592290    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 22:29:56.592351 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:56.592290    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-6.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 22:29:56.595208 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.595194    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-76pqs"
Jul 08 22:29:56.596846 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.596830    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-6.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 22:29:56.597115 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.597104    2558 server.go:1268] "Started kubelet"
Jul 08 22:29:56.597286 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.597229    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 22:29:56.597339 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.597310    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 22:29:56.597384 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.597248    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 22:29:56.598057 ip-10-0-136-6 systemd[1]: Started Kubernetes Kubelet.
Jul 08 22:29:56.600342 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.600325    2558 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 22:29:56.600594 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.600571    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 22:29:56.603755 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:56.603736    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 22:29:56.608597 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.608583    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 22:29:56.608640 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.608587    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 22:29:56.608979 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:56.608751    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-6.ec2.internal\" not found"
Jul 08 22:29:56.609359 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.609333    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 22:29:56.609359 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.609333    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 22:29:56.609359 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.609357    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 22:29:56.609550 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.609535    2558 factory.go:153] Registering CRI-O factory
Jul 08 22:29:56.609599 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.609553    2558 factory.go:223] Registration of the crio container factory successfully
Jul 08 22:29:56.609636 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.609596    2558 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 22:29:56.609636 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.609607    2558 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 22:29:56.609636 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.609598    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 22:29:56.609636 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.609628    2558 factory.go:55] Registering systemd factory
Jul 08 22:29:56.609636 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.609637    2558 factory.go:223] Registration of the systemd container factory successfully
Jul 08 22:29:56.609885 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.609658    2558 factory.go:103] Registering Raw factory
Jul 08 22:29:56.609885 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.609672    2558 manager.go:1196] Started watching for new ooms in manager
Jul 08 22:29:56.610104 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.610091    2558 manager.go:349] Starting recovery of all containers
Jul 08 22:29:56.611216 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.611197    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 22:29:56.614599 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:56.614574    2558 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-6.ec2.internal\" not found" node="ip-10-0-136-6.ec2.internal"
Jul 08 22:29:56.621530 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.621407    2558 manager.go:354] Recovery completed
Jul 08 22:29:56.625777 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.625766    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 22:29:56.627907 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.627893    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-6.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 22:29:56.627968 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.627925    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-6.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 22:29:56.627968 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.627938    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-6.ec2.internal" event="NodeHasSufficientPID"
Jul 08 22:29:56.628451 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.628435    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 22:29:56.628494 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.628452    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 22:29:56.628494 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.628473    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 22:29:56.628494 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.628474    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 22:29:56.629242 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.629226    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-6.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 22:29:56.629286 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.629259    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-6.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 22:29:56.629286 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.629270    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-6.ec2.internal" event="NodeHasSufficientPID"
Jul 08 22:29:56.629571 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.629561    2558 policy_none.go:49] "None policy: Start"
Jul 08 22:29:56.629604 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.629576    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 22:29:56.629604 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.629587    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 22:29:56.630408 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.630397    2558 policy_none.go:47] "Start"
Jul 08 22:29:56.681440 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.681422    2558 manager.go:337] "Starting Device Plugin manager"
Jul 08 22:29:56.682917 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:56.681457    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 22:29:56.682917 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.681467    2558 server.go:87] "Starting device plugin registration server"
Jul 08 22:29:56.682917 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.681774    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 22:29:56.682917 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.681787    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 22:29:56.682917 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.681905    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 22:29:56.682917 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.682014    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 22:29:56.682917 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.682025    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 22:29:56.682917 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:56.682587    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 22:29:56.682917 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:56.682643    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-6.ec2.internal\" not found"
Jul 08 22:29:56.765195 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.765113    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 22:29:56.766455 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.766439    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 22:29:56.766566 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.766473    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 22:29:56.766566 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.766499    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 22:29:56.766566 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:56.766541    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 22:29:56.769552 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.769533    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 22:29:56.782171 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.782151    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 22:29:56.783227 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.783211    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-6.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 22:29:56.783303 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.783240    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-6.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 22:29:56.783303 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.783251    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-6.ec2.internal" event="NodeHasSufficientPID"
Jul 08 22:29:56.783303 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.783274    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-6.ec2.internal"
Jul 08 22:29:56.794546 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.794523    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-6.ec2.internal"
Jul 08 22:29:56.794643 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:56.794550    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-6.ec2.internal\": node \"ip-10-0-136-6.ec2.internal\" not found"
Jul 08 22:29:56.812462 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:56.812440    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-6.ec2.internal\" not found"
Jul 08 22:29:56.867468 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.867423    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-6.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-6.ec2.internal"]
Jul 08 22:29:56.867611 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.867545    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 22:29:56.869361 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.869346    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-6.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 22:29:56.869454 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.869380    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-6.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 22:29:56.869454 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.869396    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-6.ec2.internal" event="NodeHasSufficientPID"
Jul 08 22:29:56.870589 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.870574    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 22:29:56.870698 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.870684    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-6.ec2.internal"
Jul 08 22:29:56.870747 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.870712    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 22:29:56.871774 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.871759    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-6.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 22:29:56.871774 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.871757    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-6.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 22:29:56.871919 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.871790    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-6.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 22:29:56.871919 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.871791    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-6.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 22:29:56.871919 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.871831    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-6.ec2.internal" event="NodeHasSufficientPID"
Jul 08 22:29:56.871919 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.871842    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-6.ec2.internal" event="NodeHasSufficientPID"
Jul 08 22:29:56.872930 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.872917    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-6.ec2.internal"
Jul 08 22:29:56.872984 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.872946    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 22:29:56.874754 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.874736    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-6.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 22:29:56.874893 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.874767    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-6.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 22:29:56.874893 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.874777    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-6.ec2.internal" event="NodeHasSufficientPID"
Jul 08 22:29:56.890323 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:56.890303    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-6.ec2.internal\" not found" node="ip-10-0-136-6.ec2.internal"
Jul 08 22:29:56.893676 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:56.893660    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-6.ec2.internal\" not found" node="ip-10-0-136-6.ec2.internal"
Jul 08 22:29:56.911606 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.911583    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/effe46e935c29e4d46e44fc0f6ce837c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-6.ec2.internal\" (UID: \"effe46e935c29e4d46e44fc0f6ce837c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-6.ec2.internal"
Jul 08 22:29:56.911698 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.911613    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ee323fd0beeb4f4f4622b1412db9e81-config\") pod \"kube-apiserver-proxy-ip-10-0-136-6.ec2.internal\" (UID: \"1ee323fd0beeb4f4f4622b1412db9e81\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-6.ec2.internal"
Jul 08 22:29:56.911698 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:56.911638    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/effe46e935c29e4d46e44fc0f6ce837c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-6.ec2.internal\" (UID: \"effe46e935c29e4d46e44fc0f6ce837c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-6.ec2.internal"
Jul 08 22:29:56.912614 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:56.912600    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-6.ec2.internal\" not found"
Jul 08 22:29:57.012527 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:57.012501    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/effe46e935c29e4d46e44fc0f6ce837c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-6.ec2.internal\" (UID: \"effe46e935c29e4d46e44fc0f6ce837c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-6.ec2.internal"
Jul 08 22:29:57.012527 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:57.012531    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/effe46e935c29e4d46e44fc0f6ce837c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-6.ec2.internal\" (UID: \"effe46e935c29e4d46e44fc0f6ce837c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-6.ec2.internal"
Jul 08 22:29:57.012690 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:57.012546    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ee323fd0beeb4f4f4622b1412db9e81-config\") pod \"kube-apiserver-proxy-ip-10-0-136-6.ec2.internal\" (UID: \"1ee323fd0beeb4f4f4622b1412db9e81\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-6.ec2.internal"
Jul 08 22:29:57.012690 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:57.012585    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1ee323fd0beeb4f4f4622b1412db9e81-config\") pod \"kube-apiserver-proxy-ip-10-0-136-6.ec2.internal\" (UID: \"1ee323fd0beeb4f4f4622b1412db9e81\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-6.ec2.internal"
Jul 08 22:29:57.012690 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:57.012605    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/effe46e935c29e4d46e44fc0f6ce837c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-6.ec2.internal\" (UID: \"effe46e935c29e4d46e44fc0f6ce837c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-6.ec2.internal"
Jul 08 22:29:57.012690 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:57.012619    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/effe46e935c29e4d46e44fc0f6ce837c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-6.ec2.internal\" (UID: \"effe46e935c29e4d46e44fc0f6ce837c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-6.ec2.internal"
Jul 08 22:29:57.012690 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:57.012651    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-6.ec2.internal\" not found"
Jul 08 22:29:57.113294 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:57.113218    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-6.ec2.internal\" not found"
Jul 08 22:29:57.193452 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:57.193421    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-6.ec2.internal"
Jul 08 22:29:57.196089 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:57.196071    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-6.ec2.internal"
Jul 08 22:29:57.213776 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:57.213757    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-6.ec2.internal\" not found"
Jul 08 22:29:57.314238 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:57.314208    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-6.ec2.internal\" not found"
Jul 08 22:29:57.414616 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:57.414561    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-6.ec2.internal\" not found"
Jul 08 22:29:57.514952 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:57.514923    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-6.ec2.internal\" not found"
Jul 08 22:29:57.533093 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:57.533071    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 22:29:57.533230 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:57.533211    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 22:29:57.533267 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:57.533245    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 22:29:57.600753 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:57.600693    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 22:24:57 +0000 UTC" deadline="2028-03-04 05:07:55.896625611 +0000 UTC"
Jul 08 22:29:57.600753 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:57.600750    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14502h37m58.295878617s"
Jul 08 22:29:57.615576 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:57.615547    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-6.ec2.internal\" not found"
Jul 08 22:29:57.715935 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:57.715901    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-6.ec2.internal\" not found"
Jul 08 22:29:57.724176 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:57.724143    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeffe46e935c29e4d46e44fc0f6ce837c.slice/crio-250fb7da8a78884b26ed2c47df39a87f542df9514da33cb55cdd18c8406e80d5 WatchSource:0}: Error finding container 250fb7da8a78884b26ed2c47df39a87f542df9514da33cb55cdd18c8406e80d5: Status 404 returned error can't find the container with id 250fb7da8a78884b26ed2c47df39a87f542df9514da33cb55cdd18c8406e80d5
Jul 08 22:29:57.725078 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:57.725053    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ee323fd0beeb4f4f4622b1412db9e81.slice/crio-aa22a416a75e19c2e87483e9c660169c57bda68972d8542ba084f0e8e335e8de WatchSource:0}: Error finding container aa22a416a75e19c2e87483e9c660169c57bda68972d8542ba084f0e8e335e8de: Status 404 returned error can't find the container with id aa22a416a75e19c2e87483e9c660169c57bda68972d8542ba084f0e8e335e8de
Jul 08 22:29:57.727740 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:57.727722    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 22:29:57.769974 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:57.769929    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-6.ec2.internal" event={"ID":"effe46e935c29e4d46e44fc0f6ce837c","Type":"ContainerStarted","Data":"250fb7da8a78884b26ed2c47df39a87f542df9514da33cb55cdd18c8406e80d5"}
Jul 08 22:29:57.770963 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:57.770943    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-6.ec2.internal" event={"ID":"1ee323fd0beeb4f4f4622b1412db9e81","Type":"ContainerStarted","Data":"aa22a416a75e19c2e87483e9c660169c57bda68972d8542ba084f0e8e335e8de"}
Jul 08 22:29:57.816334 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:57.816302    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-6.ec2.internal\" not found"
Jul 08 22:29:57.916715 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:57.916683    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-6.ec2.internal\" not found"
Jul 08 22:29:57.973474 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:57.973387    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 22:29:58.009547 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.009500    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-6.ec2.internal"
Jul 08 22:29:58.020968 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.020944    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 22:29:58.022861 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.022847    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-6.ec2.internal"
Jul 08 22:29:58.038351 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.038325    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 22:29:58.107967 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.107947    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 22:29:58.584995 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.584957    2558 apiserver.go:52] "Watching apiserver"
Jul 08 22:29:58.593604 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.593580    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 22:29:58.594131 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.594097    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-2484w","kube-system/global-pull-secret-syncer-ztbq2","kube-system/kube-apiserver-proxy-ip-10-0-136-6.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk","openshift-cluster-node-tuning-operator/tuned-69qhf","openshift-dns/node-resolver-bkxht","openshift-image-registry/node-ca-ncmmp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-6.ec2.internal","openshift-network-operator/iptables-alerter-2whz6","kube-system/konnectivity-agent-rx5xn","openshift-multus/multus-additional-cni-plugins-2ctjg","openshift-multus/multus-zkxcb","openshift-multus/network-metrics-daemon-dnccf","openshift-network-diagnostics/network-check-target-tfjmn"]
Jul 08 22:29:58.595876 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.595853    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ncmmp"
Jul 08 22:29:58.597141 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.597119    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:29:58.597237 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:58.597205    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnccf" podUID="5ec93cb5-8277-4f5c-a711-1fca9b9cc78a"
Jul 08 22:29:58.598172 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.598151    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:29:58.598273 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:58.598208    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjmn" podUID="b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e"
Jul 08 22:29:58.598766 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.598741    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 22:29:58.598852 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.598755    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 22:29:58.598852 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.598821    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 22:29:58.598852 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.598844    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vqd5q\""
Jul 08 22:29:58.599731 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.599708    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.601144 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.601120    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.602220 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.602198    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 22:29:58.602314 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.602247    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 22:29:58.602382 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.602338    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8clrf\""
Jul 08 22:29:58.602449 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.602251    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 22:29:58.602572 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.602545    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bkxht"
Jul 08 22:29:58.603626 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.603607    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hdfdx\""
Jul 08 22:29:58.603733 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.603643    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 22:29:58.603733 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.603650    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 22:29:58.604084 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.604054    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2whz6"
Jul 08 22:29:58.605056 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.605037    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-28rqv\""
Jul 08 22:29:58.605457 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.605434    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 22:29:58.605614 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.605586    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.605801 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.605781    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 22:29:58.606420 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.606401    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 22:29:58.606638 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.606613    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pqnhb\""
Jul 08 22:29:58.606728 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.606689    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 22:29:58.606898 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.606853    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 22:29:58.607023 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.607005    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:29:58.607099 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:58.607070    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztbq2" podUID="8e133bfb-27da-4990-aac3-8ea961563fd8"
Jul 08 22:29:58.608406 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.608385    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 22:29:58.608406 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.608399    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 22:29:58.608551 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.608423    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gx6mx\""
Jul 08 22:29:58.608688 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.608671    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 22:29:58.608767 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.608692    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rx5xn"
Jul 08 22:29:58.609117 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.609098    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 22:29:58.609780 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.609723    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 22:29:58.610589 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.610253    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.610589 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.610327    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 22:29:58.612024 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.611996    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 22:29:58.612647 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.612318    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 22:29:58.612647 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.612579    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 22:29:58.612902 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.612863    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m5gp6\""
Jul 08 22:29:58.613279 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.613229    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 22:29:58.613918 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.613896    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 22:29:58.614964 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.614231    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 22:29:58.614964 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.614425    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 22:29:58.614964 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.614509    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 22:29:58.614964 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.614552    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bjp8c\""
Jul 08 22:29:58.614964 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.614801    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.617164 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.617146    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 22:29:58.617546 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.617531    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bxv6m\""
Jul 08 22:29:58.621377 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.621355    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs\") pod \"network-metrics-daemon-dnccf\" (UID: \"5ec93cb5-8277-4f5c-a711-1fca9b9cc78a\") " pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:29:58.621479 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.621395    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bceb966d-d92e-4e29-a088-a8d5e526c017-registration-dir\") pod \"aws-ebs-csi-driver-node-hkgxk\" (UID: \"bceb966d-d92e-4e29-a088-a8d5e526c017\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.621479 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.621424    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-etc-sysctl-d\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.621479 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.621449    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d08b2cb9-aff6-407b-9a7f-5b72d056ac1f-tmp-dir\") pod \"node-resolver-bkxht\" (UID: \"d08b2cb9-aff6-407b-9a7f-5b72d056ac1f\") " pod="openshift-dns/node-resolver-bkxht"
Jul 08 22:29:58.621479 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.621473    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e724aeb-b00e-499f-adda-36a36e5c11cd-host-slash\") pod \"iptables-alerter-2whz6\" (UID: \"2e724aeb-b00e-499f-adda-36a36e5c11cd\") " pod="openshift-network-operator/iptables-alerter-2whz6"
Jul 08 22:29:58.621681 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.621496    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e133bfb-27da-4990-aac3-8ea961563fd8-dbus\") pod \"global-pull-secret-syncer-ztbq2\" (UID: \"8e133bfb-27da-4990-aac3-8ea961563fd8\") " pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:29:58.621681 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.621543    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-sys\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.621681 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.621572    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-host-cni-netd\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.621807 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.621704    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13d80c7f-b517-4acf-8354-a317c8e556c8-serviceca\") pod \"node-ca-ncmmp\" (UID: \"13d80c7f-b517-4acf-8354-a317c8e556c8\") " pod="openshift-image-registry/node-ca-ncmmp"
Jul 08 22:29:58.621807 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.621734    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed9aca41-1f6d-4e12-aece-add3905b100d-tmp\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.621807 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.621752    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-var-lib-openvswitch\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.621938 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.621832    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b2130bb-674a-4490-9da0-9576901ea3b5-cnibin\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.621938 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.621870    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b2130bb-674a-4490-9da0-9576901ea3b5-cni-binary-copy\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.621938 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.621906    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8b2130bb-674a-4490-9da0-9576901ea3b5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.622086 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.621938    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6rqk\" (UniqueName: \"kubernetes.io/projected/8b2130bb-674a-4490-9da0-9576901ea3b5-kube-api-access-m6rqk\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.622086 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.621961    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-host\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.622086 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622003    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p9fd\" (UniqueName: \"kubernetes.io/projected/13d80c7f-b517-4acf-8354-a317c8e556c8-kube-api-access-4p9fd\") pod \"node-ca-ncmmp\" (UID: \"13d80c7f-b517-4acf-8354-a317c8e556c8\") " pod="openshift-image-registry/node-ca-ncmmp"
Jul 08 22:29:58.622086 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622037    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5n66\" (UniqueName: \"kubernetes.io/projected/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-kube-api-access-z5n66\") pod \"network-metrics-daemon-dnccf\" (UID: \"5ec93cb5-8277-4f5c-a711-1fca9b9cc78a\") " pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:29:58.622086 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622062    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bceb966d-d92e-4e29-a088-a8d5e526c017-device-dir\") pod \"aws-ebs-csi-driver-node-hkgxk\" (UID: \"bceb966d-d92e-4e29-a088-a8d5e526c017\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.622329 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622087    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bceb966d-d92e-4e29-a088-a8d5e526c017-sys-fs\") pod \"aws-ebs-csi-driver-node-hkgxk\" (UID: \"bceb966d-d92e-4e29-a088-a8d5e526c017\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.622329 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622135    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-host-run-netns\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.622329 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622159    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-etc-openvswitch\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.622329 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622206    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bceb966d-d92e-4e29-a088-a8d5e526c017-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hkgxk\" (UID: \"bceb966d-d92e-4e29-a088-a8d5e526c017\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.622329 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622237    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-etc-sysconfig\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.622329 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622256    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-etc-systemd\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.622329 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622271    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-lib-modules\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.622329 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622288    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-run-openvswitch\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.622329 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622302    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-node-log\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.622329 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622322    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6aa3ac3b-8e3c-4b9b-b33e-03aaf9676e60-konnectivity-ca\") pod \"konnectivity-agent-rx5xn\" (UID: \"6aa3ac3b-8e3c-4b9b-b33e-03aaf9676e60\") " pod="kube-system/konnectivity-agent-rx5xn"
Jul 08 22:29:58.622852 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622348    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b2130bb-674a-4490-9da0-9576901ea3b5-os-release\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.622852 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622375    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bceb966d-d92e-4e29-a088-a8d5e526c017-socket-dir\") pod \"aws-ebs-csi-driver-node-hkgxk\" (UID: \"bceb966d-d92e-4e29-a088-a8d5e526c017\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.622852 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622415    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbml5\" (UniqueName: \"kubernetes.io/projected/69e328b9-bad4-4f6e-8a09-1822adbf2806-kube-api-access-rbml5\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.622852 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622450    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6aa3ac3b-8e3c-4b9b-b33e-03aaf9676e60-agent-certs\") pod \"konnectivity-agent-rx5xn\" (UID: \"6aa3ac3b-8e3c-4b9b-b33e-03aaf9676e60\") " pod="kube-system/konnectivity-agent-rx5xn"
Jul 08 22:29:58.622852 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622490    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-host-slash\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.622852 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622516    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/69e328b9-bad4-4f6e-8a09-1822adbf2806-env-overrides\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.622852 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622540    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d08b2cb9-aff6-407b-9a7f-5b72d056ac1f-hosts-file\") pod \"node-resolver-bkxht\" (UID: \"d08b2cb9-aff6-407b-9a7f-5b72d056ac1f\") " pod="openshift-dns/node-resolver-bkxht"
Jul 08 22:29:58.622852 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622566    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e724aeb-b00e-499f-adda-36a36e5c11cd-iptables-alerter-script\") pod \"iptables-alerter-2whz6\" (UID: \"2e724aeb-b00e-499f-adda-36a36e5c11cd\") " pod="openshift-network-operator/iptables-alerter-2whz6"
Jul 08 22:29:58.622852 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622601    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e133bfb-27da-4990-aac3-8ea961563fd8-kubelet-config\") pod \"global-pull-secret-syncer-ztbq2\" (UID: \"8e133bfb-27da-4990-aac3-8ea961563fd8\") " pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:29:58.622852 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622623    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ed9aca41-1f6d-4e12-aece-add3905b100d-etc-tuned\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.622852 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622646    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-etc-kubernetes\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.622852 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622669    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b2130bb-674a-4490-9da0-9576901ea3b5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.622852 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622685    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret\") pod \"global-pull-secret-syncer-ztbq2\" (UID: \"8e133bfb-27da-4990-aac3-8ea961563fd8\") " pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:29:58.623609 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622905    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95jk7\" (UniqueName: \"kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7\") pod \"network-check-target-tfjmn\" (UID: \"b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e\") " pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:29:58.623609 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622945    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-run-systemd\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.623609 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.622993    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-host-run-ovn-kubernetes\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.623609 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.623018    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-host-cni-bin\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.623609 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.623043    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bceb966d-d92e-4e29-a088-a8d5e526c017-etc-selinux\") pod \"aws-ebs-csi-driver-node-hkgxk\" (UID: \"bceb966d-d92e-4e29-a088-a8d5e526c017\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.623609 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.623066    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdfhp\" (UniqueName: \"kubernetes.io/projected/ed9aca41-1f6d-4e12-aece-add3905b100d-kube-api-access-kdfhp\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.623609 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.623084    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-log-socket\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.623609 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.623100    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/69e328b9-bad4-4f6e-8a09-1822adbf2806-ovnkube-config\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.623609 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.623116    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-run\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.623609 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.623133    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-etc-sysctl-conf\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.623609 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.623157    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b2130bb-674a-4490-9da0-9576901ea3b5-system-cni-dir\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.623609 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.623186    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-systemd-units\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.623609 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.623210    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/69e328b9-bad4-4f6e-8a09-1822adbf2806-ovnkube-script-lib\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.623609 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.623237    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13d80c7f-b517-4acf-8354-a317c8e556c8-host\") pod \"node-ca-ncmmp\" (UID: \"13d80c7f-b517-4acf-8354-a317c8e556c8\") " pod="openshift-image-registry/node-ca-ncmmp"
Jul 08 22:29:58.623609 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.623262    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-var-lib-kubelet\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.623609 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.623280    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-host-kubelet\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.624300 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.623296    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/69e328b9-bad4-4f6e-8a09-1822adbf2806-ovn-node-metrics-cert\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.624300 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.623312    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2msh\" (UniqueName: \"kubernetes.io/projected/2e724aeb-b00e-499f-adda-36a36e5c11cd-kube-api-access-b2msh\") pod \"iptables-alerter-2whz6\" (UID: \"2e724aeb-b00e-499f-adda-36a36e5c11cd\") " pod="openshift-network-operator/iptables-alerter-2whz6"
Jul 08 22:29:58.624300 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.623341    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5wgh\" (UniqueName: \"kubernetes.io/projected/bceb966d-d92e-4e29-a088-a8d5e526c017-kube-api-access-r5wgh\") pod \"aws-ebs-csi-driver-node-hkgxk\" (UID: \"bceb966d-d92e-4e29-a088-a8d5e526c017\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.624300 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.623357    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-etc-modprobe-d\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.624300 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.623372    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-run-ovn\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.624300 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.623420    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.624300 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.623481    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-782zx\" (UniqueName: \"kubernetes.io/projected/d08b2cb9-aff6-407b-9a7f-5b72d056ac1f-kube-api-access-782zx\") pod \"node-resolver-bkxht\" (UID: \"d08b2cb9-aff6-407b-9a7f-5b72d056ac1f\") " pod="openshift-dns/node-resolver-bkxht"
Jul 08 22:29:58.624300 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.623505    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8b2130bb-674a-4490-9da0-9576901ea3b5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.625374 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.625356    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 22:29:58.648907 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.648881    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4rmkk"
Jul 08 22:29:58.657471 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.657446    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4rmkk"
Jul 08 22:29:58.712900 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.710606    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 22:29:58.724201 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.724170    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-var-lib-kubelet\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.724201 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.724203    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-host-kubelet\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.724425 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.724221    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/69e328b9-bad4-4f6e-8a09-1822adbf2806-ovn-node-metrics-cert\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.724425 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.724256    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2msh\" (UniqueName: \"kubernetes.io/projected/2e724aeb-b00e-499f-adda-36a36e5c11cd-kube-api-access-b2msh\") pod \"iptables-alerter-2whz6\" (UID: \"2e724aeb-b00e-499f-adda-36a36e5c11cd\") " pod="openshift-network-operator/iptables-alerter-2whz6"
Jul 08 22:29:58.724425 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.724286    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-cni-binary-copy\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.724425 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.724325    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-var-lib-kubelet\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.724425 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.724328    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-host-kubelet\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.724425 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.724416    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-multus-daemon-config\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.724753 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.724442    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5wgh\" (UniqueName: \"kubernetes.io/projected/bceb966d-d92e-4e29-a088-a8d5e526c017-kube-api-access-r5wgh\") pod \"aws-ebs-csi-driver-node-hkgxk\" (UID: \"bceb966d-d92e-4e29-a088-a8d5e526c017\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.724753 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.724470    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-multus-cni-dir\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.724753 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.724510    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-host-var-lib-cni-multus\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.724753 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.724528    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-etc-modprobe-d\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.724753 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.724589    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-run-ovn\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.724753 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.724609    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.724753 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.724641    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-782zx\" (UniqueName: \"kubernetes.io/projected/d08b2cb9-aff6-407b-9a7f-5b72d056ac1f-kube-api-access-782zx\") pod \"node-resolver-bkxht\" (UID: \"d08b2cb9-aff6-407b-9a7f-5b72d056ac1f\") " pod="openshift-dns/node-resolver-bkxht"
Jul 08 22:29:58.724753 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.724687    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8b2130bb-674a-4490-9da0-9576901ea3b5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.724753 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.724687    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-run-ovn\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.724753 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.724699    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.724753 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.724716    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-etc-modprobe-d\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.725215 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.724749    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 22:29:58.725215 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.724965    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-os-release\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.725215 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725101    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs\") pod \"network-metrics-daemon-dnccf\" (UID: \"5ec93cb5-8277-4f5c-a711-1fca9b9cc78a\") " pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:29:58.725215 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725155    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bceb966d-d92e-4e29-a088-a8d5e526c017-registration-dir\") pod \"aws-ebs-csi-driver-node-hkgxk\" (UID: \"bceb966d-d92e-4e29-a088-a8d5e526c017\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.725215 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725189    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-etc-sysctl-d\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.725363 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725226    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d08b2cb9-aff6-407b-9a7f-5b72d056ac1f-tmp-dir\") pod \"node-resolver-bkxht\" (UID: \"d08b2cb9-aff6-407b-9a7f-5b72d056ac1f\") " pod="openshift-dns/node-resolver-bkxht"
Jul 08 22:29:58.725363 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725243    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e724aeb-b00e-499f-adda-36a36e5c11cd-host-slash\") pod \"iptables-alerter-2whz6\" (UID: \"2e724aeb-b00e-499f-adda-36a36e5c11cd\") " pod="openshift-network-operator/iptables-alerter-2whz6"
Jul 08 22:29:58.725363 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725258    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e133bfb-27da-4990-aac3-8ea961563fd8-dbus\") pod \"global-pull-secret-syncer-ztbq2\" (UID: \"8e133bfb-27da-4990-aac3-8ea961563fd8\") " pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:29:58.725363 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725279    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-multus-conf-dir\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.725363 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725302    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-sys\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.725363 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725323    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-host-cni-netd\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.725363 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725342    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-system-cni-dir\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.725565 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725366    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-multus-socket-dir-parent\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.725565 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725370    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8b2130bb-674a-4490-9da0-9576901ea3b5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.725565 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725411    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e724aeb-b00e-499f-adda-36a36e5c11cd-host-slash\") pod \"iptables-alerter-2whz6\" (UID: \"2e724aeb-b00e-499f-adda-36a36e5c11cd\") " pod="openshift-network-operator/iptables-alerter-2whz6"
Jul 08 22:29:58.725565 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725438    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-host-run-netns\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.725565 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725460    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13d80c7f-b517-4acf-8354-a317c8e556c8-serviceca\") pod \"node-ca-ncmmp\" (UID: \"13d80c7f-b517-4acf-8354-a317c8e556c8\") " pod="openshift-image-registry/node-ca-ncmmp"
Jul 08 22:29:58.725565 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725477    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed9aca41-1f6d-4e12-aece-add3905b100d-tmp\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.725565 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725493    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-var-lib-openvswitch\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.725565 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725560    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e133bfb-27da-4990-aac3-8ea961563fd8-dbus\") pod \"global-pull-secret-syncer-ztbq2\" (UID: \"8e133bfb-27da-4990-aac3-8ea961563fd8\") " pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:29:58.725814 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725568    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b2130bb-674a-4490-9da0-9576901ea3b5-cnibin\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.725814 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725602    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-etc-sysctl-d\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.725814 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725641    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-sys\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.725814 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725622    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b2130bb-674a-4490-9da0-9576901ea3b5-cni-binary-copy\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.725814 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725693    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-var-lib-openvswitch\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.725814 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725699    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8b2130bb-674a-4490-9da0-9576901ea3b5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.725814 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725780    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-host-cni-netd\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.725814 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.725780    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6rqk\" (UniqueName: \"kubernetes.io/projected/8b2130bb-674a-4490-9da0-9576901ea3b5-kube-api-access-m6rqk\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.726220 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726017    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-host\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.726220 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726049    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p9fd\" (UniqueName: \"kubernetes.io/projected/13d80c7f-b517-4acf-8354-a317c8e556c8-kube-api-access-4p9fd\") pod \"node-ca-ncmmp\" (UID: \"13d80c7f-b517-4acf-8354-a317c8e556c8\") " pod="openshift-image-registry/node-ca-ncmmp"
Jul 08 22:29:58.726220 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726075    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5n66\" (UniqueName: \"kubernetes.io/projected/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-kube-api-access-z5n66\") pod \"network-metrics-daemon-dnccf\" (UID: \"5ec93cb5-8277-4f5c-a711-1fca9b9cc78a\") " pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:29:58.726220 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726107    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13d80c7f-b517-4acf-8354-a317c8e556c8-serviceca\") pod \"node-ca-ncmmp\" (UID: \"13d80c7f-b517-4acf-8354-a317c8e556c8\") " pod="openshift-image-registry/node-ca-ncmmp"
Jul 08 22:29:58.726679 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726499    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b2130bb-674a-4490-9da0-9576901ea3b5-cni-binary-copy\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.726679 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726506    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bceb966d-d92e-4e29-a088-a8d5e526c017-device-dir\") pod \"aws-ebs-csi-driver-node-hkgxk\" (UID: \"bceb966d-d92e-4e29-a088-a8d5e526c017\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.726679 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726525    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b2130bb-674a-4490-9da0-9576901ea3b5-cnibin\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.726679 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726561    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bceb966d-d92e-4e29-a088-a8d5e526c017-sys-fs\") pod \"aws-ebs-csi-driver-node-hkgxk\" (UID: \"bceb966d-d92e-4e29-a088-a8d5e526c017\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.726679 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726572    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bceb966d-d92e-4e29-a088-a8d5e526c017-device-dir\") pod \"aws-ebs-csi-driver-node-hkgxk\" (UID: \"bceb966d-d92e-4e29-a088-a8d5e526c017\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.726679 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726575    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bceb966d-d92e-4e29-a088-a8d5e526c017-registration-dir\") pod \"aws-ebs-csi-driver-node-hkgxk\" (UID: \"bceb966d-d92e-4e29-a088-a8d5e526c017\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.726679 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726589    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-host-run-netns\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.726679 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726641    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-host-run-netns\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.727187 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726698    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-etc-openvswitch\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.727187 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726750    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bceb966d-d92e-4e29-a088-a8d5e526c017-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hkgxk\" (UID: \"bceb966d-d92e-4e29-a088-a8d5e526c017\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.727187 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726769    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-etc-sysconfig\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.727187 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726802    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-etc-systemd\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.727187 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726800    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bceb966d-d92e-4e29-a088-a8d5e526c017-sys-fs\") pod \"aws-ebs-csi-driver-node-hkgxk\" (UID: \"bceb966d-d92e-4e29-a088-a8d5e526c017\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.727187 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726817    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-lib-modules\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.727187 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726849    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-run-openvswitch\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.727187 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726910    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-etc-openvswitch\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.727187 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726913    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-node-log\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.727187 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726957    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-node-log\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.727187 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.726998    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bceb966d-d92e-4e29-a088-a8d5e526c017-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hkgxk\" (UID: \"bceb966d-d92e-4e29-a088-a8d5e526c017\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.727187 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727036    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-lib-modules\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.727187 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727044    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-etc-systemd\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.727187 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727080    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6aa3ac3b-8e3c-4b9b-b33e-03aaf9676e60-konnectivity-ca\") pod \"konnectivity-agent-rx5xn\" (UID: \"6aa3ac3b-8e3c-4b9b-b33e-03aaf9676e60\") " pod="kube-system/konnectivity-agent-rx5xn"
Jul 08 22:29:58.727187 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727091    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-run-openvswitch\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.727187 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727110    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b2130bb-674a-4490-9da0-9576901ea3b5-os-release\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.727187 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727158    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-etc-sysconfig\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.727187 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727166    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d08b2cb9-aff6-407b-9a7f-5b72d056ac1f-tmp-dir\") pod \"node-resolver-bkxht\" (UID: \"d08b2cb9-aff6-407b-9a7f-5b72d056ac1f\") " pod="openshift-dns/node-resolver-bkxht"
Jul 08 22:29:58.728203 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727177    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b2130bb-674a-4490-9da0-9576901ea3b5-os-release\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.728203 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727199    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-host\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.728203 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727217    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bceb966d-d92e-4e29-a088-a8d5e526c017-socket-dir\") pod \"aws-ebs-csi-driver-node-hkgxk\" (UID: \"bceb966d-d92e-4e29-a088-a8d5e526c017\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.728203 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727448    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bceb966d-d92e-4e29-a088-a8d5e526c017-socket-dir\") pod \"aws-ebs-csi-driver-node-hkgxk\" (UID: \"bceb966d-d92e-4e29-a088-a8d5e526c017\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.728203 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727495    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbml5\" (UniqueName: \"kubernetes.io/projected/69e328b9-bad4-4f6e-8a09-1822adbf2806-kube-api-access-rbml5\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.728203 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727543    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6aa3ac3b-8e3c-4b9b-b33e-03aaf9676e60-agent-certs\") pod \"konnectivity-agent-rx5xn\" (UID: \"6aa3ac3b-8e3c-4b9b-b33e-03aaf9676e60\") " pod="kube-system/konnectivity-agent-rx5xn"
Jul 08 22:29:58.728203 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727593    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-host-run-k8s-cni-cncf-io\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.728203 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727630    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-host-var-lib-cni-bin\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.728203 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727664    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-host-run-multus-certs\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.728203 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727698    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbfds\" (UniqueName: \"kubernetes.io/projected/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-kube-api-access-gbfds\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.728203 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727737    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-host-slash\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.728203 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727787    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/69e328b9-bad4-4f6e-8a09-1822adbf2806-env-overrides\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.728203 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727821    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d08b2cb9-aff6-407b-9a7f-5b72d056ac1f-hosts-file\") pod \"node-resolver-bkxht\" (UID: \"d08b2cb9-aff6-407b-9a7f-5b72d056ac1f\") " pod="openshift-dns/node-resolver-bkxht"
Jul 08 22:29:58.728203 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727853    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e724aeb-b00e-499f-adda-36a36e5c11cd-iptables-alerter-script\") pod \"iptables-alerter-2whz6\" (UID: \"2e724aeb-b00e-499f-adda-36a36e5c11cd\") " pod="openshift-network-operator/iptables-alerter-2whz6"
Jul 08 22:29:58.728203 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727856    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6aa3ac3b-8e3c-4b9b-b33e-03aaf9676e60-konnectivity-ca\") pod \"konnectivity-agent-rx5xn\" (UID: \"6aa3ac3b-8e3c-4b9b-b33e-03aaf9676e60\") " pod="kube-system/konnectivity-agent-rx5xn"
Jul 08 22:29:58.728203 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727877    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-host-slash\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.728203 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727899    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e133bfb-27da-4990-aac3-8ea961563fd8-kubelet-config\") pod \"global-pull-secret-syncer-ztbq2\" (UID: \"8e133bfb-27da-4990-aac3-8ea961563fd8\") " pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:29:58.729067 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.727948    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ed9aca41-1f6d-4e12-aece-add3905b100d-etc-tuned\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.729067 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728003    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-etc-kubernetes\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.729067 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728056    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b2130bb-674a-4490-9da0-9576901ea3b5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.729067 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728076    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d08b2cb9-aff6-407b-9a7f-5b72d056ac1f-hosts-file\") pod \"node-resolver-bkxht\" (UID: \"d08b2cb9-aff6-407b-9a7f-5b72d056ac1f\") " pod="openshift-dns/node-resolver-bkxht"
Jul 08 22:29:58.729067 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728086    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-hostroot\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.729067 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728135    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e133bfb-27da-4990-aac3-8ea961563fd8-kubelet-config\") pod \"global-pull-secret-syncer-ztbq2\" (UID: \"8e133bfb-27da-4990-aac3-8ea961563fd8\") " pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:29:58.729067 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728166    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret\") pod \"global-pull-secret-syncer-ztbq2\" (UID: \"8e133bfb-27da-4990-aac3-8ea961563fd8\") " pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:29:58.729067 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728197    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95jk7\" (UniqueName: \"kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7\") pod \"network-check-target-tfjmn\" (UID: \"b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e\") " pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:29:58.729067 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728224    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-run-systemd\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.729067 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728268    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-host-run-ovn-kubernetes\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.729067 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728311    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-host-cni-bin\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.729067 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728338    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bceb966d-d92e-4e29-a088-a8d5e526c017-etc-selinux\") pod \"aws-ebs-csi-driver-node-hkgxk\" (UID: \"bceb966d-d92e-4e29-a088-a8d5e526c017\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.729067 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728365    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdfhp\" (UniqueName: \"kubernetes.io/projected/ed9aca41-1f6d-4e12-aece-add3905b100d-kube-api-access-kdfhp\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.729067 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728407    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-log-socket\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.729067 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728434    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/69e328b9-bad4-4f6e-8a09-1822adbf2806-ovnkube-config\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.729067 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728462    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-run\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.729067 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728488    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-etc-sysctl-conf\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.729993 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728493    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/69e328b9-bad4-4f6e-8a09-1822adbf2806-env-overrides\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.729993 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728514    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b2130bb-674a-4490-9da0-9576901ea3b5-system-cni-dir\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.729993 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728570    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-cnibin\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.729993 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728597    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-host-var-lib-kubelet\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.729993 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728654    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-etc-kubernetes\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.729993 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728660    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-systemd-units\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.729993 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728719    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/69e328b9-bad4-4f6e-8a09-1822adbf2806-ovnkube-script-lib\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.729993 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728746    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-etc-kubernetes\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.729993 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728770    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13d80c7f-b517-4acf-8354-a317c8e556c8-host\") pod \"node-ca-ncmmp\" (UID: \"13d80c7f-b517-4acf-8354-a317c8e556c8\") " pod="openshift-image-registry/node-ca-ncmmp"
Jul 08 22:29:58.729993 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.728881    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13d80c7f-b517-4acf-8354-a317c8e556c8-host\") pod \"node-ca-ncmmp\" (UID: \"13d80c7f-b517-4acf-8354-a317c8e556c8\") " pod="openshift-image-registry/node-ca-ncmmp"
Jul 08 22:29:58.729993 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:58.728991    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 22:29:58.729993 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.729019    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/69e328b9-bad4-4f6e-8a09-1822adbf2806-ovn-node-metrics-cert\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.729993 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:58.729089    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret podName:8e133bfb-27da-4990-aac3-8ea961563fd8 nodeName:}" failed. No retries permitted until 2026-07-08 22:29:59.229059936 +0000 UTC m=+3.005795322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret") pod "global-pull-secret-syncer-ztbq2" (UID: "8e133bfb-27da-4990-aac3-8ea961563fd8") : object "kube-system"/"original-pull-secret" not registered
Jul 08 22:29:58.729993 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.729103    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-run\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.729993 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.729221    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ed9aca41-1f6d-4e12-aece-add3905b100d-etc-sysctl-conf\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.729993 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.729272    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b2130bb-674a-4490-9da0-9576901ea3b5-system-cni-dir\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.729993 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.729334    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-run-systemd\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.730849 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.729384    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-host-run-ovn-kubernetes\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.730849 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.729452    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-host-cni-bin\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.730849 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.729541    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bceb966d-d92e-4e29-a088-a8d5e526c017-etc-selinux\") pod \"aws-ebs-csi-driver-node-hkgxk\" (UID: \"bceb966d-d92e-4e29-a088-a8d5e526c017\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.730849 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.729591    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-log-socket\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.730849 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.729710    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b2130bb-674a-4490-9da0-9576901ea3b5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.730849 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.730115    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/69e328b9-bad4-4f6e-8a09-1822adbf2806-ovnkube-config\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.730849 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.730169    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e724aeb-b00e-499f-adda-36a36e5c11cd-iptables-alerter-script\") pod \"iptables-alerter-2whz6\" (UID: \"2e724aeb-b00e-499f-adda-36a36e5c11cd\") " pod="openshift-network-operator/iptables-alerter-2whz6"
Jul 08 22:29:58.730849 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.730236    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/69e328b9-bad4-4f6e-8a09-1822adbf2806-systemd-units\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.730849 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.730290    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/69e328b9-bad4-4f6e-8a09-1822adbf2806-ovnkube-script-lib\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.731855 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:58.731374    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:29:58.731855 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.731426    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6aa3ac3b-8e3c-4b9b-b33e-03aaf9676e60-agent-certs\") pod \"konnectivity-agent-rx5xn\" (UID: \"6aa3ac3b-8e3c-4b9b-b33e-03aaf9676e60\") " pod="kube-system/konnectivity-agent-rx5xn"
Jul 08 22:29:58.731855 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:58.731483    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs podName:5ec93cb5-8277-4f5c-a711-1fca9b9cc78a nodeName:}" failed. No retries permitted until 2026-07-08 22:29:59.231463777 +0000 UTC m=+3.008199168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs") pod "network-metrics-daemon-dnccf" (UID: "5ec93cb5-8277-4f5c-a711-1fca9b9cc78a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:29:58.731855 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.731812    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8b2130bb-674a-4490-9da0-9576901ea3b5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.733305 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.733279    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ed9aca41-1f6d-4e12-aece-add3905b100d-etc-tuned\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.733441 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.733351    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed9aca41-1f6d-4e12-aece-add3905b100d-tmp\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.737642 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:58.737620    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 22:29:58.737763 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:58.737652    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 22:29:58.737763 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:58.737667    2558 projected.go:196] Error preparing data for projected volume kube-api-access-95jk7 for pod openshift-network-diagnostics/network-check-target-tfjmn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:29:58.737873 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:58.737768    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7 podName:b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e nodeName:}" failed. No retries permitted until 2026-07-08 22:29:59.237745668 +0000 UTC m=+3.014481055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-95jk7" (UniqueName: "kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7") pod "network-check-target-tfjmn" (UID: "b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:29:58.738212 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.738184    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2msh\" (UniqueName: \"kubernetes.io/projected/2e724aeb-b00e-499f-adda-36a36e5c11cd-kube-api-access-b2msh\") pod \"iptables-alerter-2whz6\" (UID: \"2e724aeb-b00e-499f-adda-36a36e5c11cd\") " pod="openshift-network-operator/iptables-alerter-2whz6"
Jul 08 22:29:58.739447 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.739420    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5wgh\" (UniqueName: \"kubernetes.io/projected/bceb966d-d92e-4e29-a088-a8d5e526c017-kube-api-access-r5wgh\") pod \"aws-ebs-csi-driver-node-hkgxk\" (UID: \"bceb966d-d92e-4e29-a088-a8d5e526c017\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.742373 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.739850    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-782zx\" (UniqueName: \"kubernetes.io/projected/d08b2cb9-aff6-407b-9a7f-5b72d056ac1f-kube-api-access-782zx\") pod \"node-resolver-bkxht\" (UID: \"d08b2cb9-aff6-407b-9a7f-5b72d056ac1f\") " pod="openshift-dns/node-resolver-bkxht"
Jul 08 22:29:58.742373 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.741447    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbml5\" (UniqueName: \"kubernetes.io/projected/69e328b9-bad4-4f6e-8a09-1822adbf2806-kube-api-access-rbml5\") pod \"ovnkube-node-2484w\" (UID: \"69e328b9-bad4-4f6e-8a09-1822adbf2806\") " pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.743344 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.743318    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6rqk\" (UniqueName: \"kubernetes.io/projected/8b2130bb-674a-4490-9da0-9576901ea3b5-kube-api-access-m6rqk\") pod \"multus-additional-cni-plugins-2ctjg\" (UID: \"8b2130bb-674a-4490-9da0-9576901ea3b5\") " pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.743648 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.743627    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5n66\" (UniqueName: \"kubernetes.io/projected/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-kube-api-access-z5n66\") pod \"network-metrics-daemon-dnccf\" (UID: \"5ec93cb5-8277-4f5c-a711-1fca9b9cc78a\") " pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:29:58.744015 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.743994    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p9fd\" (UniqueName: \"kubernetes.io/projected/13d80c7f-b517-4acf-8354-a317c8e556c8-kube-api-access-4p9fd\") pod \"node-ca-ncmmp\" (UID: \"13d80c7f-b517-4acf-8354-a317c8e556c8\") " pod="openshift-image-registry/node-ca-ncmmp"
Jul 08 22:29:58.745144 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.745089    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdfhp\" (UniqueName: \"kubernetes.io/projected/ed9aca41-1f6d-4e12-aece-add3905b100d-kube-api-access-kdfhp\") pod \"tuned-69qhf\" (UID: \"ed9aca41-1f6d-4e12-aece-add3905b100d\") " pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.829956 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.829916    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-host-run-k8s-cni-cncf-io\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830153 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.829971    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-host-var-lib-cni-bin\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830153 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830029    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-host-run-multus-certs\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830153 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830073    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbfds\" (UniqueName: \"kubernetes.io/projected/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-kube-api-access-gbfds\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830153 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830069    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-host-run-k8s-cni-cncf-io\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830153 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830036    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-host-var-lib-cni-bin\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830153 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830117    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-host-run-multus-certs\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830153 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830138    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-hostroot\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830432 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830192    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-cnibin\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830432 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830217    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-host-var-lib-kubelet\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830432 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830244    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-hostroot\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830432 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830284    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-etc-kubernetes\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830432 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830247    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-etc-kubernetes\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830432 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830299    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-cnibin\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830432 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830325    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-cni-binary-copy\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830432 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830342    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-host-var-lib-kubelet\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830432 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830352    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-multus-daemon-config\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830432 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830377    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-multus-cni-dir\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830432 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830401    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-host-var-lib-cni-multus\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830432 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830432    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-os-release\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830831 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830466    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-multus-conf-dir\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830831 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830494    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-system-cni-dir\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830831 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830525    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-multus-socket-dir-parent\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830831 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830549    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-host-run-netns\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830831 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830617    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-host-run-netns\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830831 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830677    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-multus-cni-dir\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830831 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830718    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-host-var-lib-cni-multus\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830831 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830781    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-os-release\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.830831 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830824    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-multus-conf-dir\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.831236 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830899    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-cni-binary-copy\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.831236 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830900    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-system-cni-dir\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.831236 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830968    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-multus-socket-dir-parent\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.831236 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.830997    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-multus-daemon-config\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.842944 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.842865    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbfds\" (UniqueName: \"kubernetes.io/projected/2d7cf662-b5c8-4f57-a9be-fabe9b63b441-kube-api-access-gbfds\") pod \"multus-zkxcb\" (UID: \"2d7cf662-b5c8-4f57-a9be-fabe9b63b441\") " pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:58.909311 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.909001    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ncmmp"
Jul 08 22:29:58.918995 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.918974    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk"
Jul 08 22:29:58.928100 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.927940    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-69qhf"
Jul 08 22:29:58.934655 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.934627    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bkxht"
Jul 08 22:29:58.943799 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.943779    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2whz6"
Jul 08 22:29:58.951668 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.951639    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:29:58.960564 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.960545    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rx5xn"
Jul 08 22:29:58.966711 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.966692    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2ctjg"
Jul 08 22:29:58.971569 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:58.971548    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zkxcb"
Jul 08 22:29:59.024277 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:59.024244    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 22:29:59.071758 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:59.071727    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 22:29:59.233309 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:59.233216    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret\") pod \"global-pull-secret-syncer-ztbq2\" (UID: \"8e133bfb-27da-4990-aac3-8ea961563fd8\") " pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:29:59.233309 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:59.233309    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs\") pod \"network-metrics-daemon-dnccf\" (UID: \"5ec93cb5-8277-4f5c-a711-1fca9b9cc78a\") " pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:29:59.233559 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:59.233358    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 22:29:59.233559 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:59.233423    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:29:59.233559 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:59.233431    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret podName:8e133bfb-27da-4990-aac3-8ea961563fd8 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:00.233408944 +0000 UTC m=+4.010144329 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret") pod "global-pull-secret-syncer-ztbq2" (UID: "8e133bfb-27da-4990-aac3-8ea961563fd8") : object "kube-system"/"original-pull-secret" not registered
Jul 08 22:29:59.233559 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:59.233480    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs podName:5ec93cb5-8277-4f5c-a711-1fca9b9cc78a nodeName:}" failed. No retries permitted until 2026-07-08 22:30:00.233460508 +0000 UTC m=+4.010195894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs") pod "network-metrics-daemon-dnccf" (UID: "5ec93cb5-8277-4f5c-a711-1fca9b9cc78a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:29:59.334300 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:59.334257    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95jk7\" (UniqueName: \"kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7\") pod \"network-check-target-tfjmn\" (UID: \"b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e\") " pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:29:59.334489 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:59.334464    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 22:29:59.334489 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:59.334490    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 22:29:59.334567 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:59.334500    2558 projected.go:196] Error preparing data for projected volume kube-api-access-95jk7 for pod openshift-network-diagnostics/network-check-target-tfjmn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:29:59.334600 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:59.334572    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7 podName:b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e nodeName:}" failed. No retries permitted until 2026-07-08 22:30:00.334556949 +0000 UTC m=+4.111292335 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-95jk7" (UniqueName: "kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7") pod "network-check-target-tfjmn" (UID: "b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:29:59.660242 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:59.660150    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 22:24:59 +0000 UTC" deadline="2027-12-24 02:40:08.889918298 +0000 UTC"
Jul 08 22:29:59.660242 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:59.660185    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12796h10m9.229737046s"
Jul 08 22:29:59.767456 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:59.767416    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:29:59.767638 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:29:59.767416    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:29:59.767638 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:59.767568    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjmn" podUID="b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e"
Jul 08 22:29:59.767772 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:29:59.767647    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztbq2" podUID="8e133bfb-27da-4990-aac3-8ea961563fd8"
Jul 08 22:29:59.825506 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:59.825361    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aa3ac3b_8e3c_4b9b_b33e_03aaf9676e60.slice/crio-c0e60539540f097e0edb49895cc2eba6c2feb1a74809e70436424fd3c18c0c0e WatchSource:0}: Error finding container c0e60539540f097e0edb49895cc2eba6c2feb1a74809e70436424fd3c18c0c0e: Status 404 returned error can't find the container with id c0e60539540f097e0edb49895cc2eba6c2feb1a74809e70436424fd3c18c0c0e
Jul 08 22:29:59.828306 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:59.828162    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbceb966d_d92e_4e29_a088_a8d5e526c017.slice/crio-1b92c980687f94ece4de625dade24f9afd2a472ffd05fa91970b0aff17f7953a WatchSource:0}: Error finding container 1b92c980687f94ece4de625dade24f9afd2a472ffd05fa91970b0aff17f7953a: Status 404 returned error can't find the container with id 1b92c980687f94ece4de625dade24f9afd2a472ffd05fa91970b0aff17f7953a
Jul 08 22:29:59.831683 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:59.831656    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b2130bb_674a_4490_9da0_9576901ea3b5.slice/crio-77d5fbb2b777e095e9d6226a6353b8deeb3d7a7ea31be9cfd83ab5b5577453da WatchSource:0}: Error finding container 77d5fbb2b777e095e9d6226a6353b8deeb3d7a7ea31be9cfd83ab5b5577453da: Status 404 returned error can't find the container with id 77d5fbb2b777e095e9d6226a6353b8deeb3d7a7ea31be9cfd83ab5b5577453da
Jul 08 22:29:59.833360 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:29:59.832694    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded9aca41_1f6d_4e12_aece_add3905b100d.slice/crio-6e354abb350b937388d80d4c69a73a77d1345e6e4932e8dcc9865c2e9b27da88 WatchSource:0}: Error finding container 6e354abb350b937388d80d4c69a73a77d1345e6e4932e8dcc9865c2e9b27da88: Status 404 returned error can't find the container with id 6e354abb350b937388d80d4c69a73a77d1345e6e4932e8dcc9865c2e9b27da88
Jul 08 22:30:00.244206 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:00.243933    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret\") pod \"global-pull-secret-syncer-ztbq2\" (UID: \"8e133bfb-27da-4990-aac3-8ea961563fd8\") " pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:30:00.244206 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:00.244200    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs\") pod \"network-metrics-daemon-dnccf\" (UID: \"5ec93cb5-8277-4f5c-a711-1fca9b9cc78a\") " pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:00.244441 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:00.244084    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 22:30:00.244441 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:00.244314    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:30:00.244441 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:00.244326    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret podName:8e133bfb-27da-4990-aac3-8ea961563fd8 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:02.244301879 +0000 UTC m=+6.021037269 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret") pod "global-pull-secret-syncer-ztbq2" (UID: "8e133bfb-27da-4990-aac3-8ea961563fd8") : object "kube-system"/"original-pull-secret" not registered
Jul 08 22:30:00.244441 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:00.244358    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs podName:5ec93cb5-8277-4f5c-a711-1fca9b9cc78a nodeName:}" failed. No retries permitted until 2026-07-08 22:30:02.244345901 +0000 UTC m=+6.021081270 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs") pod "network-metrics-daemon-dnccf" (UID: "5ec93cb5-8277-4f5c-a711-1fca9b9cc78a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:30:00.345664 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:00.345623    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95jk7\" (UniqueName: \"kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7\") pod \"network-check-target-tfjmn\" (UID: \"b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e\") " pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:30:00.345879 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:00.345842    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 22:30:00.345879 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:00.345870    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 22:30:00.346002 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:00.345885    2558 projected.go:196] Error preparing data for projected volume kube-api-access-95jk7 for pod openshift-network-diagnostics/network-check-target-tfjmn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:30:00.346002 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:00.345958    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7 podName:b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e nodeName:}" failed. No retries permitted until 2026-07-08 22:30:02.34593762 +0000 UTC m=+6.122673010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-95jk7" (UniqueName: "kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7") pod "network-check-target-tfjmn" (UID: "b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:30:00.660502 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:00.660372    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 22:24:59 +0000 UTC" deadline="2027-12-20 12:44:09.072995818 +0000 UTC"
Jul 08 22:30:00.660502 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:00.660442    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12710h14m8.412558069s"
Jul 08 22:30:00.770910 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:00.770343    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:00.770910 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:00.770505    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnccf" podUID="5ec93cb5-8277-4f5c-a711-1fca9b9cc78a"
Jul 08 22:30:00.792815 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:00.792656    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2484w" event={"ID":"69e328b9-bad4-4f6e-8a09-1822adbf2806","Type":"ContainerStarted","Data":"e57d97a49db8eefe43b1d21002c552352543faab647ee20b6e640ba30730856c"}
Jul 08 22:30:00.804046 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:00.804007    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2whz6" event={"ID":"2e724aeb-b00e-499f-adda-36a36e5c11cd","Type":"ContainerStarted","Data":"03389bfe02e80b8a95602d87698a1301bc90862af7e54bad6adf03120a68f738"}
Jul 08 22:30:00.812548 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:00.811430    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-69qhf" event={"ID":"ed9aca41-1f6d-4e12-aece-add3905b100d","Type":"ContainerStarted","Data":"6e354abb350b937388d80d4c69a73a77d1345e6e4932e8dcc9865c2e9b27da88"}
Jul 08 22:30:00.817767 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:00.817727    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk" event={"ID":"bceb966d-d92e-4e29-a088-a8d5e526c017","Type":"ContainerStarted","Data":"1b92c980687f94ece4de625dade24f9afd2a472ffd05fa91970b0aff17f7953a"}
Jul 08 22:30:00.827169 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:00.827126    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rx5xn" event={"ID":"6aa3ac3b-8e3c-4b9b-b33e-03aaf9676e60","Type":"ContainerStarted","Data":"c0e60539540f097e0edb49895cc2eba6c2feb1a74809e70436424fd3c18c0c0e"}
Jul 08 22:30:00.841302 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:00.841266    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-6.ec2.internal" event={"ID":"1ee323fd0beeb4f4f4622b1412db9e81","Type":"ContainerStarted","Data":"e26bcb24a6f0686413db735e07b957d3485deb35a560568bb8c73e9624c1ed0e"}
Jul 08 22:30:00.850939 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:00.850904    2558 generic.go:356] "Generic (PLEG): container finished" podID="effe46e935c29e4d46e44fc0f6ce837c" containerID="7e7a9fab0fd32a61b9192dd4e2f8b3b5696a6a66311c11f918587adaad8bf09e" exitCode=0
Jul 08 22:30:00.851115 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:00.851001    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-6.ec2.internal" event={"ID":"effe46e935c29e4d46e44fc0f6ce837c","Type":"ContainerDied","Data":"7e7a9fab0fd32a61b9192dd4e2f8b3b5696a6a66311c11f918587adaad8bf09e"}
Jul 08 22:30:00.859274 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:00.858664    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-6.ec2.internal" podStartSLOduration=2.85864207 podStartE2EDuration="2.85864207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:29:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:00.857771642 +0000 UTC m=+4.634507034" watchObservedRunningTime="2026-07-08 22:30:00.85864207 +0000 UTC m=+4.635377462"
Jul 08 22:30:00.877097 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:00.877056    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bkxht" event={"ID":"d08b2cb9-aff6-407b-9a7f-5b72d056ac1f","Type":"ContainerStarted","Data":"7190cbdd107a22cedd53327591367be88e0f8ca820c945478590353f25efaa07"}
Jul 08 22:30:00.883824 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:00.883779    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ncmmp" event={"ID":"13d80c7f-b517-4acf-8354-a317c8e556c8","Type":"ContainerStarted","Data":"b5e0fa10bf0c61def9aef59e8fa8e27b80d1625767cc65ff1dd108881e073d62"}
Jul 08 22:30:00.890104 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:00.890072    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ctjg" event={"ID":"8b2130bb-674a-4490-9da0-9576901ea3b5","Type":"ContainerStarted","Data":"77d5fbb2b777e095e9d6226a6353b8deeb3d7a7ea31be9cfd83ab5b5577453da"}
Jul 08 22:30:00.905343 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:00.905271    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zkxcb" event={"ID":"2d7cf662-b5c8-4f57-a9be-fabe9b63b441","Type":"ContainerStarted","Data":"2fde38d02050136847d9fb71cc5a7ab83a0e40087b3c147b9af7c8eff374e277"}
Jul 08 22:30:01.767408 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:01.767370    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:30:01.767967 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:01.767519    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztbq2" podUID="8e133bfb-27da-4990-aac3-8ea961563fd8"
Jul 08 22:30:01.768056 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:01.768006    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:30:01.768153 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:01.768125    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjmn" podUID="b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e"
Jul 08 22:30:01.943769 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:01.943675    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-6.ec2.internal" event={"ID":"effe46e935c29e4d46e44fc0f6ce837c","Type":"ContainerStarted","Data":"055ec30a7c7aafcf39ce0bef76ba1f5905876a0463cd043833e0410ce6e0659d"}
Jul 08 22:30:02.264537 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:02.264432    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs\") pod \"network-metrics-daemon-dnccf\" (UID: \"5ec93cb5-8277-4f5c-a711-1fca9b9cc78a\") " pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:02.264844 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:02.264586    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret\") pod \"global-pull-secret-syncer-ztbq2\" (UID: \"8e133bfb-27da-4990-aac3-8ea961563fd8\") " pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:30:02.268103 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:02.268065    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:30:02.268739 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:02.268717    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs podName:5ec93cb5-8277-4f5c-a711-1fca9b9cc78a nodeName:}" failed. No retries permitted until 2026-07-08 22:30:06.268675253 +0000 UTC m=+10.045410641 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs") pod "network-metrics-daemon-dnccf" (UID: "5ec93cb5-8277-4f5c-a711-1fca9b9cc78a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:30:02.268898 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:02.268869    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 22:30:02.268977 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:02.268936    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret podName:8e133bfb-27da-4990-aac3-8ea961563fd8 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:06.268921805 +0000 UTC m=+10.045657188 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret") pod "global-pull-secret-syncer-ztbq2" (UID: "8e133bfb-27da-4990-aac3-8ea961563fd8") : object "kube-system"/"original-pull-secret" not registered
Jul 08 22:30:02.365271 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:02.365229    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95jk7\" (UniqueName: \"kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7\") pod \"network-check-target-tfjmn\" (UID: \"b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e\") " pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:30:02.365477 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:02.365441    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 22:30:02.365477 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:02.365455    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 22:30:02.365477 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:02.365465    2558 projected.go:196] Error preparing data for projected volume kube-api-access-95jk7 for pod openshift-network-diagnostics/network-check-target-tfjmn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:30:02.365634 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:02.365512    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7 podName:b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e nodeName:}" failed. No retries permitted until 2026-07-08 22:30:06.365497695 +0000 UTC m=+10.142233061 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-95jk7" (UniqueName: "kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7") pod "network-check-target-tfjmn" (UID: "b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:30:02.768088 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:02.768052    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:02.768588 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:02.768352    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnccf" podUID="5ec93cb5-8277-4f5c-a711-1fca9b9cc78a"
Jul 08 22:30:03.767816 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:03.767775    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:30:03.767816 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:03.767796    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:30:03.768096 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:03.767920    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjmn" podUID="b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e"
Jul 08 22:30:03.768096 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:03.768052    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztbq2" podUID="8e133bfb-27da-4990-aac3-8ea961563fd8"
Jul 08 22:30:04.768070 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:04.767513    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:04.768070 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:04.767674    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnccf" podUID="5ec93cb5-8277-4f5c-a711-1fca9b9cc78a"
Jul 08 22:30:05.767420 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:05.767383    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:30:05.767616 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:05.767437    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:30:05.767616 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:05.767558    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjmn" podUID="b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e"
Jul 08 22:30:05.767702 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:05.767654    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztbq2" podUID="8e133bfb-27da-4990-aac3-8ea961563fd8"
Jul 08 22:30:06.298777 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:06.298735    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret\") pod \"global-pull-secret-syncer-ztbq2\" (UID: \"8e133bfb-27da-4990-aac3-8ea961563fd8\") " pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:30:06.299302 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:06.298820    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs\") pod \"network-metrics-daemon-dnccf\" (UID: \"5ec93cb5-8277-4f5c-a711-1fca9b9cc78a\") " pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:06.299302 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:06.298973    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:30:06.299302 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:06.299039    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs podName:5ec93cb5-8277-4f5c-a711-1fca9b9cc78a nodeName:}" failed. No retries permitted until 2026-07-08 22:30:14.299018677 +0000 UTC m=+18.075754060 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs") pod "network-metrics-daemon-dnccf" (UID: "5ec93cb5-8277-4f5c-a711-1fca9b9cc78a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:30:06.299557 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:06.299472    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 22:30:06.299557 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:06.299531    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret podName:8e133bfb-27da-4990-aac3-8ea961563fd8 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:14.299512436 +0000 UTC m=+18.076247808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret") pod "global-pull-secret-syncer-ztbq2" (UID: "8e133bfb-27da-4990-aac3-8ea961563fd8") : object "kube-system"/"original-pull-secret" not registered
Jul 08 22:30:06.399720 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:06.399676    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95jk7\" (UniqueName: \"kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7\") pod \"network-check-target-tfjmn\" (UID: \"b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e\") " pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:30:06.399950 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:06.399893    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 22:30:06.399950 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:06.399917    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 22:30:06.399950 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:06.399931    2558 projected.go:196] Error preparing data for projected volume kube-api-access-95jk7 for pod openshift-network-diagnostics/network-check-target-tfjmn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:30:06.400106 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:06.399992    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7 podName:b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e nodeName:}" failed. No retries permitted until 2026-07-08 22:30:14.399971894 +0000 UTC m=+18.176707289 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-95jk7" (UniqueName: "kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7") pod "network-check-target-tfjmn" (UID: "b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:30:06.767896 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:06.767811    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:06.768043 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:06.767962    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnccf" podUID="5ec93cb5-8277-4f5c-a711-1fca9b9cc78a"
Jul 08 22:30:07.766865 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:07.766827    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:30:07.767309 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:07.766973    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjmn" podUID="b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e"
Jul 08 22:30:07.767365 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:07.767326    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:30:07.767429 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:07.767402    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztbq2" podUID="8e133bfb-27da-4990-aac3-8ea961563fd8"
Jul 08 22:30:08.767539 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:08.767504    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:08.768037 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:08.767662    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnccf" podUID="5ec93cb5-8277-4f5c-a711-1fca9b9cc78a"
Jul 08 22:30:09.767767 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:09.767718    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:30:09.768278 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:09.767908    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjmn" podUID="b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e"
Jul 08 22:30:09.768421 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:09.768392    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:30:09.768532 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:09.768505    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztbq2" podUID="8e133bfb-27da-4990-aac3-8ea961563fd8"
Jul 08 22:30:10.768112 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:10.767602    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:10.768112 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:10.767747    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnccf" podUID="5ec93cb5-8277-4f5c-a711-1fca9b9cc78a"
Jul 08 22:30:11.767026 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:11.766989    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:30:11.767218 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:11.767037    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:30:11.767218 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:11.767121    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztbq2" podUID="8e133bfb-27da-4990-aac3-8ea961563fd8"
Jul 08 22:30:11.767331 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:11.767268    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjmn" podUID="b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e"
Jul 08 22:30:12.767509 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:12.767478    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:12.768048 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:12.767617    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnccf" podUID="5ec93cb5-8277-4f5c-a711-1fca9b9cc78a"
Jul 08 22:30:13.767521 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:13.767481    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:30:13.768043 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:13.767536    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:30:13.768043 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:13.767619    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztbq2" podUID="8e133bfb-27da-4990-aac3-8ea961563fd8"
Jul 08 22:30:13.768043 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:13.767761    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjmn" podUID="b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e"
Jul 08 22:30:14.366728 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:14.366698    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs\") pod \"network-metrics-daemon-dnccf\" (UID: \"5ec93cb5-8277-4f5c-a711-1fca9b9cc78a\") " pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:14.366966 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:14.366768    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret\") pod \"global-pull-secret-syncer-ztbq2\" (UID: \"8e133bfb-27da-4990-aac3-8ea961563fd8\") " pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:30:14.366966 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:14.366833    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:30:14.366966 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:14.366886    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 22:30:14.366966 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:14.366901    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs podName:5ec93cb5-8277-4f5c-a711-1fca9b9cc78a nodeName:}" failed. No retries permitted until 2026-07-08 22:30:30.366880483 +0000 UTC m=+34.143615850 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs") pod "network-metrics-daemon-dnccf" (UID: "5ec93cb5-8277-4f5c-a711-1fca9b9cc78a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:30:14.366966 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:14.366926    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret podName:8e133bfb-27da-4990-aac3-8ea961563fd8 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:30.366914806 +0000 UTC m=+34.143650190 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret") pod "global-pull-secret-syncer-ztbq2" (UID: "8e133bfb-27da-4990-aac3-8ea961563fd8") : object "kube-system"/"original-pull-secret" not registered
Jul 08 22:30:14.467931 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:14.467888    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95jk7\" (UniqueName: \"kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7\") pod \"network-check-target-tfjmn\" (UID: \"b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e\") " pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:30:14.468124 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:14.468057    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 22:30:14.468124 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:14.468082    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 22:30:14.468124 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:14.468095    2558 projected.go:196] Error preparing data for projected volume kube-api-access-95jk7 for pod openshift-network-diagnostics/network-check-target-tfjmn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:30:14.468280 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:14.468160    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7 podName:b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e nodeName:}" failed. No retries permitted until 2026-07-08 22:30:30.468140857 +0000 UTC m=+34.244876241 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-95jk7" (UniqueName: "kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7") pod "network-check-target-tfjmn" (UID: "b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:30:14.767252 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:14.767172    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:14.767417 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:14.767303    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnccf" podUID="5ec93cb5-8277-4f5c-a711-1fca9b9cc78a"
Jul 08 22:30:15.767038 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:15.767003    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:30:15.767501 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:15.767045    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:30:15.767501 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:15.767132    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjmn" podUID="b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e"
Jul 08 22:30:15.767501 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:15.767279    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztbq2" podUID="8e133bfb-27da-4990-aac3-8ea961563fd8"
Jul 08 22:30:16.768222 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:16.768187    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:16.768683 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:16.768296    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnccf" podUID="5ec93cb5-8277-4f5c-a711-1fca9b9cc78a"
Jul 08 22:30:17.767683 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:17.767648    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:30:17.767886 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:17.767649    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:30:17.767886 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:17.767771    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztbq2" podUID="8e133bfb-27da-4990-aac3-8ea961563fd8"
Jul 08 22:30:17.768030 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:17.767880    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjmn" podUID="b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e"
Jul 08 22:30:18.767763 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:18.767728    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:18.768261 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:18.767875    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnccf" podUID="5ec93cb5-8277-4f5c-a711-1fca9b9cc78a"
Jul 08 22:30:19.767683 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:19.767387    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:30:19.767793 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:19.767387    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:30:19.767793 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:19.767748    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztbq2" podUID="8e133bfb-27da-4990-aac3-8ea961563fd8"
Jul 08 22:30:19.768376 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:19.767841    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjmn" podUID="b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e"
Jul 08 22:30:19.985985 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:19.985951    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk" event={"ID":"bceb966d-d92e-4e29-a088-a8d5e526c017","Type":"ContainerStarted","Data":"c85da735bc79dbc962ac8b6fc217bb14236f4058ee124cdcf402a49d1ef9b52d"}
Jul 08 22:30:19.987342 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:19.987314    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rx5xn" event={"ID":"6aa3ac3b-8e3c-4b9b-b33e-03aaf9676e60","Type":"ContainerStarted","Data":"1d53993ac0a810edc2d2fd8a92f103939dc1d10f39c83f84426e7c443ee8197e"}
Jul 08 22:30:19.988640 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:19.988617    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bkxht" event={"ID":"d08b2cb9-aff6-407b-9a7f-5b72d056ac1f","Type":"ContainerStarted","Data":"ec0f66eea03d336a315c8a75afaea580e01024477fee09aa104e1745d6dfc6f7"}
Jul 08 22:30:19.989936 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:19.989914    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ncmmp" event={"ID":"13d80c7f-b517-4acf-8354-a317c8e556c8","Type":"ContainerStarted","Data":"50370cea286b31c764eeaf9910bf53b16fb5866d1bef70a1240d8784486722c1"}
Jul 08 22:30:19.996571 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:19.996548    2558 generic.go:356] "Generic (PLEG): container finished" podID="8b2130bb-674a-4490-9da0-9576901ea3b5" containerID="0b63fb909826cccc749b65a1ec46d572397a19eb262d329d9998daa105a1f974" exitCode=0
Jul 08 22:30:19.996644 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:19.996624    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ctjg" event={"ID":"8b2130bb-674a-4490-9da0-9576901ea3b5","Type":"ContainerDied","Data":"0b63fb909826cccc749b65a1ec46d572397a19eb262d329d9998daa105a1f974"}
Jul 08 22:30:19.997897 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:19.997877    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zkxcb" event={"ID":"2d7cf662-b5c8-4f57-a9be-fabe9b63b441","Type":"ContainerStarted","Data":"84a3966a93d6b706b145d1024e12caec843d9d645ab93d21a91a1af370835340"}
Jul 08 22:30:20.004301 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:20.004243    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2484w" event={"ID":"69e328b9-bad4-4f6e-8a09-1822adbf2806","Type":"ContainerStarted","Data":"51e34604ad6ca63247b0cd0e85de5a1d671a813e655ea07fda07982674999908"}
Jul 08 22:30:20.004381 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:20.004350    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2484w" event={"ID":"69e328b9-bad4-4f6e-8a09-1822adbf2806","Type":"ContainerStarted","Data":"c08de8449c8a37c3211b69f4295d7722de732b60b513d34c8bd5c419464cf7da"}
Jul 08 22:30:20.004432 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:20.004401    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2484w" event={"ID":"69e328b9-bad4-4f6e-8a09-1822adbf2806","Type":"ContainerStarted","Data":"350e958c3a2da020cafe12f5787ff772d5f41f54514c1b6daa7a399cefd54ff9"}
Jul 08 22:30:20.004483 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:20.004452    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2484w" event={"ID":"69e328b9-bad4-4f6e-8a09-1822adbf2806","Type":"ContainerStarted","Data":"5b4f5f0addce951a3844460a6ba043793c3e4cf4aebfea3b70ce012d983dc57f"}
Jul 08 22:30:20.005554 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:20.005534    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-69qhf" event={"ID":"ed9aca41-1f6d-4e12-aece-add3905b100d","Type":"ContainerStarted","Data":"4fd99f4ed8d3451d71b3aaa01dfba4ba7925cd86c1d16cb32e168684bc69b831"}
Jul 08 22:30:20.008310 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:20.008275    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-6.ec2.internal" podStartSLOduration=22.008263491 podStartE2EDuration="22.008263491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:29:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:01.962226794 +0000 UTC m=+5.738962191" watchObservedRunningTime="2026-07-08 22:30:20.008263491 +0000 UTC m=+23.784998878"
Jul 08 22:30:20.008404 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:20.008366    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rx5xn" podStartSLOduration=7.866301612 podStartE2EDuration="23.008362106s" totalImagesPullingTime="15.142060494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:20.007965603 +0000 UTC m=+23.784700990" watchObservedRunningTime="2026-07-08 22:30:20.008362106 +0000 UTC m=+23.785097541"
Jul 08 22:30:20.025923 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:20.025880    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-69qhf" podStartSLOduration=3.516319397 podStartE2EDuration="23.025868589s" totalImagesPullingTime="19.509549192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:20.025868431 +0000 UTC m=+23.802603819" watchObservedRunningTime="2026-07-08 22:30:20.025868589 +0000 UTC m=+23.802603974"
Jul 08 22:30:20.044154 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:20.044109    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zkxcb" podStartSLOduration=3.462789677 podStartE2EDuration="23.044094764s" totalImagesPullingTime="19.581305087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:20.043914625 +0000 UTC m=+23.820650012" watchObservedRunningTime="2026-07-08 22:30:20.044094764 +0000 UTC m=+23.820830151"
Jul 08 22:30:20.058217 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:20.058182    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ncmmp" podStartSLOduration=3.555409537 podStartE2EDuration="23.058169897s" totalImagesPullingTime="19.50276036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:20.057978137 +0000 UTC m=+23.834713525" watchObservedRunningTime="2026-07-08 22:30:20.058169897 +0000 UTC m=+23.834905286"
Jul 08 22:30:20.072623 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:20.072531    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bkxht" podStartSLOduration=3.574495581 podStartE2EDuration="23.072518708s" totalImagesPullingTime="19.498023127s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:20.072064353 +0000 UTC m=+23.848799741" watchObservedRunningTime="2026-07-08 22:30:20.072518708 +0000 UTC m=+23.849254095"
Jul 08 22:30:20.766914 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:20.766891    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:20.767040 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:20.767018    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnccf" podUID="5ec93cb5-8277-4f5c-a711-1fca9b9cc78a"
Jul 08 22:30:20.884054 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:20.884012    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 22:30:21.014234 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:21.014144    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2484w" event={"ID":"69e328b9-bad4-4f6e-8a09-1822adbf2806","Type":"ContainerStarted","Data":"5999cc211424a749d7129ec94cbab51343df66620fb6ab6286289cb1b17a3375"}
Jul 08 22:30:21.014396 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:21.014254    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2484w" event={"ID":"69e328b9-bad4-4f6e-8a09-1822adbf2806","Type":"ContainerStarted","Data":"c35b25471c58690869b16011b5d9623e60f33acf252e5561c83071f8f9d9d260"}
Jul 08 22:30:21.015659 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:21.015634    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2whz6" event={"ID":"2e724aeb-b00e-499f-adda-36a36e5c11cd","Type":"ContainerStarted","Data":"b5ef45c843dc47bb707e10bba56e038f199212154ca44f532f13bd29dd72978f"}
Jul 08 22:30:21.017669 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:21.017646    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk" event={"ID":"bceb966d-d92e-4e29-a088-a8d5e526c017","Type":"ContainerStarted","Data":"1000e30ce777847a0a56f68d219c1012ee6c41c90c429862e719e8688386a2d1"}
Jul 08 22:30:21.031713 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:21.031667    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2whz6" podStartSLOduration=4.53150516 podStartE2EDuration="24.031649059s" totalImagesPullingTime="19.500143899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:21.031286064 +0000 UTC m=+24.808021453" watchObservedRunningTime="2026-07-08 22:30:21.031649059 +0000 UTC m=+24.808384446"
Jul 08 22:30:21.693454 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:21.693337    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T22:30:20.88403738Z","UUID":"ade1e805-a5e4-445e-b549-f108fe372ce8","Handler":null,"Name":"","Endpoint":""}
Jul 08 22:30:21.694866 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:21.694841    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 22:30:21.694998 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:21.694898    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 22:30:21.768296 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:21.767691    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:30:21.768296 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:21.767843    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjmn" podUID="b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e"
Jul 08 22:30:21.768296 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:21.768185    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:30:21.768296 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:21.768261    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztbq2" podUID="8e133bfb-27da-4990-aac3-8ea961563fd8"
Jul 08 22:30:22.767545 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:22.767236    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:22.767951 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:22.767714    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnccf" podUID="5ec93cb5-8277-4f5c-a711-1fca9b9cc78a"
Jul 08 22:30:23.024725 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:23.024652    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2484w" event={"ID":"69e328b9-bad4-4f6e-8a09-1822adbf2806","Type":"ContainerStarted","Data":"303f38aafe73f05ac080359fad57a898bd5b023bbdae95322a280ba35fe03f2a"}
Jul 08 22:30:23.026769 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:23.026743    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk" event={"ID":"bceb966d-d92e-4e29-a088-a8d5e526c017","Type":"ContainerStarted","Data":"e5831ea1480acceb3fc4ae8ce1297478a3b7b6c1bd6bb4abbe45444e79e33082"}
Jul 08 22:30:23.043513 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:23.043474    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hkgxk" podStartSLOduration=4.311993556 podStartE2EDuration="26.043461327s" totalImagesPullingTime="21.731467771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:29:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:23.042898278 +0000 UTC m=+26.819633659" watchObservedRunningTime="2026-07-08 22:30:23.043461327 +0000 UTC m=+26.820196719"
Jul 08 22:30:23.767370 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:23.767337    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:30:23.767565 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:23.767346    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:30:23.767565 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:23.767464    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjmn" podUID="b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e"
Jul 08 22:30:23.768071 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:23.767558    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztbq2" podUID="8e133bfb-27da-4990-aac3-8ea961563fd8"
Jul 08 22:30:24.767513 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:24.767437    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:24.767673 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:24.767576    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnccf" podUID="5ec93cb5-8277-4f5c-a711-1fca9b9cc78a"
Jul 08 22:30:24.819199 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:24.819161    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rx5xn"
Jul 08 22:30:24.819950 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:24.819930    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rx5xn"
Jul 08 22:30:25.032364 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:25.032294    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rx5xn"
Jul 08 22:30:25.032785 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:25.032767    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rx5xn"
Jul 08 22:30:25.766660 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:25.766636    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:30:25.766781 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:25.766665    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:30:25.766781 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:25.766727    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjmn" podUID="b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e"
Jul 08 22:30:25.766916 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:25.766877    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztbq2" podUID="8e133bfb-27da-4990-aac3-8ea961563fd8"
Jul 08 22:30:26.041303 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:26.040619    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2484w" event={"ID":"69e328b9-bad4-4f6e-8a09-1822adbf2806","Type":"ContainerStarted","Data":"9aa512817f89f785cedb93b879d3f9208f4dd24f4c89a5d72b6cc79476e42c1b"}
Jul 08 22:30:26.041303 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:26.041012    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:30:26.041303 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:26.041085    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:30:26.041303 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:26.041202    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:30:26.060602 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:26.060579    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:30:26.064249 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:26.064230    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:30:26.078616 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:26.078572    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2484w" podStartSLOduration=9.496847142 podStartE2EDuration="29.078552915s" totalImagesPullingTime="19.581705773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:26.077107751 +0000 UTC m=+29.853843140" watchObservedRunningTime="2026-07-08 22:30:26.078552915 +0000 UTC m=+29.855288304"
Jul 08 22:30:26.767847 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:26.767820    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:26.768082 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:26.767905    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnccf" podUID="5ec93cb5-8277-4f5c-a711-1fca9b9cc78a"
Jul 08 22:30:27.043623 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:27.043541    2558 generic.go:356] "Generic (PLEG): container finished" podID="8b2130bb-674a-4490-9da0-9576901ea3b5" containerID="8ffc8725d2fa3725172f806ad14628c54374210f36673e7b78894037f8405ba2" exitCode=0
Jul 08 22:30:27.043623 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:27.043579    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ctjg" event={"ID":"8b2130bb-674a-4490-9da0-9576901ea3b5","Type":"ContainerDied","Data":"8ffc8725d2fa3725172f806ad14628c54374210f36673e7b78894037f8405ba2"}
Jul 08 22:30:27.740996 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:27.740783    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tfjmn"]
Jul 08 22:30:27.741153 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:27.741109    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:30:27.741243 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:27.741219    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjmn" podUID="b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e"
Jul 08 22:30:27.754713 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:27.754681    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ztbq2"]
Jul 08 22:30:27.754863 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:27.754793    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:30:27.754925 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:27.754900    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztbq2" podUID="8e133bfb-27da-4990-aac3-8ea961563fd8"
Jul 08 22:30:27.765639 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:27.765612    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dnccf"]
Jul 08 22:30:27.765821 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:27.765719    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:27.765892 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:27.765840    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnccf" podUID="5ec93cb5-8277-4f5c-a711-1fca9b9cc78a"
Jul 08 22:30:29.049902 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:29.049850    2558 generic.go:356] "Generic (PLEG): container finished" podID="8b2130bb-674a-4490-9da0-9576901ea3b5" containerID="52b8096f3551d3c4948d6164dcc7966f595093eb3e4e702dbb4dac139d410540" exitCode=0
Jul 08 22:30:29.050484 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:29.049937    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ctjg" event={"ID":"8b2130bb-674a-4490-9da0-9576901ea3b5","Type":"ContainerDied","Data":"52b8096f3551d3c4948d6164dcc7966f595093eb3e4e702dbb4dac139d410540"}
Jul 08 22:30:29.766750 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:29.766682    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:30:29.766844 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:29.766773    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:29.766844 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:29.766778    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztbq2" podUID="8e133bfb-27da-4990-aac3-8ea961563fd8"
Jul 08 22:30:29.766844 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:29.766813    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:30:29.766999 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:29.766896    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnccf" podUID="5ec93cb5-8277-4f5c-a711-1fca9b9cc78a"
Jul 08 22:30:29.766999 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:29.766956    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjmn" podUID="b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e"
Jul 08 22:30:30.054593 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:30.054560    2558 generic.go:356] "Generic (PLEG): container finished" podID="8b2130bb-674a-4490-9da0-9576901ea3b5" containerID="a6f24cd50d53ba67e6c9a66050ac08f06cf1d5346667335aaa5917fb12d59392" exitCode=0
Jul 08 22:30:30.055133 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:30.054623    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ctjg" event={"ID":"8b2130bb-674a-4490-9da0-9576901ea3b5","Type":"ContainerDied","Data":"a6f24cd50d53ba67e6c9a66050ac08f06cf1d5346667335aaa5917fb12d59392"}
Jul 08 22:30:30.392582 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:30.392483    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs\") pod \"network-metrics-daemon-dnccf\" (UID: \"5ec93cb5-8277-4f5c-a711-1fca9b9cc78a\") " pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:30.392582 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:30.392551    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret\") pod \"global-pull-secret-syncer-ztbq2\" (UID: \"8e133bfb-27da-4990-aac3-8ea961563fd8\") " pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:30:30.392820 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:30.392641    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:30:30.392820 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:30.392661    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 22:30:30.392820 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:30.392710    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs podName:5ec93cb5-8277-4f5c-a711-1fca9b9cc78a nodeName:}" failed. No retries permitted until 2026-07-08 22:31:02.392694657 +0000 UTC m=+66.169430027 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs") pod "network-metrics-daemon-dnccf" (UID: "5ec93cb5-8277-4f5c-a711-1fca9b9cc78a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:30:30.392820 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:30.392725    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret podName:8e133bfb-27da-4990-aac3-8ea961563fd8 nodeName:}" failed. No retries permitted until 2026-07-08 22:31:02.392719002 +0000 UTC m=+66.169454368 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret") pod "global-pull-secret-syncer-ztbq2" (UID: "8e133bfb-27da-4990-aac3-8ea961563fd8") : object "kube-system"/"original-pull-secret" not registered
Jul 08 22:30:30.493724 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:30.493692    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95jk7\" (UniqueName: \"kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7\") pod \"network-check-target-tfjmn\" (UID: \"b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e\") " pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:30:30.493908 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:30.493829    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 22:30:30.493908 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:30.493846    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 22:30:30.493908 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:30.493855    2558 projected.go:196] Error preparing data for projected volume kube-api-access-95jk7 for pod openshift-network-diagnostics/network-check-target-tfjmn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:30:30.493908 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:30.493907    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7 podName:b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e nodeName:}" failed. No retries permitted until 2026-07-08 22:31:02.493891377 +0000 UTC m=+66.270626760 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-95jk7" (UniqueName: "kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7") pod "network-check-target-tfjmn" (UID: "b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:30:31.767329 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:31.766841    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:31.767329 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:31.766850    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:30:31.767329 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:31.766985    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnccf" podUID="5ec93cb5-8277-4f5c-a711-1fca9b9cc78a"
Jul 08 22:30:31.767329 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:31.766850    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:30:31.767329 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:31.767060    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ztbq2" podUID="8e133bfb-27da-4990-aac3-8ea961563fd8"
Jul 08 22:30:31.767329 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:31.767102    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tfjmn" podUID="b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e"
Jul 08 22:30:33.051907 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.051882    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-6.ec2.internal" event="NodeReady"
Jul 08 22:30:33.052425 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.052031    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 22:30:33.097047 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.097013    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jgstm"]
Jul 08 22:30:33.098926 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.098906    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jgstm"
Jul 08 22:30:33.100480 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.100455    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pj4jv"]
Jul 08 22:30:33.101853 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.101833    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 22:30:33.102114 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.102093    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 22:30:33.102207 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.102148    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v84dk\""
Jul 08 22:30:33.102264 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.102148    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 22:30:33.102467 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.102447    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:30:33.104663 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.104639    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 22:30:33.104755 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.104666    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 22:30:33.104755 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.104731    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5pzmj\""
Jul 08 22:30:33.110097 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.109386    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jgstm"]
Jul 08 22:30:33.114570 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.114505    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pj4jv"]
Jul 08 22:30:33.214026 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.213997    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95cba72c-b37c-4ead-bf9d-c66d377b90f7-cert\") pod \"ingress-canary-jgstm\" (UID: \"95cba72c-b37c-4ead-bf9d-c66d377b90f7\") " pod="openshift-ingress-canary/ingress-canary-jgstm"
Jul 08 22:30:33.214026 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.214039    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpggk\" (UniqueName: \"kubernetes.io/projected/01a27f4f-0263-4eca-b756-54b31715f955-kube-api-access-qpggk\") pod \"dns-default-pj4jv\" (UID: \"01a27f4f-0263-4eca-b756-54b31715f955\") " pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:30:33.214291 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.214141    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls\") pod \"dns-default-pj4jv\" (UID: \"01a27f4f-0263-4eca-b756-54b31715f955\") " pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:30:33.214291 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.214164    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01a27f4f-0263-4eca-b756-54b31715f955-tmp-dir\") pod \"dns-default-pj4jv\" (UID: \"01a27f4f-0263-4eca-b756-54b31715f955\") " pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:30:33.214291 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.214200    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n92lj\" (UniqueName: \"kubernetes.io/projected/95cba72c-b37c-4ead-bf9d-c66d377b90f7-kube-api-access-n92lj\") pod \"ingress-canary-jgstm\" (UID: \"95cba72c-b37c-4ead-bf9d-c66d377b90f7\") " pod="openshift-ingress-canary/ingress-canary-jgstm"
Jul 08 22:30:33.214291 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.214265    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/01a27f4f-0263-4eca-b756-54b31715f955-config-volume\") pod \"dns-default-pj4jv\" (UID: \"01a27f4f-0263-4eca-b756-54b31715f955\") " pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:30:33.315342 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.315308    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95cba72c-b37c-4ead-bf9d-c66d377b90f7-cert\") pod \"ingress-canary-jgstm\" (UID: \"95cba72c-b37c-4ead-bf9d-c66d377b90f7\") " pod="openshift-ingress-canary/ingress-canary-jgstm"
Jul 08 22:30:33.315342 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.315346    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpggk\" (UniqueName: \"kubernetes.io/projected/01a27f4f-0263-4eca-b756-54b31715f955-kube-api-access-qpggk\") pod \"dns-default-pj4jv\" (UID: \"01a27f4f-0263-4eca-b756-54b31715f955\") " pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:30:33.315592 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.315420    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls\") pod \"dns-default-pj4jv\" (UID: \"01a27f4f-0263-4eca-b756-54b31715f955\") " pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:30:33.315592 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.315442    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01a27f4f-0263-4eca-b756-54b31715f955-tmp-dir\") pod \"dns-default-pj4jv\" (UID: \"01a27f4f-0263-4eca-b756-54b31715f955\") " pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:30:33.315592 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.315511    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n92lj\" (UniqueName: \"kubernetes.io/projected/95cba72c-b37c-4ead-bf9d-c66d377b90f7-kube-api-access-n92lj\") pod \"ingress-canary-jgstm\" (UID: \"95cba72c-b37c-4ead-bf9d-c66d377b90f7\") " pod="openshift-ingress-canary/ingress-canary-jgstm"
Jul 08 22:30:33.315592 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:33.315549    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:30:33.315592 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.315559    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/01a27f4f-0263-4eca-b756-54b31715f955-config-volume\") pod \"dns-default-pj4jv\" (UID: \"01a27f4f-0263-4eca-b756-54b31715f955\") " pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:30:33.315843 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:33.315619    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls podName:01a27f4f-0263-4eca-b756-54b31715f955 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:33.815598995 +0000 UTC m=+37.592334360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls") pod "dns-default-pj4jv" (UID: "01a27f4f-0263-4eca-b756-54b31715f955") : secret "dns-default-metrics-tls" not found
Jul 08 22:30:33.315843 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.315745    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01a27f4f-0263-4eca-b756-54b31715f955-tmp-dir\") pod \"dns-default-pj4jv\" (UID: \"01a27f4f-0263-4eca-b756-54b31715f955\") " pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:30:33.316137 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.316116    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/01a27f4f-0263-4eca-b756-54b31715f955-config-volume\") pod \"dns-default-pj4jv\" (UID: \"01a27f4f-0263-4eca-b756-54b31715f955\") " pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:30:33.320137 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.320115    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/95cba72c-b37c-4ead-bf9d-c66d377b90f7-cert\") pod \"ingress-canary-jgstm\" (UID: \"95cba72c-b37c-4ead-bf9d-c66d377b90f7\") " pod="openshift-ingress-canary/ingress-canary-jgstm"
Jul 08 22:30:33.324786 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.324762    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n92lj\" (UniqueName: \"kubernetes.io/projected/95cba72c-b37c-4ead-bf9d-c66d377b90f7-kube-api-access-n92lj\") pod \"ingress-canary-jgstm\" (UID: \"95cba72c-b37c-4ead-bf9d-c66d377b90f7\") " pod="openshift-ingress-canary/ingress-canary-jgstm"
Jul 08 22:30:33.324902 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.324781    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpggk\" (UniqueName: \"kubernetes.io/projected/01a27f4f-0263-4eca-b756-54b31715f955-kube-api-access-qpggk\") pod \"dns-default-pj4jv\" (UID: \"01a27f4f-0263-4eca-b756-54b31715f955\") " pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:30:33.412705 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.412623    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jgstm"
Jul 08 22:30:33.767508 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.767430    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:30:33.767653 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.767426    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:30:33.767653 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.767448    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:30:33.770436 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.770417    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 22:30:33.771716 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.771439    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 22:30:33.771716 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.771433    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 22:30:33.771716 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.771442    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 22:30:33.771716 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.771443    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lrv86\""
Jul 08 22:30:33.772127 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.772112    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tm4h7\""
Jul 08 22:30:33.819079 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:33.819052    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls\") pod \"dns-default-pj4jv\" (UID: \"01a27f4f-0263-4eca-b756-54b31715f955\") " pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:30:33.819238 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:33.819189    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:30:33.819298 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:33.819264    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls podName:01a27f4f-0263-4eca-b756-54b31715f955 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:34.819249758 +0000 UTC m=+38.595985124 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls") pod "dns-default-pj4jv" (UID: "01a27f4f-0263-4eca-b756-54b31715f955") : secret "dns-default-metrics-tls" not found
Jul 08 22:30:34.827071 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:34.827040    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls\") pod \"dns-default-pj4jv\" (UID: \"01a27f4f-0263-4eca-b756-54b31715f955\") " pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:30:34.827493 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:34.827189    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:30:34.827493 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:34.827257    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls podName:01a27f4f-0263-4eca-b756-54b31715f955 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:36.827242035 +0000 UTC m=+40.603977405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls") pod "dns-default-pj4jv" (UID: "01a27f4f-0263-4eca-b756-54b31715f955") : secret "dns-default-metrics-tls" not found
Jul 08 22:30:35.011053 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:35.010852    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jgstm"]
Jul 08 22:30:35.015809 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:30:35.015768    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95cba72c_b37c_4ead_bf9d_c66d377b90f7.slice/crio-f3ef73ecb47581518b54ac3ff231e89c3550bd71b7eb1eba2693e0d6cdece87e WatchSource:0}: Error finding container f3ef73ecb47581518b54ac3ff231e89c3550bd71b7eb1eba2693e0d6cdece87e: Status 404 returned error can't find the container with id f3ef73ecb47581518b54ac3ff231e89c3550bd71b7eb1eba2693e0d6cdece87e
Jul 08 22:30:35.069194 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:35.069162    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jgstm" event={"ID":"95cba72c-b37c-4ead-bf9d-c66d377b90f7","Type":"ContainerStarted","Data":"f3ef73ecb47581518b54ac3ff231e89c3550bd71b7eb1eba2693e0d6cdece87e"}
Jul 08 22:30:36.074660 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:36.074617    2558 generic.go:356] "Generic (PLEG): container finished" podID="8b2130bb-674a-4490-9da0-9576901ea3b5" containerID="3abdf76c63eead3e4ae0bf8ab58b5aceca36e8a19db56e4d22166da6edd3a0dc" exitCode=0
Jul 08 22:30:36.075107 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:36.074667    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ctjg" event={"ID":"8b2130bb-674a-4490-9da0-9576901ea3b5","Type":"ContainerDied","Data":"3abdf76c63eead3e4ae0bf8ab58b5aceca36e8a19db56e4d22166da6edd3a0dc"}
Jul 08 22:30:36.842568 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:36.842390    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls\") pod \"dns-default-pj4jv\" (UID: \"01a27f4f-0263-4eca-b756-54b31715f955\") " pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:30:36.842753 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:36.842539    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:30:36.842753 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:36.842683    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls podName:01a27f4f-0263-4eca-b756-54b31715f955 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:40.842663613 +0000 UTC m=+44.619398993 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls") pod "dns-default-pj4jv" (UID: "01a27f4f-0263-4eca-b756-54b31715f955") : secret "dns-default-metrics-tls" not found
Jul 08 22:30:37.080937 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:37.080902    2558 generic.go:356] "Generic (PLEG): container finished" podID="8b2130bb-674a-4490-9da0-9576901ea3b5" containerID="a5f4305e4ab2491a0f9cd68883ae6629358d78438708510cf0bdcfa0c2c4bf5d" exitCode=0
Jul 08 22:30:37.081333 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:37.080965    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ctjg" event={"ID":"8b2130bb-674a-4490-9da0-9576901ea3b5","Type":"ContainerDied","Data":"a5f4305e4ab2491a0f9cd68883ae6629358d78438708510cf0bdcfa0c2c4bf5d"}
Jul 08 22:30:38.085407 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:38.085329    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jgstm" event={"ID":"95cba72c-b37c-4ead-bf9d-c66d377b90f7","Type":"ContainerStarted","Data":"e1950f257a58d48a59525ebc2d92e3c8e76297a0e674b1fd6f73d3e7f55ef0bb"}
Jul 08 22:30:38.088832 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:38.088790    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2ctjg" event={"ID":"8b2130bb-674a-4490-9da0-9576901ea3b5","Type":"ContainerStarted","Data":"0320ee6ab7825e48dcd9e64325a080d7827ad6f7c895cd3ad8911c03ae6ec2b9"}
Jul 08 22:30:38.099845 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:38.099791    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jgstm" podStartSLOduration=2.351027252 podStartE2EDuration="5.099778527s" totalImagesPullingTime="2.748751275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:30:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:38.099762461 +0000 UTC m=+41.876497850" watchObservedRunningTime="2026-07-08 22:30:38.099778527 +0000 UTC m=+41.876513893"
Jul 08 22:30:38.122991 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:38.122948    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2ctjg" podStartSLOduration=8.81796356 podStartE2EDuration="41.122933033s" totalImagesPullingTime="32.304969473s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:29:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:38.121780225 +0000 UTC m=+41.898515639" watchObservedRunningTime="2026-07-08 22:30:38.122933033 +0000 UTC m=+41.899668420"
Jul 08 22:30:40.871192 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:40.871160    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls\") pod \"dns-default-pj4jv\" (UID: \"01a27f4f-0263-4eca-b756-54b31715f955\") " pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:30:40.871571 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:40.871274    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:30:40.871571 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:40.871324    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls podName:01a27f4f-0263-4eca-b756-54b31715f955 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:48.871310531 +0000 UTC m=+52.648045910 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls") pod "dns-default-pj4jv" (UID: "01a27f4f-0263-4eca-b756-54b31715f955") : secret "dns-default-metrics-tls" not found
Jul 08 22:30:48.925523 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:48.925488    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls\") pod \"dns-default-pj4jv\" (UID: \"01a27f4f-0263-4eca-b756-54b31715f955\") " pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:30:48.926001 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:48.925669    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:30:48.926001 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:30:48.925735    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls podName:01a27f4f-0263-4eca-b756-54b31715f955 nodeName:}" failed. No retries permitted until 2026-07-08 22:31:04.92571854 +0000 UTC m=+68.702453906 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls") pod "dns-default-pj4jv" (UID: "01a27f4f-0263-4eca-b756-54b31715f955") : secret "dns-default-metrics-tls" not found
Jul 08 22:30:58.065732 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:30:58.065697    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2484w"
Jul 08 22:31:02.419055 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:02.419022    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs\") pod \"network-metrics-daemon-dnccf\" (UID: \"5ec93cb5-8277-4f5c-a711-1fca9b9cc78a\") " pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:31:02.419501 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:02.419093    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret\") pod \"global-pull-secret-syncer-ztbq2\" (UID: \"8e133bfb-27da-4990-aac3-8ea961563fd8\") " pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:31:02.422113 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:02.422091    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 22:31:02.422239 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:02.422094    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 22:31:02.429525 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:31:02.429504    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 22:31:02.429596 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:31:02.429566    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs podName:5ec93cb5-8277-4f5c-a711-1fca9b9cc78a nodeName:}" failed. No retries permitted until 2026-07-08 22:32:06.429550204 +0000 UTC m=+130.206285585 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs") pod "network-metrics-daemon-dnccf" (UID: "5ec93cb5-8277-4f5c-a711-1fca9b9cc78a") : secret "metrics-daemon-secret" not found
Jul 08 22:31:02.433336 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:02.433315    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e133bfb-27da-4990-aac3-8ea961563fd8-original-pull-secret\") pod \"global-pull-secret-syncer-ztbq2\" (UID: \"8e133bfb-27da-4990-aac3-8ea961563fd8\") " pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:31:02.519648 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:02.519604    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95jk7\" (UniqueName: \"kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7\") pod \"network-check-target-tfjmn\" (UID: \"b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e\") " pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:31:02.522296 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:02.522280    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 22:31:02.532583 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:02.532564    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 22:31:02.543080 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:02.543061    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95jk7\" (UniqueName: \"kubernetes.io/projected/b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e-kube-api-access-95jk7\") pod \"network-check-target-tfjmn\" (UID: \"b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e\") " pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:31:02.579957 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:02.579927    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ztbq2"
Jul 08 22:31:02.593838 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:02.593795    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lrv86\""
Jul 08 22:31:02.601600 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:02.601578    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:31:02.708370 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:02.708344    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ztbq2"]
Jul 08 22:31:02.711616 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:31:02.711575    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e133bfb_27da_4990_aac3_8ea961563fd8.slice/crio-d9a276aac91751ce6b93772e260bee8b8764f551b9b5f0c345fe4eb8211e60e5 WatchSource:0}: Error finding container d9a276aac91751ce6b93772e260bee8b8764f551b9b5f0c345fe4eb8211e60e5: Status 404 returned error can't find the container with id d9a276aac91751ce6b93772e260bee8b8764f551b9b5f0c345fe4eb8211e60e5
Jul 08 22:31:02.728336 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:02.728312    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tfjmn"]
Jul 08 22:31:02.730636 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:31:02.730615    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2140c16_b1f7_4b44_b8c5_8dad94d1ea3e.slice/crio-e7898d19dad180d69e47ab3d6c6ec14fd40dd0e27bd9267a707ae0d8c892be45 WatchSource:0}: Error finding container e7898d19dad180d69e47ab3d6c6ec14fd40dd0e27bd9267a707ae0d8c892be45: Status 404 returned error can't find the container with id e7898d19dad180d69e47ab3d6c6ec14fd40dd0e27bd9267a707ae0d8c892be45
Jul 08 22:31:03.151228 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:03.151190    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tfjmn" event={"ID":"b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e","Type":"ContainerStarted","Data":"e7898d19dad180d69e47ab3d6c6ec14fd40dd0e27bd9267a707ae0d8c892be45"}
Jul 08 22:31:03.152215 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:03.152193    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ztbq2" event={"ID":"8e133bfb-27da-4990-aac3-8ea961563fd8","Type":"ContainerStarted","Data":"d9a276aac91751ce6b93772e260bee8b8764f551b9b5f0c345fe4eb8211e60e5"}
Jul 08 22:31:04.938227 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:04.938196    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls\") pod \"dns-default-pj4jv\" (UID: \"01a27f4f-0263-4eca-b756-54b31715f955\") " pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:31:04.938998 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:31:04.938314    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:31:04.938998 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:31:04.938408    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls podName:01a27f4f-0263-4eca-b756-54b31715f955 nodeName:}" failed. No retries permitted until 2026-07-08 22:31:36.938390375 +0000 UTC m=+100.715125741 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls") pod "dns-default-pj4jv" (UID: "01a27f4f-0263-4eca-b756-54b31715f955") : secret "dns-default-metrics-tls" not found
Jul 08 22:31:08.165956 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:08.165917    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tfjmn" event={"ID":"b2140c16-b1f7-4b44-b8c5-8dad94d1ea3e","Type":"ContainerStarted","Data":"ca23912a95efd25542ef2d5a85c02a38d8b574e77d1abb7369b988aaf6146630"}
Jul 08 22:31:08.166448 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:08.166039    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:31:08.167350 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:08.167328    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ztbq2" event={"ID":"8e133bfb-27da-4990-aac3-8ea961563fd8","Type":"ContainerStarted","Data":"bb885915a53fae0b29b524abca8013763203d4609610b3563c010326d1dfb67a"}
Jul 08 22:31:08.181620 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:08.181582    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tfjmn" podStartSLOduration=66.206987994 podStartE2EDuration="1m11.181571171s" totalImagesPullingTime="4.974583177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:31:08.180337561 +0000 UTC m=+71.957072940" watchObservedRunningTime="2026-07-08 22:31:08.181571171 +0000 UTC m=+71.958306563"
Jul 08 22:31:08.193686 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:08.193647    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ztbq2" podStartSLOduration=66.196609305 podStartE2EDuration="1m11.193634016s" totalImagesPullingTime="4.997024711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:31:08.193275166 +0000 UTC m=+71.970010554" watchObservedRunningTime="2026-07-08 22:31:08.193634016 +0000 UTC m=+71.970369400"
Jul 08 22:31:14.623265 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.623234    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z"]
Jul 08 22:31:14.625445 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.625428    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z"
Jul 08 22:31:14.628101 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.628078    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 08 22:31:14.629132 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.629112    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 08 22:31:14.629227 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.629141    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 08 22:31:14.629227 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.629143    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 08 22:31:14.637983 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.637963    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z"]
Jul 08 22:31:14.656258 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.656238    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"]
Jul 08 22:31:14.657909 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.657895    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"
Jul 08 22:31:14.660222 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.660201    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 08 22:31:14.660345 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.660237    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 08 22:31:14.660411 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.660402    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 08 22:31:14.660466 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.660430    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 08 22:31:14.667611 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.667591    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"]
Jul 08 22:31:14.702008 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.701985    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/acd46816-30e7-49c4-85f0-3850a0ea3dcd-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c8cdfc779-z427z\" (UID: \"acd46816-30e7-49c4-85f0-3850a0ea3dcd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z"
Jul 08 22:31:14.702122 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.702021    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9xbf\" (UniqueName: \"kubernetes.io/projected/e64da6d6-b525-4dac-9aee-8428f11a8cee-kube-api-access-v9xbf\") pod \"cluster-proxy-proxy-agent-79b76544b7-fcjpg\" (UID: \"e64da6d6-b525-4dac-9aee-8428f11a8cee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"
Jul 08 22:31:14.702122 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.702046    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acd46816-30e7-49c4-85f0-3850a0ea3dcd-tmp\") pod \"klusterlet-addon-workmgr-7c8cdfc779-z427z\" (UID: \"acd46816-30e7-49c4-85f0-3850a0ea3dcd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z"
Jul 08 22:31:14.702122 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.702081    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e64da6d6-b525-4dac-9aee-8428f11a8cee-additional-service-ca\") pod \"cluster-proxy-proxy-agent-79b76544b7-fcjpg\" (UID: \"e64da6d6-b525-4dac-9aee-8428f11a8cee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"
Jul 08 22:31:14.702122 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.702114    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e64da6d6-b525-4dac-9aee-8428f11a8cee-ca\") pod \"cluster-proxy-proxy-agent-79b76544b7-fcjpg\" (UID: \"e64da6d6-b525-4dac-9aee-8428f11a8cee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"
Jul 08 22:31:14.702273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.702129    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5grnf\" (UniqueName: \"kubernetes.io/projected/acd46816-30e7-49c4-85f0-3850a0ea3dcd-kube-api-access-5grnf\") pod \"klusterlet-addon-workmgr-7c8cdfc779-z427z\" (UID: \"acd46816-30e7-49c4-85f0-3850a0ea3dcd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z"
Jul 08 22:31:14.702273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.702169    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e64da6d6-b525-4dac-9aee-8428f11a8cee-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-79b76544b7-fcjpg\" (UID: \"e64da6d6-b525-4dac-9aee-8428f11a8cee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"
Jul 08 22:31:14.702273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.702211    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e64da6d6-b525-4dac-9aee-8428f11a8cee-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-79b76544b7-fcjpg\" (UID: \"e64da6d6-b525-4dac-9aee-8428f11a8cee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"
Jul 08 22:31:14.702273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.702242    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e64da6d6-b525-4dac-9aee-8428f11a8cee-hub\") pod \"cluster-proxy-proxy-agent-79b76544b7-fcjpg\" (UID: \"e64da6d6-b525-4dac-9aee-8428f11a8cee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"
Jul 08 22:31:14.803166 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.803134    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e64da6d6-b525-4dac-9aee-8428f11a8cee-ca\") pod \"cluster-proxy-proxy-agent-79b76544b7-fcjpg\" (UID: \"e64da6d6-b525-4dac-9aee-8428f11a8cee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"
Jul 08 22:31:14.803321 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.803172    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5grnf\" (UniqueName: \"kubernetes.io/projected/acd46816-30e7-49c4-85f0-3850a0ea3dcd-kube-api-access-5grnf\") pod \"klusterlet-addon-workmgr-7c8cdfc779-z427z\" (UID: \"acd46816-30e7-49c4-85f0-3850a0ea3dcd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z"
Jul 08 22:31:14.803321 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.803197    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e64da6d6-b525-4dac-9aee-8428f11a8cee-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-79b76544b7-fcjpg\" (UID: \"e64da6d6-b525-4dac-9aee-8428f11a8cee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"
Jul 08 22:31:14.803321 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.803232    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e64da6d6-b525-4dac-9aee-8428f11a8cee-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-79b76544b7-fcjpg\" (UID: \"e64da6d6-b525-4dac-9aee-8428f11a8cee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"
Jul 08 22:31:14.803321 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.803269    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e64da6d6-b525-4dac-9aee-8428f11a8cee-hub\") pod \"cluster-proxy-proxy-agent-79b76544b7-fcjpg\" (UID: \"e64da6d6-b525-4dac-9aee-8428f11a8cee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"
Jul 08 22:31:14.803321 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.803295    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/acd46816-30e7-49c4-85f0-3850a0ea3dcd-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c8cdfc779-z427z\" (UID: \"acd46816-30e7-49c4-85f0-3850a0ea3dcd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z"
Jul 08 22:31:14.803580 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.803332    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9xbf\" (UniqueName: \"kubernetes.io/projected/e64da6d6-b525-4dac-9aee-8428f11a8cee-kube-api-access-v9xbf\") pod \"cluster-proxy-proxy-agent-79b76544b7-fcjpg\" (UID: \"e64da6d6-b525-4dac-9aee-8428f11a8cee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"
Jul 08 22:31:14.803580 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.803356    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acd46816-30e7-49c4-85f0-3850a0ea3dcd-tmp\") pod \"klusterlet-addon-workmgr-7c8cdfc779-z427z\" (UID: \"acd46816-30e7-49c4-85f0-3850a0ea3dcd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z"
Jul 08 22:31:14.803580 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.803390    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e64da6d6-b525-4dac-9aee-8428f11a8cee-additional-service-ca\") pod \"cluster-proxy-proxy-agent-79b76544b7-fcjpg\" (UID: \"e64da6d6-b525-4dac-9aee-8428f11a8cee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"
Jul 08 22:31:14.804083 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.804061    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e64da6d6-b525-4dac-9aee-8428f11a8cee-additional-service-ca\") pod \"cluster-proxy-proxy-agent-79b76544b7-fcjpg\" (UID: \"e64da6d6-b525-4dac-9aee-8428f11a8cee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"
Jul 08 22:31:14.804232 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.804212    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acd46816-30e7-49c4-85f0-3850a0ea3dcd-tmp\") pod \"klusterlet-addon-workmgr-7c8cdfc779-z427z\" (UID: \"acd46816-30e7-49c4-85f0-3850a0ea3dcd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z"
Jul 08 22:31:14.805925 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.805901    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e64da6d6-b525-4dac-9aee-8428f11a8cee-hub\") pod \"cluster-proxy-proxy-agent-79b76544b7-fcjpg\" (UID: \"e64da6d6-b525-4dac-9aee-8428f11a8cee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"
Jul 08 22:31:14.806210 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.806194    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e64da6d6-b525-4dac-9aee-8428f11a8cee-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-79b76544b7-fcjpg\" (UID: \"e64da6d6-b525-4dac-9aee-8428f11a8cee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"
Jul 08 22:31:14.806286 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.806263    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e64da6d6-b525-4dac-9aee-8428f11a8cee-ca\") pod \"cluster-proxy-proxy-agent-79b76544b7-fcjpg\" (UID: \"e64da6d6-b525-4dac-9aee-8428f11a8cee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"
Jul 08 22:31:14.806423 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.806409    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/acd46816-30e7-49c4-85f0-3850a0ea3dcd-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c8cdfc779-z427z\" (UID: \"acd46816-30e7-49c4-85f0-3850a0ea3dcd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z"
Jul 08 22:31:14.806565 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.806548    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e64da6d6-b525-4dac-9aee-8428f11a8cee-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-79b76544b7-fcjpg\" (UID: \"e64da6d6-b525-4dac-9aee-8428f11a8cee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"
Jul 08 22:31:14.811501 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.811481    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5grnf\" (UniqueName: \"kubernetes.io/projected/acd46816-30e7-49c4-85f0-3850a0ea3dcd-kube-api-access-5grnf\") pod \"klusterlet-addon-workmgr-7c8cdfc779-z427z\" (UID: \"acd46816-30e7-49c4-85f0-3850a0ea3dcd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z"
Jul 08 22:31:14.811567 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.811546    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9xbf\" (UniqueName: \"kubernetes.io/projected/e64da6d6-b525-4dac-9aee-8428f11a8cee-kube-api-access-v9xbf\") pod \"cluster-proxy-proxy-agent-79b76544b7-fcjpg\" (UID: \"e64da6d6-b525-4dac-9aee-8428f11a8cee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"
Jul 08 22:31:14.934476 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.934379    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z"
Jul 08 22:31:14.976051 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:14.976014    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"
Jul 08 22:31:15.061167 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:15.060943    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z"]
Jul 08 22:31:15.063578 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:31:15.063538    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd46816_30e7_49c4_85f0_3850a0ea3dcd.slice/crio-1c708bad477e9277338dd9643ab49a9e35fc1c648424cf180b2cde5d4cfd0a0f WatchSource:0}: Error finding container 1c708bad477e9277338dd9643ab49a9e35fc1c648424cf180b2cde5d4cfd0a0f: Status 404 returned error can't find the container with id 1c708bad477e9277338dd9643ab49a9e35fc1c648424cf180b2cde5d4cfd0a0f
Jul 08 22:31:15.104625 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:15.104598    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"]
Jul 08 22:31:15.107091 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:31:15.107069    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode64da6d6_b525_4dac_9aee_8428f11a8cee.slice/crio-738eacdbc5e1407c1d046d97d626f529e9c71a63110ac9d7faf581ea96349deb WatchSource:0}: Error finding container 738eacdbc5e1407c1d046d97d626f529e9c71a63110ac9d7faf581ea96349deb: Status 404 returned error can't find the container with id 738eacdbc5e1407c1d046d97d626f529e9c71a63110ac9d7faf581ea96349deb
Jul 08 22:31:15.189093 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:15.186291    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z" event={"ID":"acd46816-30e7-49c4-85f0-3850a0ea3dcd","Type":"ContainerStarted","Data":"1c708bad477e9277338dd9643ab49a9e35fc1c648424cf180b2cde5d4cfd0a0f"}
Jul 08 22:31:15.190297 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:15.190268    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg" event={"ID":"e64da6d6-b525-4dac-9aee-8428f11a8cee","Type":"ContainerStarted","Data":"738eacdbc5e1407c1d046d97d626f529e9c71a63110ac9d7faf581ea96349deb"}
Jul 08 22:31:21.212838 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:21.212736    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg" event={"ID":"e64da6d6-b525-4dac-9aee-8428f11a8cee","Type":"ContainerStarted","Data":"b8858902d958fb1259b5e80a7ca8302e67dff01b4e1cfedbd33a5dc3a3149f79"}
Jul 08 22:31:21.212838 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:21.212786    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg" event={"ID":"e64da6d6-b525-4dac-9aee-8428f11a8cee","Type":"ContainerStarted","Data":"c73da71c9cdc075298e4f3eed05060be5dc725a352d1eb9a7c6dced2e863589f"}
Jul 08 22:31:21.212838 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:21.212826    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg" event={"ID":"e64da6d6-b525-4dac-9aee-8428f11a8cee","Type":"ContainerStarted","Data":"9f915c4663e0c290e0fb408a764f4b075d0d62c21b63474d9ffc22efce2a3c89"}
Jul 08 22:31:21.230939 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:21.230892    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg" podStartSLOduration=1.496027792 podStartE2EDuration="7.230874351s" totalImagesPullingTime="5.734846559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:31:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:31:21.229789341 +0000 UTC m=+85.006524739" watchObservedRunningTime="2026-07-08 22:31:21.230874351 +0000 UTC m=+85.007609740"
Jul 08 22:31:23.219576 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:23.219542    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z" event={"ID":"acd46816-30e7-49c4-85f0-3850a0ea3dcd","Type":"ContainerStarted","Data":"0e0e425579de0877a15c2932cb9ccb1ea5d1f3f56d0898b847b89708c6e689c0"}
Jul 08 22:31:23.219998 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:23.219748    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z"
Jul 08 22:31:23.221389 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:23.221370    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z"
Jul 08 22:31:23.235540 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:23.235499    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z" podStartSLOduration=1.961755674 podStartE2EDuration="9.235485503s" totalImagesPullingTime="7.273729829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:31:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:31:23.234847498 +0000 UTC m=+87.011582882" watchObservedRunningTime="2026-07-08 22:31:23.235485503 +0000 UTC m=+87.012220892"
Jul 08 22:31:36.969654 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:36.969612    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls\") pod \"dns-default-pj4jv\" (UID: \"01a27f4f-0263-4eca-b756-54b31715f955\") " pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:31:36.970057 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:31:36.969731    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:31:36.970057 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:31:36.969792    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls podName:01a27f4f-0263-4eca-b756-54b31715f955 nodeName:}" failed. No retries permitted until 2026-07-08 22:32:40.969780236 +0000 UTC m=+164.746515601 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls") pod "dns-default-pj4jv" (UID: "01a27f4f-0263-4eca-b756-54b31715f955") : secret "dns-default-metrics-tls" not found
Jul 08 22:31:39.172271 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:31:39.172242    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tfjmn"
Jul 08 22:32:06.474994 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:32:06.474951    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs\") pod \"network-metrics-daemon-dnccf\" (UID: \"5ec93cb5-8277-4f5c-a711-1fca9b9cc78a\") " pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:32:06.475462 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:32:06.475076    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 22:32:06.475462 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:32:06.475137    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs podName:5ec93cb5-8277-4f5c-a711-1fca9b9cc78a nodeName:}" failed. No retries permitted until 2026-07-08 22:34:08.475120493 +0000 UTC m=+252.251855876 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs") pod "network-metrics-daemon-dnccf" (UID: "5ec93cb5-8277-4f5c-a711-1fca9b9cc78a") : secret "metrics-daemon-secret" not found
Jul 08 22:32:36.119410 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:32:36.119353    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pj4jv" podUID="01a27f4f-0263-4eca-b756-54b31715f955"
Jul 08 22:32:36.417142 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:32:36.417059    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:32:36.785855 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:32:36.785758    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dnccf" podUID="5ec93cb5-8277-4f5c-a711-1fca9b9cc78a"
Jul 08 22:32:41.020063 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:32:41.020011    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls\") pod \"dns-default-pj4jv\" (UID: \"01a27f4f-0263-4eca-b756-54b31715f955\") " pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:32:41.020518 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:32:41.020166    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:32:41.020518 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:32:41.020236    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls podName:01a27f4f-0263-4eca-b756-54b31715f955 nodeName:}" failed. No retries permitted until 2026-07-08 22:34:43.020217059 +0000 UTC m=+286.796952445 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls") pod "dns-default-pj4jv" (UID: "01a27f4f-0263-4eca-b756-54b31715f955") : secret "dns-default-metrics-tls" not found
Jul 08 22:32:49.767677 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:32:49.767393    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:33:22.541546 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:33:22.541515    2558 generic.go:356] "Generic (PLEG): container finished" podID="acd46816-30e7-49c4-85f0-3850a0ea3dcd" containerID="0e0e425579de0877a15c2932cb9ccb1ea5d1f3f56d0898b847b89708c6e689c0" exitCode=1
Jul 08 22:33:22.541929 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:33:22.541573    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z" event={"ID":"acd46816-30e7-49c4-85f0-3850a0ea3dcd","Type":"ContainerDied","Data":"0e0e425579de0877a15c2932cb9ccb1ea5d1f3f56d0898b847b89708c6e689c0"}
Jul 08 22:33:22.541929 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:33:22.541872    2558 scope.go:117] "RemoveContainer" containerID="0e0e425579de0877a15c2932cb9ccb1ea5d1f3f56d0898b847b89708c6e689c0"
Jul 08 22:33:23.220398 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:33:23.220367    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z"
Jul 08 22:33:23.545856 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:33:23.545755    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z" event={"ID":"acd46816-30e7-49c4-85f0-3850a0ea3dcd","Type":"ContainerStarted","Data":"8f8add5f7cdf5eb86bbed0cda5128e031df6a1687f0336ceffb90c00a7883087"}
Jul 08 22:33:23.546272 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:33:23.545948    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z"
Jul 08 22:33:23.546549 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:33:23.546534    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c8cdfc779-z427z"
Jul 08 22:34:08.513100 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:08.513063    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs\") pod \"network-metrics-daemon-dnccf\" (UID: \"5ec93cb5-8277-4f5c-a711-1fca9b9cc78a\") " pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:34:08.513565 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:08.513175    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 22:34:08.513565 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:08.513226    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs podName:5ec93cb5-8277-4f5c-a711-1fca9b9cc78a nodeName:}" failed. No retries permitted until 2026-07-08 22:36:10.513211912 +0000 UTC m=+374.289947278 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs") pod "network-metrics-daemon-dnccf" (UID: "5ec93cb5-8277-4f5c-a711-1fca9b9cc78a") : secret "metrics-daemon-secret" not found
Jul 08 22:34:22.205044 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.204962    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2qlw7"]
Jul 08 22:34:22.206864 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.206847    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:22.209717 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.209673    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 22:34:22.209898 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.209681    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 22:34:22.210050 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.210026    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 22:34:22.210147 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.210125    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 22:34:22.210865 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.210845    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v54n6\""
Jul 08 22:34:22.220728 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.220709    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2qlw7"]
Jul 08 22:34:22.306915 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.306878    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47824c1a-b4a0-4799-89af-6bb306075d89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:22.307105 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.306925    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47824c1a-b4a0-4799-89af-6bb306075d89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:22.307105 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.306980    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47824c1a-b4a0-4799-89af-6bb306075d89-crio-socket\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:22.307105 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.307071    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dfmz\" (UniqueName: \"kubernetes.io/projected/47824c1a-b4a0-4799-89af-6bb306075d89-kube-api-access-5dfmz\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:22.307226 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.307109    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47824c1a-b4a0-4799-89af-6bb306075d89-data-volume\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:22.407866 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.407826    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47824c1a-b4a0-4799-89af-6bb306075d89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:22.408031 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.407898    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47824c1a-b4a0-4799-89af-6bb306075d89-crio-socket\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:22.408031 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.407947    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dfmz\" (UniqueName: \"kubernetes.io/projected/47824c1a-b4a0-4799-89af-6bb306075d89-kube-api-access-5dfmz\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:22.408031 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:22.407901    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 22:34:22.408204 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:22.408067    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47824c1a-b4a0-4799-89af-6bb306075d89-kube-rbac-proxy-cm podName:47824c1a-b4a0-4799-89af-6bb306075d89 nodeName:}" failed. No retries permitted until 2026-07-08 22:34:22.908041609 +0000 UTC m=+266.684776978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47824c1a-b4a0-4799-89af-6bb306075d89-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2qlw7" (UID: "47824c1a-b4a0-4799-89af-6bb306075d89") : configmap "kube-rbac-proxy" not found
Jul 08 22:34:22.408204 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.408064    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47824c1a-b4a0-4799-89af-6bb306075d89-crio-socket\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:22.408204 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.407968    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47824c1a-b4a0-4799-89af-6bb306075d89-data-volume\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:22.408204 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.408132    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47824c1a-b4a0-4799-89af-6bb306075d89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:22.408381 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:22.408252    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 22:34:22.408381 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.408262    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47824c1a-b4a0-4799-89af-6bb306075d89-data-volume\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:22.408381 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:22.408307    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47824c1a-b4a0-4799-89af-6bb306075d89-insights-runtime-extractor-tls podName:47824c1a-b4a0-4799-89af-6bb306075d89 nodeName:}" failed. No retries permitted until 2026-07-08 22:34:22.908292485 +0000 UTC m=+266.685027854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47824c1a-b4a0-4799-89af-6bb306075d89-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2qlw7" (UID: "47824c1a-b4a0-4799-89af-6bb306075d89") : secret "insights-runtime-extractor-tls" not found
Jul 08 22:34:22.418893 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.418865    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dfmz\" (UniqueName: \"kubernetes.io/projected/47824c1a-b4a0-4799-89af-6bb306075d89-kube-api-access-5dfmz\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:22.911772 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.911719    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47824c1a-b4a0-4799-89af-6bb306075d89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:22.911772 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:22.911783    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47824c1a-b4a0-4799-89af-6bb306075d89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:22.912065 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:22.911893    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 22:34:22.912065 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:22.911901    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 22:34:22.912065 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:22.911981    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47824c1a-b4a0-4799-89af-6bb306075d89-kube-rbac-proxy-cm podName:47824c1a-b4a0-4799-89af-6bb306075d89 nodeName:}" failed. No retries permitted until 2026-07-08 22:34:23.911959204 +0000 UTC m=+267.688694570 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47824c1a-b4a0-4799-89af-6bb306075d89-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2qlw7" (UID: "47824c1a-b4a0-4799-89af-6bb306075d89") : configmap "kube-rbac-proxy" not found
Jul 08 22:34:22.912065 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:22.912002    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47824c1a-b4a0-4799-89af-6bb306075d89-insights-runtime-extractor-tls podName:47824c1a-b4a0-4799-89af-6bb306075d89 nodeName:}" failed. No retries permitted until 2026-07-08 22:34:23.911993162 +0000 UTC m=+267.688728527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47824c1a-b4a0-4799-89af-6bb306075d89-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2qlw7" (UID: "47824c1a-b4a0-4799-89af-6bb306075d89") : secret "insights-runtime-extractor-tls" not found
Jul 08 22:34:23.918603 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:23.918551    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47824c1a-b4a0-4799-89af-6bb306075d89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:23.918603 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:23.918607    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47824c1a-b4a0-4799-89af-6bb306075d89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:23.919121 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:23.918693    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 22:34:23.919121 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:23.918745    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47824c1a-b4a0-4799-89af-6bb306075d89-kube-rbac-proxy-cm podName:47824c1a-b4a0-4799-89af-6bb306075d89 nodeName:}" failed. No retries permitted until 2026-07-08 22:34:25.918731071 +0000 UTC m=+269.695466438 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47824c1a-b4a0-4799-89af-6bb306075d89-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2qlw7" (UID: "47824c1a-b4a0-4799-89af-6bb306075d89") : configmap "kube-rbac-proxy" not found
Jul 08 22:34:23.919121 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:23.918752    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 22:34:23.919121 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:23.918839    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47824c1a-b4a0-4799-89af-6bb306075d89-insights-runtime-extractor-tls podName:47824c1a-b4a0-4799-89af-6bb306075d89 nodeName:}" failed. No retries permitted until 2026-07-08 22:34:25.918822121 +0000 UTC m=+269.695557501 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47824c1a-b4a0-4799-89af-6bb306075d89-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2qlw7" (UID: "47824c1a-b4a0-4799-89af-6bb306075d89") : secret "insights-runtime-extractor-tls" not found
Jul 08 22:34:24.174951 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:24.174881    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bkxht_d08b2cb9-aff6-407b-9a7f-5b72d056ac1f/dns-node-resolver/0.log"
Jul 08 22:34:25.175399 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:25.175369    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ncmmp_13d80c7f-b517-4acf-8354-a317c8e556c8/node-ca/0.log"
Jul 08 22:34:25.933779 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:25.933729    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47824c1a-b4a0-4799-89af-6bb306075d89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:25.933779 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:25.933782    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47824c1a-b4a0-4799-89af-6bb306075d89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:25.934062 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:25.933883    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 22:34:25.934062 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:25.933935    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47824c1a-b4a0-4799-89af-6bb306075d89-kube-rbac-proxy-cm podName:47824c1a-b4a0-4799-89af-6bb306075d89 nodeName:}" failed. No retries permitted until 2026-07-08 22:34:29.93392144 +0000 UTC m=+273.710656806 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47824c1a-b4a0-4799-89af-6bb306075d89-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2qlw7" (UID: "47824c1a-b4a0-4799-89af-6bb306075d89") : configmap "kube-rbac-proxy" not found
Jul 08 22:34:25.934062 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:25.933931    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 22:34:25.934062 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:25.933997    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47824c1a-b4a0-4799-89af-6bb306075d89-insights-runtime-extractor-tls podName:47824c1a-b4a0-4799-89af-6bb306075d89 nodeName:}" failed. No retries permitted until 2026-07-08 22:34:29.93397994 +0000 UTC m=+273.710715314 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47824c1a-b4a0-4799-89af-6bb306075d89-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2qlw7" (UID: "47824c1a-b4a0-4799-89af-6bb306075d89") : secret "insights-runtime-extractor-tls" not found
Jul 08 22:34:26.177217 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:26.177188    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jgstm_95cba72c-b37c-4ead-bf9d-c66d377b90f7/serve-healthcheck-canary/0.log"
Jul 08 22:34:29.958711 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:29.958671    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47824c1a-b4a0-4799-89af-6bb306075d89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:29.959101 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:29.958779    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47824c1a-b4a0-4799-89af-6bb306075d89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:29.959101 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:29.958794    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 22:34:29.959101 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:29.958886    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47824c1a-b4a0-4799-89af-6bb306075d89-kube-rbac-proxy-cm podName:47824c1a-b4a0-4799-89af-6bb306075d89 nodeName:}" failed. No retries permitted until 2026-07-08 22:34:37.958864611 +0000 UTC m=+281.735599979 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47824c1a-b4a0-4799-89af-6bb306075d89-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2qlw7" (UID: "47824c1a-b4a0-4799-89af-6bb306075d89") : configmap "kube-rbac-proxy" not found
Jul 08 22:34:29.959101 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:29.958893    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 22:34:29.959101 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:29.958936    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47824c1a-b4a0-4799-89af-6bb306075d89-insights-runtime-extractor-tls podName:47824c1a-b4a0-4799-89af-6bb306075d89 nodeName:}" failed. No retries permitted until 2026-07-08 22:34:37.958925273 +0000 UTC m=+281.735660638 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47824c1a-b4a0-4799-89af-6bb306075d89-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2qlw7" (UID: "47824c1a-b4a0-4799-89af-6bb306075d89") : secret "insights-runtime-extractor-tls" not found
Jul 08 22:34:38.020397 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:38.020360    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47824c1a-b4a0-4799-89af-6bb306075d89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:38.020397 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:38.020404    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47824c1a-b4a0-4799-89af-6bb306075d89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:38.020891 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:38.020873    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47824c1a-b4a0-4799-89af-6bb306075d89-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:38.022727 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:38.022703    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47824c1a-b4a0-4799-89af-6bb306075d89-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qlw7\" (UID: \"47824c1a-b4a0-4799-89af-6bb306075d89\") " pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:38.115893 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:38.115864    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2qlw7"
Jul 08 22:34:38.235305 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:38.235276    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2qlw7"]
Jul 08 22:34:38.237982 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:34:38.237957    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47824c1a_b4a0_4799_89af_6bb306075d89.slice/crio-3a3c6a25b208fd625508aed7a51d39a5dd20d14026fdd99350dda3135d311994 WatchSource:0}: Error finding container 3a3c6a25b208fd625508aed7a51d39a5dd20d14026fdd99350dda3135d311994: Status 404 returned error can't find the container with id 3a3c6a25b208fd625508aed7a51d39a5dd20d14026fdd99350dda3135d311994
Jul 08 22:34:38.758464 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:38.758424    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2qlw7" event={"ID":"47824c1a-b4a0-4799-89af-6bb306075d89","Type":"ContainerStarted","Data":"3a3c6a25b208fd625508aed7a51d39a5dd20d14026fdd99350dda3135d311994"}
Jul 08 22:34:39.417543 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:39.417494    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pj4jv" podUID="01a27f4f-0263-4eca-b756-54b31715f955"
Jul 08 22:34:39.761001 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:39.760936    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:34:42.773621 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:42.773591    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2qlw7" event={"ID":"47824c1a-b4a0-4799-89af-6bb306075d89","Type":"ContainerStarted","Data":"e97261abe0c2542df4839b5541b6a1c98f96dfb207b18576f29650ca4931a7e2"}
Jul 08 22:34:42.773991 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:42.773637    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2qlw7" event={"ID":"47824c1a-b4a0-4799-89af-6bb306075d89","Type":"ContainerStarted","Data":"73e58fa6305806ec5933089d8caa951060d50b8887460aa39eda850aae70e7f3"}
Jul 08 22:34:43.058500 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:43.058468    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls\") pod \"dns-default-pj4jv\" (UID: \"01a27f4f-0263-4eca-b756-54b31715f955\") " pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:34:43.060939 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:43.060916    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01a27f4f-0263-4eca-b756-54b31715f955-metrics-tls\") pod \"dns-default-pj4jv\" (UID: \"01a27f4f-0263-4eca-b756-54b31715f955\") " pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:34:43.064522 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:43.064493    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5pzmj\""
Jul 08 22:34:43.072768 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:43.072733    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:34:43.191064 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:43.191031    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pj4jv"]
Jul 08 22:34:43.193817 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:34:43.193770    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a27f4f_0263_4eca_b756_54b31715f955.slice/crio-7b496eb16e3e10dd3443b95a549884fa899aa466b706d3daaddd74244dd31e41 WatchSource:0}: Error finding container 7b496eb16e3e10dd3443b95a549884fa899aa466b706d3daaddd74244dd31e41: Status 404 returned error can't find the container with id 7b496eb16e3e10dd3443b95a549884fa899aa466b706d3daaddd74244dd31e41
Jul 08 22:34:43.778655 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:43.778577    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pj4jv" event={"ID":"01a27f4f-0263-4eca-b756-54b31715f955","Type":"ContainerStarted","Data":"7b496eb16e3e10dd3443b95a549884fa899aa466b706d3daaddd74244dd31e41"}
Jul 08 22:34:44.463658 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.463623    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74c8bd875c-6qdzt"]
Jul 08 22:34:44.465626 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.465591    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.468606 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.468581    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8mxl8\""
Jul 08 22:34:44.468606 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.468609    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 08 22:34:44.468827 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.468717    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 08 22:34:44.469467 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.469443    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 08 22:34:44.479687 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.479665    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 08 22:34:44.484348 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.484329    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74c8bd875c-6qdzt"]
Jul 08 22:34:44.570743 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.570702    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86babb4e-d7ea-42f7-a9d3-5c894857ee54-registry-certificates\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.570952 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.570754    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2lk2\" (UniqueName: \"kubernetes.io/projected/86babb4e-d7ea-42f7-a9d3-5c894857ee54-kube-api-access-z2lk2\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.570952 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.570781    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86babb4e-d7ea-42f7-a9d3-5c894857ee54-registry-tls\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.570952 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.570883    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86babb4e-d7ea-42f7-a9d3-5c894857ee54-bound-sa-token\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.570952 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.570926    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86babb4e-d7ea-42f7-a9d3-5c894857ee54-image-registry-private-configuration\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.570952 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.570945    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86babb4e-d7ea-42f7-a9d3-5c894857ee54-ca-trust-extracted\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.571226 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.570974    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86babb4e-d7ea-42f7-a9d3-5c894857ee54-trusted-ca\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.571226 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.571020    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86babb4e-d7ea-42f7-a9d3-5c894857ee54-installation-pull-secrets\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.671718 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.671685    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86babb4e-d7ea-42f7-a9d3-5c894857ee54-installation-pull-secrets\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.671920 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.671756    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86babb4e-d7ea-42f7-a9d3-5c894857ee54-registry-certificates\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.671920 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.671794    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2lk2\" (UniqueName: \"kubernetes.io/projected/86babb4e-d7ea-42f7-a9d3-5c894857ee54-kube-api-access-z2lk2\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.671920 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.671860    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86babb4e-d7ea-42f7-a9d3-5c894857ee54-registry-tls\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.671920 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.671899    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86babb4e-d7ea-42f7-a9d3-5c894857ee54-bound-sa-token\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.672087 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.671930    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86babb4e-d7ea-42f7-a9d3-5c894857ee54-image-registry-private-configuration\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.672087 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.671959    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86babb4e-d7ea-42f7-a9d3-5c894857ee54-ca-trust-extracted\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.672087 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.671991    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86babb4e-d7ea-42f7-a9d3-5c894857ee54-trusted-ca\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.672717 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.672686    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86babb4e-d7ea-42f7-a9d3-5c894857ee54-registry-certificates\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.672888 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.672817    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86babb4e-d7ea-42f7-a9d3-5c894857ee54-ca-trust-extracted\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.673164 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.673072    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86babb4e-d7ea-42f7-a9d3-5c894857ee54-trusted-ca\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.674914 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.674888    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86babb4e-d7ea-42f7-a9d3-5c894857ee54-installation-pull-secrets\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.675117 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.675094    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86babb4e-d7ea-42f7-a9d3-5c894857ee54-image-registry-private-configuration\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.675205 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.675185    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86babb4e-d7ea-42f7-a9d3-5c894857ee54-registry-tls\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.680594 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.680566    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2lk2\" (UniqueName: \"kubernetes.io/projected/86babb4e-d7ea-42f7-a9d3-5c894857ee54-kube-api-access-z2lk2\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.681081 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.681059    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86babb4e-d7ea-42f7-a9d3-5c894857ee54-bound-sa-token\") pod \"image-registry-74c8bd875c-6qdzt\" (UID: \"86babb4e-d7ea-42f7-a9d3-5c894857ee54\") " pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:44.777589 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:44.777501    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:46.002743 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:46.002710    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74c8bd875c-6qdzt"]
Jul 08 22:34:46.005712 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:34:46.005685    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86babb4e_d7ea_42f7_a9d3_5c894857ee54.slice/crio-d1acfd8a47b5cb95a88dc6b88c9d62fbbee88e7c0da851e9e511161cc3dc7c91 WatchSource:0}: Error finding container d1acfd8a47b5cb95a88dc6b88c9d62fbbee88e7c0da851e9e511161cc3dc7c91: Status 404 returned error can't find the container with id d1acfd8a47b5cb95a88dc6b88c9d62fbbee88e7c0da851e9e511161cc3dc7c91
Jul 08 22:34:46.790288 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:46.790248    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pj4jv" event={"ID":"01a27f4f-0263-4eca-b756-54b31715f955","Type":"ContainerStarted","Data":"3eea98dbd277fdefb3741df71fef7725fa912fdddffbd289cf78814e7e97386c"}
Jul 08 22:34:46.790480 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:46.790300    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pj4jv" event={"ID":"01a27f4f-0263-4eca-b756-54b31715f955","Type":"ContainerStarted","Data":"11aa7f07ded39af4ee50e944412a5bc1c2b86ddb3398fc5da0ba626814af6592"}
Jul 08 22:34:46.790480 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:46.790381    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:34:46.791773 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:46.791746    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt" event={"ID":"86babb4e-d7ea-42f7-a9d3-5c894857ee54","Type":"ContainerStarted","Data":"4364963201fc7393e7de9a91c3c94767b549b8092c10b6ae3801e05ddd6b7c8f"}
Jul 08 22:34:46.791914 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:46.791786    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt" event={"ID":"86babb4e-d7ea-42f7-a9d3-5c894857ee54","Type":"ContainerStarted","Data":"d1acfd8a47b5cb95a88dc6b88c9d62fbbee88e7c0da851e9e511161cc3dc7c91"}
Jul 08 22:34:46.791914 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:46.791847    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:34:46.793582 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:46.793558    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2qlw7" event={"ID":"47824c1a-b4a0-4799-89af-6bb306075d89","Type":"ContainerStarted","Data":"c110634b5fccc94ba355294d189b026eaa55f5ec8648ec36b77635cfd4589930"}
Jul 08 22:34:46.806925 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:46.806842    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pj4jv" podStartSLOduration=251.143094204 podStartE2EDuration="4m13.80682579s" totalImagesPullingTime="2.663731586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:30:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:34:46.806101867 +0000 UTC m=+290.582837265" watchObservedRunningTime="2026-07-08 22:34:46.80682579 +0000 UTC m=+290.583561174"
Jul 08 22:34:46.822757 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:46.822716    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2qlw7" podStartSLOduration=17.301056231 podStartE2EDuration="24.822700877s" totalImagesPullingTime="7.521644646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:34:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:34:46.822602962 +0000 UTC m=+290.599338351" watchObservedRunningTime="2026-07-08 22:34:46.822700877 +0000 UTC m=+290.599436265"
Jul 08 22:34:46.842954 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:46.842907    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt" podStartSLOduration=2.84289326 podStartE2EDuration="2.84289326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:34:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:34:46.841485101 +0000 UTC m=+290.618220488" watchObservedRunningTime="2026-07-08 22:34:46.84289326 +0000 UTC m=+290.619628647"
Jul 08 22:34:52.768192 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:34:52.768150    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dnccf" podUID="5ec93cb5-8277-4f5c-a711-1fca9b9cc78a"
Jul 08 22:34:56.623998 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:56.623973    2558 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 22:34:56.798867 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:34:56.798837    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pj4jv"
Jul 08 22:35:04.977202 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:04.977147    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg" podUID="e64da6d6-b525-4dac-9aee-8428f11a8cee" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 08 22:35:05.767583 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:05.767549    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:35:07.801699 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:07.801671    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74c8bd875c-6qdzt"
Jul 08 22:35:10.349221 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.349190    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hj72l"]
Jul 08 22:35:10.367099 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.367069    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.371528 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.371505    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 22:35:10.371695 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.371597    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 22:35:10.371695 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.371659    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 22:35:10.371969 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.371954    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 22:35:10.372726 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.372708    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 22:35:10.372891 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.372855    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dvq2w\""
Jul 08 22:35:10.372891 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.372867    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 22:35:10.458429 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.458395    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5cb9d783-9d93-4aca-a7de-f4053a1a370b-root\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.458429 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.458430    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5cb9d783-9d93-4aca-a7de-f4053a1a370b-node-exporter-wtmp\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.458686 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.458458    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5cb9d783-9d93-4aca-a7de-f4053a1a370b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.458686 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.458542    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8mg8\" (UniqueName: \"kubernetes.io/projected/5cb9d783-9d93-4aca-a7de-f4053a1a370b-kube-api-access-l8mg8\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.458686 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.458581    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5cb9d783-9d93-4aca-a7de-f4053a1a370b-node-exporter-accelerators-collector-config\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.458686 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.458609    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5cb9d783-9d93-4aca-a7de-f4053a1a370b-node-exporter-tls\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.458686 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.458634    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5cb9d783-9d93-4aca-a7de-f4053a1a370b-sys\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.458686 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.458669    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5cb9d783-9d93-4aca-a7de-f4053a1a370b-node-exporter-textfile\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.458916 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.458697    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5cb9d783-9d93-4aca-a7de-f4053a1a370b-metrics-client-ca\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.559896 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.559856    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5cb9d783-9d93-4aca-a7de-f4053a1a370b-node-exporter-textfile\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.559896 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.559897    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5cb9d783-9d93-4aca-a7de-f4053a1a370b-metrics-client-ca\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.560136 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.559945    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5cb9d783-9d93-4aca-a7de-f4053a1a370b-root\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.560136 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.559969    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5cb9d783-9d93-4aca-a7de-f4053a1a370b-node-exporter-wtmp\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.560136 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.560076    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5cb9d783-9d93-4aca-a7de-f4053a1a370b-node-exporter-wtmp\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.560136 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.560084    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5cb9d783-9d93-4aca-a7de-f4053a1a370b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.560136 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.560113    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8mg8\" (UniqueName: \"kubernetes.io/projected/5cb9d783-9d93-4aca-a7de-f4053a1a370b-kube-api-access-l8mg8\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.560378 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.560079    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5cb9d783-9d93-4aca-a7de-f4053a1a370b-root\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.560378 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.560137    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5cb9d783-9d93-4aca-a7de-f4053a1a370b-node-exporter-accelerators-collector-config\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.560378 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.560177    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5cb9d783-9d93-4aca-a7de-f4053a1a370b-node-exporter-tls\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.560378 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.560193    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5cb9d783-9d93-4aca-a7de-f4053a1a370b-node-exporter-textfile\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.560378 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.560202    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5cb9d783-9d93-4aca-a7de-f4053a1a370b-sys\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.560378 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.560240    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5cb9d783-9d93-4aca-a7de-f4053a1a370b-sys\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.560378 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:35:10.560315    2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 08 22:35:10.560691 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:35:10.560395    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb9d783-9d93-4aca-a7de-f4053a1a370b-node-exporter-tls podName:5cb9d783-9d93-4aca-a7de-f4053a1a370b nodeName:}" failed. No retries permitted until 2026-07-08 22:35:11.060377351 +0000 UTC m=+314.837112718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5cb9d783-9d93-4aca-a7de-f4053a1a370b-node-exporter-tls") pod "node-exporter-hj72l" (UID: "5cb9d783-9d93-4aca-a7de-f4053a1a370b") : secret "node-exporter-tls" not found
Jul 08 22:35:10.560691 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.560538    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5cb9d783-9d93-4aca-a7de-f4053a1a370b-node-exporter-accelerators-collector-config\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.560691 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.560578    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5cb9d783-9d93-4aca-a7de-f4053a1a370b-metrics-client-ca\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.562517 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.562501    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5cb9d783-9d93-4aca-a7de-f4053a1a370b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:10.572048 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:10.572029    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8mg8\" (UniqueName: \"kubernetes.io/projected/5cb9d783-9d93-4aca-a7de-f4053a1a370b-kube-api-access-l8mg8\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:11.063695 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:11.063653    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5cb9d783-9d93-4aca-a7de-f4053a1a370b-node-exporter-tls\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:11.066112 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:11.066083    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5cb9d783-9d93-4aca-a7de-f4053a1a370b-node-exporter-tls\") pod \"node-exporter-hj72l\" (UID: \"5cb9d783-9d93-4aca-a7de-f4053a1a370b\") " pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:11.276385 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:11.276352    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hj72l"
Jul 08 22:35:11.285416 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:35:11.285389    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cb9d783_9d93_4aca_a7de_f4053a1a370b.slice/crio-d0dfea246d282b6df79d901de6dbd2225c5ddf835ccd1011d1322b15edd7b77f WatchSource:0}: Error finding container d0dfea246d282b6df79d901de6dbd2225c5ddf835ccd1011d1322b15edd7b77f: Status 404 returned error can't find the container with id d0dfea246d282b6df79d901de6dbd2225c5ddf835ccd1011d1322b15edd7b77f
Jul 08 22:35:11.287287 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:11.287268    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 22:35:11.862992 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:11.862956    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hj72l" event={"ID":"5cb9d783-9d93-4aca-a7de-f4053a1a370b","Type":"ContainerStarted","Data":"d0dfea246d282b6df79d901de6dbd2225c5ddf835ccd1011d1322b15edd7b77f"}
Jul 08 22:35:12.867289 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:12.867255    2558 generic.go:356] "Generic (PLEG): container finished" podID="5cb9d783-9d93-4aca-a7de-f4053a1a370b" containerID="0e5b6d315f4142b285e19f58d4092eedd15192819655dcf159729f735e984881" exitCode=0
Jul 08 22:35:12.867656 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:12.867314    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hj72l" event={"ID":"5cb9d783-9d93-4aca-a7de-f4053a1a370b","Type":"ContainerDied","Data":"0e5b6d315f4142b285e19f58d4092eedd15192819655dcf159729f735e984881"}
Jul 08 22:35:13.872664 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:13.872628    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hj72l" event={"ID":"5cb9d783-9d93-4aca-a7de-f4053a1a370b","Type":"ContainerStarted","Data":"1057d13242f5b2895f650337d26164f631a9d996e24367e84faff29fcfacaf5c"}
Jul 08 22:35:13.873050 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:13.872678    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hj72l" event={"ID":"5cb9d783-9d93-4aca-a7de-f4053a1a370b","Type":"ContainerStarted","Data":"121ea2e937df9801f4b74d2e815e14f17eab2a28194eab30a3271d073b3bedc5"}
Jul 08 22:35:13.893748 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:13.893703    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hj72l" podStartSLOduration=2.707352002 podStartE2EDuration="3.893688766s" totalImagesPullingTime="1.115484281s" totalInitContainerRuntime="70.852483ms" isStatefulPod=true podCreationTimestamp="2026-07-08 22:35:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:35:13.892725025 +0000 UTC m=+317.669460415" watchObservedRunningTime="2026-07-08 22:35:13.893688766 +0000 UTC m=+317.670424145"
Jul 08 22:35:14.715584 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.715546    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"]
Jul 08 22:35:14.717631 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.717607    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:14.721639 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.721611    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 08 22:35:14.721762 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.721622    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 08 22:35:14.721762 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.721627    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 08 22:35:14.721762 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.721628    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 08 22:35:14.721762 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.721628    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-f8cqr\""
Jul 08 22:35:14.722159 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.721651    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-499cc2q2p377\""
Jul 08 22:35:14.731023 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.731002    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"]
Jul 08 22:35:14.893375 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.893339    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8d3aaf9c-592d-4225-bf3e-e39d19d11a26-metrics-server-audit-profiles\") pod \"metrics-server-7f67c8c8b6-6flj9\" (UID: \"8d3aaf9c-592d-4225-bf3e-e39d19d11a26\") " pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:14.893754 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.893382    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8d3aaf9c-592d-4225-bf3e-e39d19d11a26-audit-log\") pod \"metrics-server-7f67c8c8b6-6flj9\" (UID: \"8d3aaf9c-592d-4225-bf3e-e39d19d11a26\") " pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:14.893754 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.893401    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d3aaf9c-592d-4225-bf3e-e39d19d11a26-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f67c8c8b6-6flj9\" (UID: \"8d3aaf9c-592d-4225-bf3e-e39d19d11a26\") " pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:14.893754 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.893420    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d3aaf9c-592d-4225-bf3e-e39d19d11a26-client-ca-bundle\") pod \"metrics-server-7f67c8c8b6-6flj9\" (UID: \"8d3aaf9c-592d-4225-bf3e-e39d19d11a26\") " pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:14.893754 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.893495    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcjgt\" (UniqueName: \"kubernetes.io/projected/8d3aaf9c-592d-4225-bf3e-e39d19d11a26-kube-api-access-gcjgt\") pod \"metrics-server-7f67c8c8b6-6flj9\" (UID: \"8d3aaf9c-592d-4225-bf3e-e39d19d11a26\") " pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:14.893754 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.893546    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8d3aaf9c-592d-4225-bf3e-e39d19d11a26-secret-metrics-server-client-certs\") pod \"metrics-server-7f67c8c8b6-6flj9\" (UID: \"8d3aaf9c-592d-4225-bf3e-e39d19d11a26\") " pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:14.893754 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.893631    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8d3aaf9c-592d-4225-bf3e-e39d19d11a26-secret-metrics-server-tls\") pod \"metrics-server-7f67c8c8b6-6flj9\" (UID: \"8d3aaf9c-592d-4225-bf3e-e39d19d11a26\") " pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:14.977824 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.977713    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg" podUID="e64da6d6-b525-4dac-9aee-8428f11a8cee" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 08 22:35:14.994753 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.994722    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8d3aaf9c-592d-4225-bf3e-e39d19d11a26-audit-log\") pod \"metrics-server-7f67c8c8b6-6flj9\" (UID: \"8d3aaf9c-592d-4225-bf3e-e39d19d11a26\") " pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:14.994753 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.994752    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d3aaf9c-592d-4225-bf3e-e39d19d11a26-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f67c8c8b6-6flj9\" (UID: \"8d3aaf9c-592d-4225-bf3e-e39d19d11a26\") " pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:14.994978 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.994769    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d3aaf9c-592d-4225-bf3e-e39d19d11a26-client-ca-bundle\") pod \"metrics-server-7f67c8c8b6-6flj9\" (UID: \"8d3aaf9c-592d-4225-bf3e-e39d19d11a26\") " pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:14.995066 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.995048    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcjgt\" (UniqueName: \"kubernetes.io/projected/8d3aaf9c-592d-4225-bf3e-e39d19d11a26-kube-api-access-gcjgt\") pod \"metrics-server-7f67c8c8b6-6flj9\" (UID: \"8d3aaf9c-592d-4225-bf3e-e39d19d11a26\") " pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:14.995133 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.995116    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8d3aaf9c-592d-4225-bf3e-e39d19d11a26-secret-metrics-server-client-certs\") pod \"metrics-server-7f67c8c8b6-6flj9\" (UID: \"8d3aaf9c-592d-4225-bf3e-e39d19d11a26\") " pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:14.995192 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.995179    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8d3aaf9c-592d-4225-bf3e-e39d19d11a26-secret-metrics-server-tls\") pod \"metrics-server-7f67c8c8b6-6flj9\" (UID: \"8d3aaf9c-592d-4225-bf3e-e39d19d11a26\") " pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:14.995244 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.995207    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8d3aaf9c-592d-4225-bf3e-e39d19d11a26-audit-log\") pod \"metrics-server-7f67c8c8b6-6flj9\" (UID: \"8d3aaf9c-592d-4225-bf3e-e39d19d11a26\") " pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:14.995244 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.995226    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8d3aaf9c-592d-4225-bf3e-e39d19d11a26-metrics-server-audit-profiles\") pod \"metrics-server-7f67c8c8b6-6flj9\" (UID: \"8d3aaf9c-592d-4225-bf3e-e39d19d11a26\") " pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:14.995782 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.995754    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d3aaf9c-592d-4225-bf3e-e39d19d11a26-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f67c8c8b6-6flj9\" (UID: \"8d3aaf9c-592d-4225-bf3e-e39d19d11a26\") " pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:14.996431 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.996406    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8d3aaf9c-592d-4225-bf3e-e39d19d11a26-metrics-server-audit-profiles\") pod \"metrics-server-7f67c8c8b6-6flj9\" (UID: \"8d3aaf9c-592d-4225-bf3e-e39d19d11a26\") " pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:14.997363 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.997341    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8d3aaf9c-592d-4225-bf3e-e39d19d11a26-client-ca-bundle\") pod \"metrics-server-7f67c8c8b6-6flj9\" (UID: \"8d3aaf9c-592d-4225-bf3e-e39d19d11a26\") " pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:14.997475 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.997458    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8d3aaf9c-592d-4225-bf3e-e39d19d11a26-secret-metrics-server-tls\") pod \"metrics-server-7f67c8c8b6-6flj9\" (UID: \"8d3aaf9c-592d-4225-bf3e-e39d19d11a26\") " pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:14.997688 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:14.997665    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8d3aaf9c-592d-4225-bf3e-e39d19d11a26-secret-metrics-server-client-certs\") pod \"metrics-server-7f67c8c8b6-6flj9\" (UID: \"8d3aaf9c-592d-4225-bf3e-e39d19d11a26\") " pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:15.005406 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.005384    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcjgt\" (UniqueName: \"kubernetes.io/projected/8d3aaf9c-592d-4225-bf3e-e39d19d11a26-kube-api-access-gcjgt\") pod \"metrics-server-7f67c8c8b6-6flj9\" (UID: \"8d3aaf9c-592d-4225-bf3e-e39d19d11a26\") " pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:15.026420 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.026390    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:15.161106 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.161074    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"]
Jul 08 22:35:15.165076 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:35:15.165051    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d3aaf9c_592d_4225_bf3e_e39d19d11a26.slice/crio-823e041d3c63abe3286ddcc36cf197e050151d243443ce1b77144cf417b78f69 WatchSource:0}: Error finding container 823e041d3c63abe3286ddcc36cf197e050151d243443ce1b77144cf417b78f69: Status 404 returned error can't find the container with id 823e041d3c63abe3286ddcc36cf197e050151d243443ce1b77144cf417b78f69
Jul 08 22:35:15.542037 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.541996    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-fb68d668c-98w7k"]
Jul 08 22:35:15.544705 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.544683    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.547432 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.547408    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 08 22:35:15.547653 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.547637    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 08 22:35:15.547728 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.547638    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-kgvvk\""
Jul 08 22:35:15.547728 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.547637    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 08 22:35:15.547842 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.547787    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 08 22:35:15.547953 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.547938    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 08 22:35:15.553747 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.553726    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 08 22:35:15.557982 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.557962    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fb68d668c-98w7k"]
Jul 08 22:35:15.700514 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.700486    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm6m6\" (UniqueName: \"kubernetes.io/projected/128fb5ef-7ae2-469a-986f-ea27e220fd34-kube-api-access-zm6m6\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.700514 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.700519    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/128fb5ef-7ae2-469a-986f-ea27e220fd34-federate-client-tls\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.700729 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.700541    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/128fb5ef-7ae2-469a-986f-ea27e220fd34-telemeter-client-tls\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.700729 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.700647    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/128fb5ef-7ae2-469a-986f-ea27e220fd34-metrics-client-ca\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.700729 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.700685    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/128fb5ef-7ae2-469a-986f-ea27e220fd34-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.700729 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.700706    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/128fb5ef-7ae2-469a-986f-ea27e220fd34-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.700891 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.700724    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/128fb5ef-7ae2-469a-986f-ea27e220fd34-secret-telemeter-client\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.700891 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.700774    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/128fb5ef-7ae2-469a-986f-ea27e220fd34-serving-certs-ca-bundle\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.802057 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.802029    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/128fb5ef-7ae2-469a-986f-ea27e220fd34-telemeter-client-tls\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.802188 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.802078    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/128fb5ef-7ae2-469a-986f-ea27e220fd34-metrics-client-ca\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.802188 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.802105    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/128fb5ef-7ae2-469a-986f-ea27e220fd34-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.802188 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.802123    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/128fb5ef-7ae2-469a-986f-ea27e220fd34-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.802188 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.802141    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/128fb5ef-7ae2-469a-986f-ea27e220fd34-secret-telemeter-client\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.802188 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.802165    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/128fb5ef-7ae2-469a-986f-ea27e220fd34-serving-certs-ca-bundle\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.802427 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.802191    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm6m6\" (UniqueName: \"kubernetes.io/projected/128fb5ef-7ae2-469a-986f-ea27e220fd34-kube-api-access-zm6m6\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.802427 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.802207    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/128fb5ef-7ae2-469a-986f-ea27e220fd34-federate-client-tls\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.802916 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.802890    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/128fb5ef-7ae2-469a-986f-ea27e220fd34-serving-certs-ca-bundle\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.803112 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.803091    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/128fb5ef-7ae2-469a-986f-ea27e220fd34-metrics-client-ca\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.803298 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.803279    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/128fb5ef-7ae2-469a-986f-ea27e220fd34-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.804662 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.804642    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/128fb5ef-7ae2-469a-986f-ea27e220fd34-telemeter-client-tls\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.804905 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.804887    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/128fb5ef-7ae2-469a-986f-ea27e220fd34-federate-client-tls\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.805256 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.805236    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/128fb5ef-7ae2-469a-986f-ea27e220fd34-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.805294 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.805286    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/128fb5ef-7ae2-469a-986f-ea27e220fd34-secret-telemeter-client\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.811702 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.811684    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm6m6\" (UniqueName: \"kubernetes.io/projected/128fb5ef-7ae2-469a-986f-ea27e220fd34-kube-api-access-zm6m6\") pod \"telemeter-client-fb68d668c-98w7k\" (UID: \"128fb5ef-7ae2-469a-986f-ea27e220fd34\") " pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.854897 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.854854    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k"
Jul 08 22:35:15.880929 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:15.880848    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9" event={"ID":"8d3aaf9c-592d-4225-bf3e-e39d19d11a26","Type":"ContainerStarted","Data":"823e041d3c63abe3286ddcc36cf197e050151d243443ce1b77144cf417b78f69"}
Jul 08 22:35:16.001128 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:16.001099    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fb68d668c-98w7k"]
Jul 08 22:35:16.003897 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:35:16.003869    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod128fb5ef_7ae2_469a_986f_ea27e220fd34.slice/crio-7f435dd019000bd3fb127c91a650e30edcd0e9fcfffc3a0de16a4858c50e2520 WatchSource:0}: Error finding container 7f435dd019000bd3fb127c91a650e30edcd0e9fcfffc3a0de16a4858c50e2520: Status 404 returned error can't find the container with id 7f435dd019000bd3fb127c91a650e30edcd0e9fcfffc3a0de16a4858c50e2520
Jul 08 22:35:16.886235 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:16.886194    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k" event={"ID":"128fb5ef-7ae2-469a-986f-ea27e220fd34","Type":"ContainerStarted","Data":"7f435dd019000bd3fb127c91a650e30edcd0e9fcfffc3a0de16a4858c50e2520"}
Jul 08 22:35:16.888114 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:16.888083    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9" event={"ID":"8d3aaf9c-592d-4225-bf3e-e39d19d11a26","Type":"ContainerStarted","Data":"03dfc05ad865815c2d491ac8c111c41cf46066c0fd7a45c2a62352eb7f620cf6"}
Jul 08 22:35:16.919708 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:16.919612    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9" podStartSLOduration=1.42770536 podStartE2EDuration="2.919595297s" totalImagesPullingTime="1.491889937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:35:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:35:16.918558546 +0000 UTC m=+320.695293936" watchObservedRunningTime="2026-07-08 22:35:16.919595297 +0000 UTC m=+320.696330684"
Jul 08 22:35:18.897360 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:18.897318    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k" event={"ID":"128fb5ef-7ae2-469a-986f-ea27e220fd34","Type":"ContainerStarted","Data":"77164b42771ebdab093540a666b2023877ee30887eb793cd0fd31a9b1241eb53"}
Jul 08 22:35:19.902900 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:19.902862    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k" event={"ID":"128fb5ef-7ae2-469a-986f-ea27e220fd34","Type":"ContainerStarted","Data":"5e35da34fb8a70ba3c8204105c3be0f04d7f5cdd0598f265481e7ab856c5844e"}
Jul 08 22:35:19.903284 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:19.902923    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k" event={"ID":"128fb5ef-7ae2-469a-986f-ea27e220fd34","Type":"ContainerStarted","Data":"e8abdcd5c5a93acf01974addb8c09c6609bc3c84e2f479c930c0e9577d47d4fc"}
Jul 08 22:35:19.925835 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:19.925770    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-fb68d668c-98w7k" podStartSLOduration=1.464701805 podStartE2EDuration="4.925755535s" totalImagesPullingTime="3.46105373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:35:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:35:19.924767805 +0000 UTC m=+323.701503220" watchObservedRunningTime="2026-07-08 22:35:19.925755535 +0000 UTC m=+323.702490922"
Jul 08 22:35:24.977102 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:24.977064    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg" podUID="e64da6d6-b525-4dac-9aee-8428f11a8cee" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 08 22:35:24.977458 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:24.977143    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg"
Jul 08 22:35:24.977683 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:24.977653    2558 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"b8858902d958fb1259b5e80a7ca8302e67dff01b4e1cfedbd33a5dc3a3149f79"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 08 22:35:24.977732 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:24.977709    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg" podUID="e64da6d6-b525-4dac-9aee-8428f11a8cee" containerName="service-proxy" containerID="cri-o://b8858902d958fb1259b5e80a7ca8302e67dff01b4e1cfedbd33a5dc3a3149f79" gracePeriod=30
Jul 08 22:35:25.929122 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:25.929091    2558 generic.go:356] "Generic (PLEG): container finished" podID="e64da6d6-b525-4dac-9aee-8428f11a8cee" containerID="b8858902d958fb1259b5e80a7ca8302e67dff01b4e1cfedbd33a5dc3a3149f79" exitCode=2
Jul 08 22:35:25.929290 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:25.929130    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg" event={"ID":"e64da6d6-b525-4dac-9aee-8428f11a8cee","Type":"ContainerDied","Data":"b8858902d958fb1259b5e80a7ca8302e67dff01b4e1cfedbd33a5dc3a3149f79"}
Jul 08 22:35:25.929290 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:25.929162    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79b76544b7-fcjpg" event={"ID":"e64da6d6-b525-4dac-9aee-8428f11a8cee","Type":"ContainerStarted","Data":"b996356a4a8f04c0eb2474e643accffff7c5ad10a3687f4d761d8249a0ee6cf4"}
Jul 08 22:35:27.860980 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:27.860949    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jgstm_95cba72c-b37c-4ead-bf9d-c66d377b90f7/serve-healthcheck-canary/0.log"
Jul 08 22:35:35.027465 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:35.027420    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:35.027881 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:35.027491    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:55.032277 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:55.032189    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:35:55.035930 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:35:55.035907    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7f67c8c8b6-6flj9"
Jul 08 22:36:10.537266 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:36:10.537224    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs\") pod \"network-metrics-daemon-dnccf\" (UID: \"5ec93cb5-8277-4f5c-a711-1fca9b9cc78a\") " pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:36:10.539763 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:36:10.539740    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ec93cb5-8277-4f5c-a711-1fca9b9cc78a-metrics-certs\") pod \"network-metrics-daemon-dnccf\" (UID: \"5ec93cb5-8277-4f5c-a711-1fca9b9cc78a\") " pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:36:10.571306 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:36:10.571282    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tm4h7\""
Jul 08 22:36:10.579549 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:36:10.579528    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnccf"
Jul 08 22:36:10.705704 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:36:10.705674    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dnccf"]
Jul 08 22:36:10.709372 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:36:10.709349    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ec93cb5_8277_4f5c_a711_1fca9b9cc78a.slice/crio-cb0c43638ee72b34f2de5ed6918e7cc9169d28d3f8a74e272674304b9792fceb WatchSource:0}: Error finding container cb0c43638ee72b34f2de5ed6918e7cc9169d28d3f8a74e272674304b9792fceb: Status 404 returned error can't find the container with id cb0c43638ee72b34f2de5ed6918e7cc9169d28d3f8a74e272674304b9792fceb
Jul 08 22:36:11.074314 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:36:11.074277    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dnccf" event={"ID":"5ec93cb5-8277-4f5c-a711-1fca9b9cc78a","Type":"ContainerStarted","Data":"cb0c43638ee72b34f2de5ed6918e7cc9169d28d3f8a74e272674304b9792fceb"}
Jul 08 22:36:12.079478 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:36:12.079437    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dnccf" event={"ID":"5ec93cb5-8277-4f5c-a711-1fca9b9cc78a","Type":"ContainerStarted","Data":"f3c8725ba0960e22fb543fa1119278c93bf92c8130b94938ea62bdd03fb2f177"}
Jul 08 22:36:12.079966 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:36:12.079495    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dnccf" event={"ID":"5ec93cb5-8277-4f5c-a711-1fca9b9cc78a","Type":"ContainerStarted","Data":"3bd9ded23cccb9fba23d5fce216c75f2e71358e33b8c7aad70f332ad369c7654"}
Jul 08 22:36:12.097240 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:36:12.097198    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dnccf" podStartSLOduration=374.17620721 podStartE2EDuration="6m15.097182289s" totalImagesPullingTime="920.975079ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:36:12.096193368 +0000 UTC m=+375.872928755" watchObservedRunningTime="2026-07-08 22:36:12.097182289 +0000 UTC m=+375.873917676"
Jul 08 22:38:20.673666 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.673635    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc"]
Jul 08 22:38:20.676666 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.676645    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc"
Jul 08 22:38:20.679670 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.679652    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 22:38:20.680100 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.680078    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 22:38:20.680217 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.680105    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 22:38:20.680217 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.680168    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nk2k8\""
Jul 08 22:38:20.680217 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.680188    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 22:38:20.694622 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.694600    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc"]
Jul 08 22:38:20.772752 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.772720    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/73ddd36b-55ea-474b-b653-9d29fa69e1c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67f464889d-dfddc\" (UID: \"73ddd36b-55ea-474b-b653-9d29fa69e1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc"
Jul 08 22:38:20.772752 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.772756    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxmnz\" (UniqueName: \"kubernetes.io/projected/73ddd36b-55ea-474b-b653-9d29fa69e1c5-kube-api-access-xxmnz\") pod \"opendatahub-operator-controller-manager-67f464889d-dfddc\" (UID: \"73ddd36b-55ea-474b-b653-9d29fa69e1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc"
Jul 08 22:38:20.772959 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.772795    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73ddd36b-55ea-474b-b653-9d29fa69e1c5-tmp\") pod \"opendatahub-operator-controller-manager-67f464889d-dfddc\" (UID: \"73ddd36b-55ea-474b-b653-9d29fa69e1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc"
Jul 08 22:38:20.772959 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.772844    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/73ddd36b-55ea-474b-b653-9d29fa69e1c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-67f464889d-dfddc\" (UID: \"73ddd36b-55ea-474b-b653-9d29fa69e1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc"
Jul 08 22:38:20.772959 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.772862    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/73ddd36b-55ea-474b-b653-9d29fa69e1c5-manifests\") pod \"opendatahub-operator-controller-manager-67f464889d-dfddc\" (UID: \"73ddd36b-55ea-474b-b653-9d29fa69e1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc"
Jul 08 22:38:20.874009 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.873979    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73ddd36b-55ea-474b-b653-9d29fa69e1c5-tmp\") pod \"opendatahub-operator-controller-manager-67f464889d-dfddc\" (UID: \"73ddd36b-55ea-474b-b653-9d29fa69e1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc"
Jul 08 22:38:20.874151 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.874128    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/73ddd36b-55ea-474b-b653-9d29fa69e1c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-67f464889d-dfddc\" (UID: \"73ddd36b-55ea-474b-b653-9d29fa69e1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc"
Jul 08 22:38:20.874191 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.874178    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/73ddd36b-55ea-474b-b653-9d29fa69e1c5-manifests\") pod \"opendatahub-operator-controller-manager-67f464889d-dfddc\" (UID: \"73ddd36b-55ea-474b-b653-9d29fa69e1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc"
Jul 08 22:38:20.874289 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.874270    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/73ddd36b-55ea-474b-b653-9d29fa69e1c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67f464889d-dfddc\" (UID: \"73ddd36b-55ea-474b-b653-9d29fa69e1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc"
Jul 08 22:38:20.874377 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.874335    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxmnz\" (UniqueName: \"kubernetes.io/projected/73ddd36b-55ea-474b-b653-9d29fa69e1c5-kube-api-access-xxmnz\") pod \"opendatahub-operator-controller-manager-67f464889d-dfddc\" (UID: \"73ddd36b-55ea-474b-b653-9d29fa69e1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc"
Jul 08 22:38:20.874569 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.874547    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/73ddd36b-55ea-474b-b653-9d29fa69e1c5-manifests\") pod \"opendatahub-operator-controller-manager-67f464889d-dfddc\" (UID: \"73ddd36b-55ea-474b-b653-9d29fa69e1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc"
Jul 08 22:38:20.876412 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.876391    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73ddd36b-55ea-474b-b653-9d29fa69e1c5-tmp\") pod \"opendatahub-operator-controller-manager-67f464889d-dfddc\" (UID: \"73ddd36b-55ea-474b-b653-9d29fa69e1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc"
Jul 08 22:38:20.876629 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.876613    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/73ddd36b-55ea-474b-b653-9d29fa69e1c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-67f464889d-dfddc\" (UID: \"73ddd36b-55ea-474b-b653-9d29fa69e1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc"
Jul 08 22:38:20.876758 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.876738    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/73ddd36b-55ea-474b-b653-9d29fa69e1c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67f464889d-dfddc\" (UID: \"73ddd36b-55ea-474b-b653-9d29fa69e1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc"
Jul 08 22:38:20.892986 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.892965    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxmnz\" (UniqueName: \"kubernetes.io/projected/73ddd36b-55ea-474b-b653-9d29fa69e1c5-kube-api-access-xxmnz\") pod \"opendatahub-operator-controller-manager-67f464889d-dfddc\" (UID: \"73ddd36b-55ea-474b-b653-9d29fa69e1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc"
Jul 08 22:38:20.986528 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:20.986450    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc"
Jul 08 22:38:21.112083 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:21.112059    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc"]
Jul 08 22:38:21.114625 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:38:21.114595    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73ddd36b_55ea_474b_b653_9d29fa69e1c5.slice/crio-564e699a05e373582c6887f453bbee64f0d2efbacfe6b64168ba559bb30c40c7 WatchSource:0}: Error finding container 564e699a05e373582c6887f453bbee64f0d2efbacfe6b64168ba559bb30c40c7: Status 404 returned error can't find the container with id 564e699a05e373582c6887f453bbee64f0d2efbacfe6b64168ba559bb30c40c7
Jul 08 22:38:21.516189 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:21.516153    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc" event={"ID":"73ddd36b-55ea-474b-b653-9d29fa69e1c5","Type":"ContainerStarted","Data":"564e699a05e373582c6887f453bbee64f0d2efbacfe6b64168ba559bb30c40c7"}
Jul 08 22:38:24.528892 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:24.528850    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc" event={"ID":"73ddd36b-55ea-474b-b653-9d29fa69e1c5","Type":"ContainerStarted","Data":"5a1f180bffb939000a9e567836c5c0795befe421b8e09159934448b7d4d89a5a"}
Jul 08 22:38:25.538471 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:25.538380    2558 generic.go:356] "Generic (PLEG): container finished" podID="73ddd36b-55ea-474b-b653-9d29fa69e1c5" containerID="5a1f180bffb939000a9e567836c5c0795befe421b8e09159934448b7d4d89a5a" exitCode=0
Jul 08 22:38:25.538471 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:25.538419    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc" event={"ID":"73ddd36b-55ea-474b-b653-9d29fa69e1c5","Type":"ContainerDied","Data":"5a1f180bffb939000a9e567836c5c0795befe421b8e09159934448b7d4d89a5a"}
Jul 08 22:38:26.544205 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:26.544108    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc" event={"ID":"73ddd36b-55ea-474b-b653-9d29fa69e1c5","Type":"ContainerStarted","Data":"571fdd76c4b5d992cb5ab6df376798ce39faac62998f88ef8ae1cc63aaf47a43"}
Jul 08 22:38:26.544577 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:26.544221    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc"
Jul 08 22:38:26.566661 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:26.566610    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc" podStartSLOduration=2.136804571 podStartE2EDuration="6.566593085s" totalImagesPullingTime="3.374597316s" totalInitContainerRuntime="1.055191198s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:38:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:38:26.564723534 +0000 UTC m=+510.341458933" watchObservedRunningTime="2026-07-08 22:38:26.566593085 +0000 UTC m=+510.343328473"
Jul 08 22:38:37.549666 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:37.549633    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-dfddc"
Jul 08 22:38:40.170413 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.170373    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6d9656f865-vdgx4"]
Jul 08 22:38:40.180770 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.180741    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d9656f865-vdgx4"
Jul 08 22:38:40.184862 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.184844    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 08 22:38:40.184982 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.184893    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 08 22:38:40.185051 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.184892    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 22:38:40.185315 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.185299    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 22:38:40.200333 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.200310    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d9656f865-vdgx4"]
Jul 08 22:38:40.215634 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.215605    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99a75cf9-46df-4253-8bac-84d6f5fc0d01-tls-certs\") pod \"kube-auth-proxy-6d9656f865-vdgx4\" (UID: \"99a75cf9-46df-4253-8bac-84d6f5fc0d01\") " pod="openshift-ingress/kube-auth-proxy-6d9656f865-vdgx4"
Jul 08 22:38:40.215763 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.215677    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99a75cf9-46df-4253-8bac-84d6f5fc0d01-tmp\") pod \"kube-auth-proxy-6d9656f865-vdgx4\" (UID: \"99a75cf9-46df-4253-8bac-84d6f5fc0d01\") " pod="openshift-ingress/kube-auth-proxy-6d9656f865-vdgx4"
Jul 08 22:38:40.215763 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.215706    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlvq7\" (UniqueName: \"kubernetes.io/projected/99a75cf9-46df-4253-8bac-84d6f5fc0d01-kube-api-access-zlvq7\") pod \"kube-auth-proxy-6d9656f865-vdgx4\" (UID: \"99a75cf9-46df-4253-8bac-84d6f5fc0d01\") " pod="openshift-ingress/kube-auth-proxy-6d9656f865-vdgx4"
Jul 08 22:38:40.316377 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.316341    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99a75cf9-46df-4253-8bac-84d6f5fc0d01-tls-certs\") pod \"kube-auth-proxy-6d9656f865-vdgx4\" (UID: \"99a75cf9-46df-4253-8bac-84d6f5fc0d01\") " pod="openshift-ingress/kube-auth-proxy-6d9656f865-vdgx4"
Jul 08 22:38:40.316531 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.316427    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99a75cf9-46df-4253-8bac-84d6f5fc0d01-tmp\") pod \"kube-auth-proxy-6d9656f865-vdgx4\" (UID: \"99a75cf9-46df-4253-8bac-84d6f5fc0d01\") " pod="openshift-ingress/kube-auth-proxy-6d9656f865-vdgx4"
Jul 08 22:38:40.316531 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.316466    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlvq7\" (UniqueName: \"kubernetes.io/projected/99a75cf9-46df-4253-8bac-84d6f5fc0d01-kube-api-access-zlvq7\") pod \"kube-auth-proxy-6d9656f865-vdgx4\" (UID: \"99a75cf9-46df-4253-8bac-84d6f5fc0d01\") " pod="openshift-ingress/kube-auth-proxy-6d9656f865-vdgx4"
Jul 08 22:38:40.318998 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.318971    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99a75cf9-46df-4253-8bac-84d6f5fc0d01-tmp\") pod \"kube-auth-proxy-6d9656f865-vdgx4\" (UID: \"99a75cf9-46df-4253-8bac-84d6f5fc0d01\") " pod="openshift-ingress/kube-auth-proxy-6d9656f865-vdgx4"
Jul 08 22:38:40.319193 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.319178    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99a75cf9-46df-4253-8bac-84d6f5fc0d01-tls-certs\") pod \"kube-auth-proxy-6d9656f865-vdgx4\" (UID: \"99a75cf9-46df-4253-8bac-84d6f5fc0d01\") " pod="openshift-ingress/kube-auth-proxy-6d9656f865-vdgx4"
Jul 08 22:38:40.332391 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.332356    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlvq7\" (UniqueName: \"kubernetes.io/projected/99a75cf9-46df-4253-8bac-84d6f5fc0d01-kube-api-access-zlvq7\") pod \"kube-auth-proxy-6d9656f865-vdgx4\" (UID: \"99a75cf9-46df-4253-8bac-84d6f5fc0d01\") " pod="openshift-ingress/kube-auth-proxy-6d9656f865-vdgx4"
Jul 08 22:38:40.490468 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.490382    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d9656f865-vdgx4"
Jul 08 22:38:40.492221 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.492191    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-w449w"]
Jul 08 22:38:40.494496 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.494475    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-w449w"
Jul 08 22:38:40.497232 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.497204    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 08 22:38:40.497232 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.497220    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-7tnwr\""
Jul 08 22:38:40.518761 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.518688    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-w449w"]
Jul 08 22:38:40.619173 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.619137    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98bdbae2-2338-400f-823f-779dcd660cfc-cert\") pod \"odh-model-controller-7998c67dc4-w449w\" (UID: \"98bdbae2-2338-400f-823f-779dcd660cfc\") " pod="opendatahub/odh-model-controller-7998c67dc4-w449w"
Jul 08 22:38:40.619354 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.619196    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bfbw\" (UniqueName: \"kubernetes.io/projected/98bdbae2-2338-400f-823f-779dcd660cfc-kube-api-access-7bfbw\") pod \"odh-model-controller-7998c67dc4-w449w\" (UID: \"98bdbae2-2338-400f-823f-779dcd660cfc\") " pod="opendatahub/odh-model-controller-7998c67dc4-w449w"
Jul 08 22:38:40.633025 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.632999    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d9656f865-vdgx4"]
Jul 08 22:38:40.635920 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:38:40.635891    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99a75cf9_46df_4253_8bac_84d6f5fc0d01.slice/crio-18be982765aa1e85a3a5d8563d084f8528a11d8805238d9e378a18e044023eac WatchSource:0}: Error finding container 18be982765aa1e85a3a5d8563d084f8528a11d8805238d9e378a18e044023eac: Status 404 returned error can't find the container with id 18be982765aa1e85a3a5d8563d084f8528a11d8805238d9e378a18e044023eac
Jul 08 22:38:40.720276 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.720242    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98bdbae2-2338-400f-823f-779dcd660cfc-cert\") pod \"odh-model-controller-7998c67dc4-w449w\" (UID: \"98bdbae2-2338-400f-823f-779dcd660cfc\") " pod="opendatahub/odh-model-controller-7998c67dc4-w449w"
Jul 08 22:38:40.720276 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.720278    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bfbw\" (UniqueName: \"kubernetes.io/projected/98bdbae2-2338-400f-823f-779dcd660cfc-kube-api-access-7bfbw\") pod \"odh-model-controller-7998c67dc4-w449w\" (UID: \"98bdbae2-2338-400f-823f-779dcd660cfc\") " pod="opendatahub/odh-model-controller-7998c67dc4-w449w"
Jul 08 22:38:40.723006 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.722978    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98bdbae2-2338-400f-823f-779dcd660cfc-cert\") pod \"odh-model-controller-7998c67dc4-w449w\" (UID: \"98bdbae2-2338-400f-823f-779dcd660cfc\") " pod="opendatahub/odh-model-controller-7998c67dc4-w449w"
Jul 08 22:38:40.738146 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.738114    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bfbw\" (UniqueName: \"kubernetes.io/projected/98bdbae2-2338-400f-823f-779dcd660cfc-kube-api-access-7bfbw\") pod \"odh-model-controller-7998c67dc4-w449w\" (UID: \"98bdbae2-2338-400f-823f-779dcd660cfc\") " pod="opendatahub/odh-model-controller-7998c67dc4-w449w"
Jul 08 22:38:40.824620 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.824583    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-w449w"
Jul 08 22:38:40.987186 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:40.987154    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-w449w"]
Jul 08 22:38:40.993569 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:38:40.993538    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98bdbae2_2338_400f_823f_779dcd660cfc.slice/crio-d692b2fcb68db318f626844df5f37ce7a61d3a5cef1e0b619ab727c2335ba655 WatchSource:0}: Error finding container d692b2fcb68db318f626844df5f37ce7a61d3a5cef1e0b619ab727c2335ba655: Status 404 returned error can't find the container with id d692b2fcb68db318f626844df5f37ce7a61d3a5cef1e0b619ab727c2335ba655
Jul 08 22:38:41.468986 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.468954    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bcj2q"]
Jul 08 22:38:41.470995 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.470979    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-bcj2q"
Jul 08 22:38:41.474204 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.474181    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 08 22:38:41.474336 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.474219    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-99c6h\""
Jul 08 22:38:41.497813 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.497730    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bcj2q"]
Jul 08 22:38:41.526360 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.526323    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pcpj\" (UniqueName: \"kubernetes.io/projected/1e614f8e-d451-4cee-b0c4-9cc14ace0b3e-kube-api-access-5pcpj\") pod \"model-serving-api-54d89bd5fc-bcj2q\" (UID: \"1e614f8e-d451-4cee-b0c4-9cc14ace0b3e\") " pod="opendatahub/model-serving-api-54d89bd5fc-bcj2q"
Jul 08 22:38:41.526530 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.526433    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e614f8e-d451-4cee-b0c4-9cc14ace0b3e-tls-certs\") pod \"model-serving-api-54d89bd5fc-bcj2q\" (UID: \"1e614f8e-d451-4cee-b0c4-9cc14ace0b3e\") " pod="opendatahub/model-serving-api-54d89bd5fc-bcj2q"
Jul 08 22:38:41.600094 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.600045    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-w449w" event={"ID":"98bdbae2-2338-400f-823f-779dcd660cfc","Type":"ContainerStarted","Data":"d692b2fcb68db318f626844df5f37ce7a61d3a5cef1e0b619ab727c2335ba655"}
Jul 08 22:38:41.601400 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.601366    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d9656f865-vdgx4" event={"ID":"99a75cf9-46df-4253-8bac-84d6f5fc0d01","Type":"ContainerStarted","Data":"18be982765aa1e85a3a5d8563d084f8528a11d8805238d9e378a18e044023eac"}
Jul 08 22:38:41.627550 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.627513    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pcpj\" (UniqueName: \"kubernetes.io/projected/1e614f8e-d451-4cee-b0c4-9cc14ace0b3e-kube-api-access-5pcpj\") pod \"model-serving-api-54d89bd5fc-bcj2q\" (UID: \"1e614f8e-d451-4cee-b0c4-9cc14ace0b3e\") " pod="opendatahub/model-serving-api-54d89bd5fc-bcj2q"
Jul 08 22:38:41.627738 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.627614    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e614f8e-d451-4cee-b0c4-9cc14ace0b3e-tls-certs\") pod \"model-serving-api-54d89bd5fc-bcj2q\" (UID: \"1e614f8e-d451-4cee-b0c4-9cc14ace0b3e\") " pod="opendatahub/model-serving-api-54d89bd5fc-bcj2q"
Jul 08 22:38:41.630649 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.630620    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e614f8e-d451-4cee-b0c4-9cc14ace0b3e-tls-certs\") pod \"model-serving-api-54d89bd5fc-bcj2q\" (UID: \"1e614f8e-d451-4cee-b0c4-9cc14ace0b3e\") " pod="opendatahub/model-serving-api-54d89bd5fc-bcj2q"
Jul 08 22:38:41.641183 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.641155    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pcpj\" (UniqueName: \"kubernetes.io/projected/1e614f8e-d451-4cee-b0c4-9cc14ace0b3e-kube-api-access-5pcpj\") pod \"model-serving-api-54d89bd5fc-bcj2q\" (UID: \"1e614f8e-d451-4cee-b0c4-9cc14ace0b3e\") " pod="opendatahub/model-serving-api-54d89bd5fc-bcj2q"
Jul 08 22:38:41.712834 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.712790    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"]
Jul 08 22:38:41.714949 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.714934    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:41.717436 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.717400    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 08 22:38:41.717607 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.717489    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 08 22:38:41.717607 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.717555    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 08 22:38:41.717776 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.717625    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-v2568\""
Jul 08 22:38:41.717776 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.717619    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 22:38:41.728938 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.728913    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"]
Jul 08 22:38:41.781585 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.781547    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-bcj2q"
Jul 08 22:38:41.830572 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.829947    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zctj\" (UniqueName: \"kubernetes.io/projected/a17231a9-4e11-4899-9819-3723211c950d-kube-api-access-2zctj\") pod \"istiod-openshift-gateway-7574459656-m7ngt\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:41.830572 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.830007    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a17231a9-4e11-4899-9819-3723211c950d-local-certs\") pod \"istiod-openshift-gateway-7574459656-m7ngt\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:41.830572 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.830057    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a17231a9-4e11-4899-9819-3723211c950d-cacerts\") pod \"istiod-openshift-gateway-7574459656-m7ngt\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:41.830572 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.830083    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a17231a9-4e11-4899-9819-3723211c950d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-m7ngt\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:41.830572 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.830122    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a17231a9-4e11-4899-9819-3723211c950d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-m7ngt\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:41.830572 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.830165    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a17231a9-4e11-4899-9819-3723211c950d-istio-token\") pod \"istiod-openshift-gateway-7574459656-m7ngt\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:41.830572 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.830227    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a17231a9-4e11-4899-9819-3723211c950d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-m7ngt\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:41.931588 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.931283    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zctj\" (UniqueName: \"kubernetes.io/projected/a17231a9-4e11-4899-9819-3723211c950d-kube-api-access-2zctj\") pod \"istiod-openshift-gateway-7574459656-m7ngt\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:41.931588 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.931344    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a17231a9-4e11-4899-9819-3723211c950d-local-certs\") pod \"istiod-openshift-gateway-7574459656-m7ngt\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:41.931588 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.931389    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a17231a9-4e11-4899-9819-3723211c950d-cacerts\") pod \"istiod-openshift-gateway-7574459656-m7ngt\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:41.931588 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.931411    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a17231a9-4e11-4899-9819-3723211c950d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-m7ngt\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:41.931588 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.931447    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a17231a9-4e11-4899-9819-3723211c950d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-m7ngt\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:41.931588 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.931474    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a17231a9-4e11-4899-9819-3723211c950d-istio-token\") pod \"istiod-openshift-gateway-7574459656-m7ngt\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:41.931588 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.931522    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a17231a9-4e11-4899-9819-3723211c950d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-m7ngt\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:41.932471 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.932405    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a17231a9-4e11-4899-9819-3723211c950d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-m7ngt\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:41.935667 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.935635    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a17231a9-4e11-4899-9819-3723211c950d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-m7ngt\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:41.936531 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.936506    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a17231a9-4e11-4899-9819-3723211c950d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-m7ngt\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:41.936967 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.936929    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a17231a9-4e11-4899-9819-3723211c950d-cacerts\") pod \"istiod-openshift-gateway-7574459656-m7ngt\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:41.937742 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.937703    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a17231a9-4e11-4899-9819-3723211c950d-local-certs\") pod \"istiod-openshift-gateway-7574459656-m7ngt\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:41.940021 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.939999    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-bcj2q"]
Jul 08 22:38:41.944913 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:38:41.944876    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e614f8e_d451_4cee_b0c4_9cc14ace0b3e.slice/crio-a069f6c64b5f4c87e91e9d437b64b0e0bac8b907704f41bb33c09a58b0eb3b5f WatchSource:0}: Error finding container a069f6c64b5f4c87e91e9d437b64b0e0bac8b907704f41bb33c09a58b0eb3b5f: Status 404 returned error can't find the container with id a069f6c64b5f4c87e91e9d437b64b0e0bac8b907704f41bb33c09a58b0eb3b5f
Jul 08 22:38:41.945140 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.945066    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zctj\" (UniqueName: \"kubernetes.io/projected/a17231a9-4e11-4899-9819-3723211c950d-kube-api-access-2zctj\") pod \"istiod-openshift-gateway-7574459656-m7ngt\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:41.945493 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:41.945454    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a17231a9-4e11-4899-9819-3723211c950d-istio-token\") pod \"istiod-openshift-gateway-7574459656-m7ngt\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:42.028256 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:42.027956    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:42.212624 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:42.207471    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"]
Jul 08 22:38:42.609703 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:42.609639    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-bcj2q" event={"ID":"1e614f8e-d451-4cee-b0c4-9cc14ace0b3e","Type":"ContainerStarted","Data":"a069f6c64b5f4c87e91e9d437b64b0e0bac8b907704f41bb33c09a58b0eb3b5f"}
Jul 08 22:38:42.612084 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:42.612051    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt" event={"ID":"a17231a9-4e11-4899-9819-3723211c950d","Type":"ContainerStarted","Data":"e251b0e8ccfe646328946cc04df1d3b22f1e17d98cdcd6096e100fa6c998a825"}
Jul 08 22:38:46.726559 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:46.726509    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 22:38:46.726929 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:46.726610    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 22:38:47.649573 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:47.649476    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt" event={"ID":"a17231a9-4e11-4899-9819-3723211c950d","Type":"ContainerStarted","Data":"1e320992a57770c23f950f49786e60d152fa2dc3986fe3671dec040485d90ba2"}
Jul 08 22:38:47.649749 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:47.649726    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:47.651438 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:47.651403    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-bcj2q" event={"ID":"1e614f8e-d451-4cee-b0c4-9cc14ace0b3e","Type":"ContainerStarted","Data":"663d78074c5a6068c813568e9c22d95b833fa8d5da631c61a1a1fc278d3980e6"}
Jul 08 22:38:47.651588 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:47.651521    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-bcj2q"
Jul 08 22:38:47.651588 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:47.651553    2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-m7ngt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 22:38:47.651703 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:47.651619    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt" podUID="a17231a9-4e11-4899-9819-3723211c950d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 22:38:47.653172 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:47.653151    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-w449w" event={"ID":"98bdbae2-2338-400f-823f-779dcd660cfc","Type":"ContainerStarted","Data":"29d14e2ce5916641b61263a3b924fb569871ffe21bd5f6ea8c20621d4905c689"}
Jul 08 22:38:47.653301 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:47.653276    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-w449w"
Jul 08 22:38:47.654625 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:47.654605    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d9656f865-vdgx4" event={"ID":"99a75cf9-46df-4253-8bac-84d6f5fc0d01","Type":"ContainerStarted","Data":"6d22e518350fb7f26ccdeb4f661b13ae017c64ea92551b3dae15f76325f7ea79"}
Jul 08 22:38:47.697928 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:47.696757    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt" podStartSLOduration=2.182430312 podStartE2EDuration="6.696736647s" totalImagesPullingTime="4.514306335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:38:47.674721654 +0000 UTC m=+531.451457044" watchObservedRunningTime="2026-07-08 22:38:47.696736647 +0000 UTC m=+531.473472036"
Jul 08 22:38:47.697928 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:47.697039    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-bcj2q" podStartSLOduration=1.97276005 podStartE2EDuration="6.697029464s" totalImagesPullingTime="4.724269414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:38:47.696388765 +0000 UTC m=+531.473124164" watchObservedRunningTime="2026-07-08 22:38:47.697029464 +0000 UTC m=+531.473764853"
Jul 08 22:38:47.748418 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:47.748347    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6d9656f865-vdgx4" podStartSLOduration=1.716034259 podStartE2EDuration="7.748326106s" totalImagesPullingTime="6.032291847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:38:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:38:47.721986896 +0000 UTC m=+531.498722285" watchObservedRunningTime="2026-07-08 22:38:47.748326106 +0000 UTC m=+531.525061497"
Jul 08 22:38:47.749355 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:47.749324    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-w449w" podStartSLOduration=2.07682485 podStartE2EDuration="7.749311197s" totalImagesPullingTime="5.672486347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:38:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:38:47.747556596 +0000 UTC m=+531.524291986" watchObservedRunningTime="2026-07-08 22:38:47.749311197 +0000 UTC m=+531.526046585"
Jul 08 22:38:48.658567 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:48.658539    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:51.554663 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:51.554629    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8ntpk"]
Jul 08 22:38:51.557710 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:51.557689    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ntpk"
Jul 08 22:38:51.560225 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:51.560206    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 08 22:38:51.560595 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:51.560578    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-v8bbv\""
Jul 08 22:38:51.573720 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:51.573695    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8ntpk"]
Jul 08 22:38:51.621964 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:51.621928    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a355972-0ee6-45d3-b141-17be2aba5527-cert\") pod \"kserve-controller-manager-d6f4b65b8-8ntpk\" (UID: \"9a355972-0ee6-45d3-b141-17be2aba5527\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ntpk"
Jul 08 22:38:51.621964 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:51.621962    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt8r5\" (UniqueName: \"kubernetes.io/projected/9a355972-0ee6-45d3-b141-17be2aba5527-kube-api-access-gt8r5\") pod \"kserve-controller-manager-d6f4b65b8-8ntpk\" (UID: \"9a355972-0ee6-45d3-b141-17be2aba5527\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ntpk"
Jul 08 22:38:51.723249 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:51.723213    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a355972-0ee6-45d3-b141-17be2aba5527-cert\") pod \"kserve-controller-manager-d6f4b65b8-8ntpk\" (UID: \"9a355972-0ee6-45d3-b141-17be2aba5527\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ntpk"
Jul 08 22:38:51.723249 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:51.723250    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt8r5\" (UniqueName: \"kubernetes.io/projected/9a355972-0ee6-45d3-b141-17be2aba5527-kube-api-access-gt8r5\") pod \"kserve-controller-manager-d6f4b65b8-8ntpk\" (UID: \"9a355972-0ee6-45d3-b141-17be2aba5527\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ntpk"
Jul 08 22:38:51.723450 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:38:51.723372    2558 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 08 22:38:51.723450 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:38:51.723433    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a355972-0ee6-45d3-b141-17be2aba5527-cert podName:9a355972-0ee6-45d3-b141-17be2aba5527 nodeName:}" failed. No retries permitted until 2026-07-08 22:38:52.223417687 +0000 UTC m=+536.000153053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9a355972-0ee6-45d3-b141-17be2aba5527-cert") pod "kserve-controller-manager-d6f4b65b8-8ntpk" (UID: "9a355972-0ee6-45d3-b141-17be2aba5527") : secret "kserve-webhook-server-cert" not found
Jul 08 22:38:51.731853 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:51.731829    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt8r5\" (UniqueName: \"kubernetes.io/projected/9a355972-0ee6-45d3-b141-17be2aba5527-kube-api-access-gt8r5\") pod \"kserve-controller-manager-d6f4b65b8-8ntpk\" (UID: \"9a355972-0ee6-45d3-b141-17be2aba5527\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ntpk"
Jul 08 22:38:52.226284 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:52.226246    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a355972-0ee6-45d3-b141-17be2aba5527-cert\") pod \"kserve-controller-manager-d6f4b65b8-8ntpk\" (UID: \"9a355972-0ee6-45d3-b141-17be2aba5527\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ntpk"
Jul 08 22:38:52.228831 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:52.228788    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a355972-0ee6-45d3-b141-17be2aba5527-cert\") pod \"kserve-controller-manager-d6f4b65b8-8ntpk\" (UID: \"9a355972-0ee6-45d3-b141-17be2aba5527\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ntpk"
Jul 08 22:38:52.468644 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:52.468593    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ntpk"
Jul 08 22:38:52.605472 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:52.605452    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8ntpk"]
Jul 08 22:38:52.607957 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:38:52.607931    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a355972_0ee6_45d3_b141_17be2aba5527.slice/crio-a56bc022ab9db750d13c0538fe0018842f64465943aa9e57899d08e527ea3f5f WatchSource:0}: Error finding container a56bc022ab9db750d13c0538fe0018842f64465943aa9e57899d08e527ea3f5f: Status 404 returned error can't find the container with id a56bc022ab9db750d13c0538fe0018842f64465943aa9e57899d08e527ea3f5f
Jul 08 22:38:52.675490 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:52.675444    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ntpk" event={"ID":"9a355972-0ee6-45d3-b141-17be2aba5527","Type":"ContainerStarted","Data":"a56bc022ab9db750d13c0538fe0018842f64465943aa9e57899d08e527ea3f5f"}
Jul 08 22:38:55.140946 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.140907    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"]
Jul 08 22:38:55.141374 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.141118    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt" podUID="a17231a9-4e11-4899-9819-3723211c950d" containerName="discovery" containerID="cri-o://1e320992a57770c23f950f49786e60d152fa2dc3986fe3671dec040485d90ba2" gracePeriod=30
Jul 08 22:38:55.385224 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.385200    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:55.454466 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.454383    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a17231a9-4e11-4899-9819-3723211c950d-istio-csr-dns-cert\") pod \"a17231a9-4e11-4899-9819-3723211c950d\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") "
Jul 08 22:38:55.454466 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.454457    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zctj\" (UniqueName: \"kubernetes.io/projected/a17231a9-4e11-4899-9819-3723211c950d-kube-api-access-2zctj\") pod \"a17231a9-4e11-4899-9819-3723211c950d\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") "
Jul 08 22:38:55.454678 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.454493    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a17231a9-4e11-4899-9819-3723211c950d-istio-csr-ca-configmap\") pod \"a17231a9-4e11-4899-9819-3723211c950d\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") "
Jul 08 22:38:55.454678 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.454519    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a17231a9-4e11-4899-9819-3723211c950d-local-certs\") pod \"a17231a9-4e11-4899-9819-3723211c950d\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") "
Jul 08 22:38:55.454678 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.454543    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a17231a9-4e11-4899-9819-3723211c950d-cacerts\") pod \"a17231a9-4e11-4899-9819-3723211c950d\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") "
Jul 08 22:38:55.454678 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.454576    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a17231a9-4e11-4899-9819-3723211c950d-istio-token\") pod \"a17231a9-4e11-4899-9819-3723211c950d\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") "
Jul 08 22:38:55.454678 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.454619    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a17231a9-4e11-4899-9819-3723211c950d-istio-kubeconfig\") pod \"a17231a9-4e11-4899-9819-3723211c950d\" (UID: \"a17231a9-4e11-4899-9819-3723211c950d\") "
Jul 08 22:38:55.454951 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.454922    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a17231a9-4e11-4899-9819-3723211c950d-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a17231a9-4e11-4899-9819-3723211c950d" (UID: "a17231a9-4e11-4899-9819-3723211c950d"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:38:55.457484 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.457452    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a17231a9-4e11-4899-9819-3723211c950d-local-certs" (OuterVolumeSpecName: "local-certs") pod "a17231a9-4e11-4899-9819-3723211c950d" (UID: "a17231a9-4e11-4899-9819-3723211c950d"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:38:55.457617 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.457497    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a17231a9-4e11-4899-9819-3723211c950d-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a17231a9-4e11-4899-9819-3723211c950d" (UID: "a17231a9-4e11-4899-9819-3723211c950d"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:38:55.457617 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.457513    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a17231a9-4e11-4899-9819-3723211c950d-istio-token" (OuterVolumeSpecName: "istio-token") pod "a17231a9-4e11-4899-9819-3723211c950d" (UID: "a17231a9-4e11-4899-9819-3723211c950d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:38:55.457617 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.457540    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a17231a9-4e11-4899-9819-3723211c950d-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a17231a9-4e11-4899-9819-3723211c950d" (UID: "a17231a9-4e11-4899-9819-3723211c950d"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:38:55.457786 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.457759    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a17231a9-4e11-4899-9819-3723211c950d-kube-api-access-2zctj" (OuterVolumeSpecName: "kube-api-access-2zctj") pod "a17231a9-4e11-4899-9819-3723211c950d" (UID: "a17231a9-4e11-4899-9819-3723211c950d"). InnerVolumeSpecName "kube-api-access-2zctj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:38:55.457928 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.457850    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a17231a9-4e11-4899-9819-3723211c950d-cacerts" (OuterVolumeSpecName: "cacerts") pod "a17231a9-4e11-4899-9819-3723211c950d" (UID: "a17231a9-4e11-4899-9819-3723211c950d"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:38:55.556061 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.556031    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zctj\" (UniqueName: \"kubernetes.io/projected/a17231a9-4e11-4899-9819-3723211c950d-kube-api-access-2zctj\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:38:55.556061 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.556058    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a17231a9-4e11-4899-9819-3723211c950d-istio-csr-ca-configmap\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:38:55.556061 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.556068    2558 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a17231a9-4e11-4899-9819-3723211c950d-local-certs\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:38:55.556285 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.556076    2558 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a17231a9-4e11-4899-9819-3723211c950d-cacerts\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:38:55.556285 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.556083    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a17231a9-4e11-4899-9819-3723211c950d-istio-token\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:38:55.556285 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.556091    2558 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a17231a9-4e11-4899-9819-3723211c950d-istio-kubeconfig\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:38:55.556285 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.556098    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a17231a9-4e11-4899-9819-3723211c950d-istio-csr-dns-cert\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:38:55.689447 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.689407    2558 generic.go:356] "Generic (PLEG): container finished" podID="a17231a9-4e11-4899-9819-3723211c950d" containerID="1e320992a57770c23f950f49786e60d152fa2dc3986fe3671dec040485d90ba2" exitCode=0
Jul 08 22:38:55.689627 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.689457    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"
Jul 08 22:38:55.689627 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.689481    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt" event={"ID":"a17231a9-4e11-4899-9819-3723211c950d","Type":"ContainerDied","Data":"1e320992a57770c23f950f49786e60d152fa2dc3986fe3671dec040485d90ba2"}
Jul 08 22:38:55.689627 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.689535    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt" event={"ID":"a17231a9-4e11-4899-9819-3723211c950d","Type":"ContainerDied","Data":"e251b0e8ccfe646328946cc04df1d3b22f1e17d98cdcd6096e100fa6c998a825"}
Jul 08 22:38:55.689627 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.689559    2558 scope.go:117] "RemoveContainer" containerID="1e320992a57770c23f950f49786e60d152fa2dc3986fe3671dec040485d90ba2"
Jul 08 22:38:55.712723 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.712653    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"]
Jul 08 22:38:55.726832 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:55.724629    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-m7ngt"]
Jul 08 22:38:56.092631 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:56.092610    2558 scope.go:117] "RemoveContainer" containerID="1e320992a57770c23f950f49786e60d152fa2dc3986fe3671dec040485d90ba2"
Jul 08 22:38:56.092976 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:38:56.092954    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e320992a57770c23f950f49786e60d152fa2dc3986fe3671dec040485d90ba2\": container with ID starting with 1e320992a57770c23f950f49786e60d152fa2dc3986fe3671dec040485d90ba2 not found: ID does not exist" containerID="1e320992a57770c23f950f49786e60d152fa2dc3986fe3671dec040485d90ba2"
Jul 08 22:38:56.093047 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:56.092985    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e320992a57770c23f950f49786e60d152fa2dc3986fe3671dec040485d90ba2"} err="failed to get container status \"1e320992a57770c23f950f49786e60d152fa2dc3986fe3671dec040485d90ba2\": rpc error: code = NotFound desc = could not find container \"1e320992a57770c23f950f49786e60d152fa2dc3986fe3671dec040485d90ba2\": container with ID starting with 1e320992a57770c23f950f49786e60d152fa2dc3986fe3671dec040485d90ba2 not found: ID does not exist"
Jul 08 22:38:56.694298 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:56.694254    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ntpk" event={"ID":"9a355972-0ee6-45d3-b141-17be2aba5527","Type":"ContainerStarted","Data":"069d8d585a5cc1cc30372fe6f847e34a475e4bb720769debcc5bcbd4addadda0"}
Jul 08 22:38:56.694753 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:56.694320    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ntpk"
Jul 08 22:38:56.725004 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:56.724956    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ntpk" podStartSLOduration=2.189792136 podStartE2EDuration="5.724941581s" totalImagesPullingTime="3.535149445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:38:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:38:56.724302624 +0000 UTC m=+540.501038012" watchObservedRunningTime="2026-07-08 22:38:56.724941581 +0000 UTC m=+540.501676969"
Jul 08 22:38:56.771264 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:56.771235    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a17231a9-4e11-4899-9819-3723211c950d" path="/var/lib/kubelet/pods/a17231a9-4e11-4899-9819-3723211c950d/volumes"
Jul 08 22:38:58.659926 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:58.659898    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-w449w"
Jul 08 22:38:58.661599 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:38:58.661579    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-bcj2q"
Jul 08 22:39:27.705045 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:27.705017    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8ntpk"
Jul 08 22:39:41.294625 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:41.294589    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4l4xn"]
Jul 08 22:39:41.295019 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:41.294887    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a17231a9-4e11-4899-9819-3723211c950d" containerName="discovery"
Jul 08 22:39:41.295019 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:41.294899    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a17231a9-4e11-4899-9819-3723211c950d" containerName="discovery"
Jul 08 22:39:41.295019 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:41.294954    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a17231a9-4e11-4899-9819-3723211c950d" containerName="discovery"
Jul 08 22:39:41.300138 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:41.300121    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4l4xn"
Jul 08 22:39:41.302922 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:41.302900    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 22:39:41.303643 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:41.303625    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 22:39:41.303643 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:41.303632    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-7qh92\""
Jul 08 22:39:41.312308 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:41.312287    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4l4xn"]
Jul 08 22:39:41.407088 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:41.407047    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx8jq\" (UniqueName: \"kubernetes.io/projected/079e3d77-2ff5-4649-b3dd-23a90b20ca5c-kube-api-access-jx8jq\") pod \"kuadrant-operator-catalog-4l4xn\" (UID: \"079e3d77-2ff5-4649-b3dd-23a90b20ca5c\") " pod="kuadrant-system/kuadrant-operator-catalog-4l4xn"
Jul 08 22:39:41.508094 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:41.508062    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx8jq\" (UniqueName: \"kubernetes.io/projected/079e3d77-2ff5-4649-b3dd-23a90b20ca5c-kube-api-access-jx8jq\") pod \"kuadrant-operator-catalog-4l4xn\" (UID: \"079e3d77-2ff5-4649-b3dd-23a90b20ca5c\") " pod="kuadrant-system/kuadrant-operator-catalog-4l4xn"
Jul 08 22:39:41.523455 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:41.523419    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx8jq\" (UniqueName: \"kubernetes.io/projected/079e3d77-2ff5-4649-b3dd-23a90b20ca5c-kube-api-access-jx8jq\") pod \"kuadrant-operator-catalog-4l4xn\" (UID: \"079e3d77-2ff5-4649-b3dd-23a90b20ca5c\") " pod="kuadrant-system/kuadrant-operator-catalog-4l4xn"
Jul 08 22:39:41.609909 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:41.609873    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4l4xn"
Jul 08 22:39:41.665437 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:41.665403    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4l4xn"]
Jul 08 22:39:41.737132 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:41.737108    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4l4xn"]
Jul 08 22:39:41.739701 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:39:41.739673    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod079e3d77_2ff5_4649_b3dd_23a90b20ca5c.slice/crio-d027ec729196f3391a6c1844e7c038b17fb3368e4643b8fdb07b1330df6b250f WatchSource:0}: Error finding container d027ec729196f3391a6c1844e7c038b17fb3368e4643b8fdb07b1330df6b250f: Status 404 returned error can't find the container with id d027ec729196f3391a6c1844e7c038b17fb3368e4643b8fdb07b1330df6b250f
Jul 08 22:39:41.857272 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:41.857234    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4l4xn" event={"ID":"079e3d77-2ff5-4649-b3dd-23a90b20ca5c","Type":"ContainerStarted","Data":"d027ec729196f3391a6c1844e7c038b17fb3368e4643b8fdb07b1330df6b250f"}
Jul 08 22:39:41.875628 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:41.875548    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m8mcw"]
Jul 08 22:39:41.880401 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:41.880381    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m8mcw"
Jul 08 22:39:41.886767 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:41.886742    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m8mcw"]
Jul 08 22:39:41.911691 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:41.911661    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7xpz\" (UniqueName: \"kubernetes.io/projected/0ca97ee4-84ba-4027-ac4f-91f1b4d4ecd1-kube-api-access-h7xpz\") pod \"kuadrant-operator-catalog-m8mcw\" (UID: \"0ca97ee4-84ba-4027-ac4f-91f1b4d4ecd1\") " pod="kuadrant-system/kuadrant-operator-catalog-m8mcw"
Jul 08 22:39:42.012338 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:42.012307    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7xpz\" (UniqueName: \"kubernetes.io/projected/0ca97ee4-84ba-4027-ac4f-91f1b4d4ecd1-kube-api-access-h7xpz\") pod \"kuadrant-operator-catalog-m8mcw\" (UID: \"0ca97ee4-84ba-4027-ac4f-91f1b4d4ecd1\") " pod="kuadrant-system/kuadrant-operator-catalog-m8mcw"
Jul 08 22:39:42.021288 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:42.021259    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7xpz\" (UniqueName: \"kubernetes.io/projected/0ca97ee4-84ba-4027-ac4f-91f1b4d4ecd1-kube-api-access-h7xpz\") pod \"kuadrant-operator-catalog-m8mcw\" (UID: \"0ca97ee4-84ba-4027-ac4f-91f1b4d4ecd1\") " pod="kuadrant-system/kuadrant-operator-catalog-m8mcw"
Jul 08 22:39:42.189875 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:42.189770    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m8mcw"
Jul 08 22:39:42.321998 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:42.321973    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m8mcw"]
Jul 08 22:39:42.324072 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:39:42.324043    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ca97ee4_84ba_4027_ac4f_91f1b4d4ecd1.slice/crio-3af0ae9985edfae444fa0093f18cc089a26f96d4253653d91d027a4ec9cc5241 WatchSource:0}: Error finding container 3af0ae9985edfae444fa0093f18cc089a26f96d4253653d91d027a4ec9cc5241: Status 404 returned error can't find the container with id 3af0ae9985edfae444fa0093f18cc089a26f96d4253653d91d027a4ec9cc5241
Jul 08 22:39:42.865472 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:42.865391    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m8mcw" event={"ID":"0ca97ee4-84ba-4027-ac4f-91f1b4d4ecd1","Type":"ContainerStarted","Data":"3af0ae9985edfae444fa0093f18cc089a26f96d4253653d91d027a4ec9cc5241"}
Jul 08 22:39:44.875361 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:44.875320    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4l4xn" event={"ID":"079e3d77-2ff5-4649-b3dd-23a90b20ca5c","Type":"ContainerStarted","Data":"17da8617254dc01cf910e07440ace972713294ae23b8b5772ddadca1392e61a4"}
Jul 08 22:39:44.875843 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:44.875394    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-4l4xn" podUID="079e3d77-2ff5-4649-b3dd-23a90b20ca5c" containerName="registry-server" containerID="cri-o://17da8617254dc01cf910e07440ace972713294ae23b8b5772ddadca1392e61a4" gracePeriod=2
Jul 08 22:39:44.876920 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:44.876889    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m8mcw" event={"ID":"0ca97ee4-84ba-4027-ac4f-91f1b4d4ecd1","Type":"ContainerStarted","Data":"5f6777129e1406a68cf1ccea0d641e95dfe4cd5be4e8d3db8409d2c6cbdd97ec"}
Jul 08 22:39:44.890384 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:44.890346    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4l4xn" podStartSLOduration=1.582455501 podStartE2EDuration="3.890332561s" totalImagesPullingTime="2.30787706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:39:44.889760487 +0000 UTC m=+588.666495873" watchObservedRunningTime="2026-07-08 22:39:44.890332561 +0000 UTC m=+588.667067963"
Jul 08 22:39:44.905238 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:44.905188    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-m8mcw" podStartSLOduration=2.162435727 podStartE2EDuration="3.905171689s" totalImagesPullingTime="1.742735962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:39:44.904906498 +0000 UTC m=+588.681641887" watchObservedRunningTime="2026-07-08 22:39:44.905171689 +0000 UTC m=+588.681907075"
Jul 08 22:39:45.118678 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:45.118658    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4l4xn"
Jul 08 22:39:45.241242 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:45.241179    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jx8jq\" (UniqueName: \"kubernetes.io/projected/079e3d77-2ff5-4649-b3dd-23a90b20ca5c-kube-api-access-jx8jq\") pod \"079e3d77-2ff5-4649-b3dd-23a90b20ca5c\" (UID: \"079e3d77-2ff5-4649-b3dd-23a90b20ca5c\") "
Jul 08 22:39:45.243358 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:45.243333    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/079e3d77-2ff5-4649-b3dd-23a90b20ca5c-kube-api-access-jx8jq" (OuterVolumeSpecName: "kube-api-access-jx8jq") pod "079e3d77-2ff5-4649-b3dd-23a90b20ca5c" (UID: "079e3d77-2ff5-4649-b3dd-23a90b20ca5c"). InnerVolumeSpecName "kube-api-access-jx8jq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:39:45.342469 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:45.342436    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jx8jq\" (UniqueName: \"kubernetes.io/projected/079e3d77-2ff5-4649-b3dd-23a90b20ca5c-kube-api-access-jx8jq\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:39:45.886522 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:45.886485    2558 generic.go:356] "Generic (PLEG): container finished" podID="079e3d77-2ff5-4649-b3dd-23a90b20ca5c" containerID="17da8617254dc01cf910e07440ace972713294ae23b8b5772ddadca1392e61a4" exitCode=0
Jul 08 22:39:45.886999 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:45.886538    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4l4xn"
Jul 08 22:39:45.886999 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:45.886570    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4l4xn" event={"ID":"079e3d77-2ff5-4649-b3dd-23a90b20ca5c","Type":"ContainerDied","Data":"17da8617254dc01cf910e07440ace972713294ae23b8b5772ddadca1392e61a4"}
Jul 08 22:39:45.886999 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:45.886654    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4l4xn" event={"ID":"079e3d77-2ff5-4649-b3dd-23a90b20ca5c","Type":"ContainerDied","Data":"d027ec729196f3391a6c1844e7c038b17fb3368e4643b8fdb07b1330df6b250f"}
Jul 08 22:39:45.886999 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:45.886685    2558 scope.go:117] "RemoveContainer" containerID="17da8617254dc01cf910e07440ace972713294ae23b8b5772ddadca1392e61a4"
Jul 08 22:39:45.896439 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:45.896426    2558 scope.go:117] "RemoveContainer" containerID="17da8617254dc01cf910e07440ace972713294ae23b8b5772ddadca1392e61a4"
Jul 08 22:39:45.896663 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:39:45.896646    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17da8617254dc01cf910e07440ace972713294ae23b8b5772ddadca1392e61a4\": container with ID starting with 17da8617254dc01cf910e07440ace972713294ae23b8b5772ddadca1392e61a4 not found: ID does not exist" containerID="17da8617254dc01cf910e07440ace972713294ae23b8b5772ddadca1392e61a4"
Jul 08 22:39:45.896704 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:45.896671    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17da8617254dc01cf910e07440ace972713294ae23b8b5772ddadca1392e61a4"} err="failed to get container status \"17da8617254dc01cf910e07440ace972713294ae23b8b5772ddadca1392e61a4\": rpc error: code = NotFound desc = could not find container \"17da8617254dc01cf910e07440ace972713294ae23b8b5772ddadca1392e61a4\": container with ID starting with 17da8617254dc01cf910e07440ace972713294ae23b8b5772ddadca1392e61a4 not found: ID does not exist"
Jul 08 22:39:45.907601 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:45.907576    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4l4xn"]
Jul 08 22:39:45.913487 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:45.913469    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4l4xn"]
Jul 08 22:39:46.772544 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:46.772510    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="079e3d77-2ff5-4649-b3dd-23a90b20ca5c" path="/var/lib/kubelet/pods/079e3d77-2ff5-4649-b3dd-23a90b20ca5c/volumes"
Jul 08 22:39:52.190918 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:52.190883    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-m8mcw"
Jul 08 22:39:52.191325 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:52.190972    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-m8mcw"
Jul 08 22:39:52.213187 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:52.213160    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-m8mcw"
Jul 08 22:39:52.938069 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:39:52.938043    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-m8mcw"
Jul 08 22:40:14.968699 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:14.968665    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"]
Jul 08 22:40:14.971227 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:14.968948    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="079e3d77-2ff5-4649-b3dd-23a90b20ca5c" containerName="registry-server"
Jul 08 22:40:14.971227 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:14.968960    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="079e3d77-2ff5-4649-b3dd-23a90b20ca5c" containerName="registry-server"
Jul 08 22:40:14.971227 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:14.969025    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="079e3d77-2ff5-4649-b3dd-23a90b20ca5c" containerName="registry-server"
Jul 08 22:40:14.972034 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:14.972018    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:14.975265 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:14.975243    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5lldk\""
Jul 08 22:40:14.984288 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:14.984270    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"]
Jul 08 22:40:15.088095 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:15.088053    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/623649d0-0859-4bca-b9b7-d87680964f6b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nbks5\" (UID: \"623649d0-0859-4bca-b9b7-d87680964f6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:15.088269 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:15.088171    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkrn8\" (UniqueName: \"kubernetes.io/projected/623649d0-0859-4bca-b9b7-d87680964f6b-kube-api-access-mkrn8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nbks5\" (UID: \"623649d0-0859-4bca-b9b7-d87680964f6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:15.188983 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:15.188948    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkrn8\" (UniqueName: \"kubernetes.io/projected/623649d0-0859-4bca-b9b7-d87680964f6b-kube-api-access-mkrn8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nbks5\" (UID: \"623649d0-0859-4bca-b9b7-d87680964f6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:15.189143 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:15.189007    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/623649d0-0859-4bca-b9b7-d87680964f6b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nbks5\" (UID: \"623649d0-0859-4bca-b9b7-d87680964f6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:15.189401 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:15.189383    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/623649d0-0859-4bca-b9b7-d87680964f6b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nbks5\" (UID: \"623649d0-0859-4bca-b9b7-d87680964f6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:15.201513 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:15.201482    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkrn8\" (UniqueName: \"kubernetes.io/projected/623649d0-0859-4bca-b9b7-d87680964f6b-kube-api-access-mkrn8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nbks5\" (UID: \"623649d0-0859-4bca-b9b7-d87680964f6b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:15.282594 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:15.282515    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:15.417083 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:15.417050    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"]
Jul 08 22:40:15.420154 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:40:15.420128    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod623649d0_0859_4bca_b9b7_d87680964f6b.slice/crio-d1a9dc9b33690af5d2068b75ed89bd6714f2d79900c487819e9e56beecdf4387 WatchSource:0}: Error finding container d1a9dc9b33690af5d2068b75ed89bd6714f2d79900c487819e9e56beecdf4387: Status 404 returned error can't find the container with id d1a9dc9b33690af5d2068b75ed89bd6714f2d79900c487819e9e56beecdf4387
Jul 08 22:40:15.422460 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:15.422445    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 22:40:16.003186 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:16.003139    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5" event={"ID":"623649d0-0859-4bca-b9b7-d87680964f6b","Type":"ContainerStarted","Data":"d1a9dc9b33690af5d2068b75ed89bd6714f2d79900c487819e9e56beecdf4387"}
Jul 08 22:40:17.029606 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:17.029574    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"]
Jul 08 22:40:17.032612 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:17.032596    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"
Jul 08 22:40:17.035369 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:17.035343    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-chtgj\""
Jul 08 22:40:17.043709 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:17.043688    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"]
Jul 08 22:40:17.204353 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:17.204320    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nch6\" (UniqueName: \"kubernetes.io/projected/d4627a94-2bd6-486c-a0d2-3d9d9685f3b3-kube-api-access-9nch6\") pod \"limitador-operator-controller-manager-859d7b78bd-fkg7n\" (UID: \"d4627a94-2bd6-486c-a0d2-3d9d9685f3b3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"
Jul 08 22:40:17.304792 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:17.304760    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nch6\" (UniqueName: \"kubernetes.io/projected/d4627a94-2bd6-486c-a0d2-3d9d9685f3b3-kube-api-access-9nch6\") pod \"limitador-operator-controller-manager-859d7b78bd-fkg7n\" (UID: \"d4627a94-2bd6-486c-a0d2-3d9d9685f3b3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"
Jul 08 22:40:17.318328 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:17.318303    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nch6\" (UniqueName: \"kubernetes.io/projected/d4627a94-2bd6-486c-a0d2-3d9d9685f3b3-kube-api-access-9nch6\") pod \"limitador-operator-controller-manager-859d7b78bd-fkg7n\" (UID: \"d4627a94-2bd6-486c-a0d2-3d9d9685f3b3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"
Jul 08 22:40:17.344017 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:17.343980    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"
Jul 08 22:40:17.497474 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:17.497439    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"]
Jul 08 22:40:17.500627 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:40:17.500601    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4627a94_2bd6_486c_a0d2_3d9d9685f3b3.slice/crio-bd3c02c600923b656d2a8af8b84b150851235f5c0f26fc6bc68f956ca20305f7 WatchSource:0}: Error finding container bd3c02c600923b656d2a8af8b84b150851235f5c0f26fc6bc68f956ca20305f7: Status 404 returned error can't find the container with id bd3c02c600923b656d2a8af8b84b150851235f5c0f26fc6bc68f956ca20305f7
Jul 08 22:40:18.012558 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:18.012521    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n" event={"ID":"d4627a94-2bd6-486c-a0d2-3d9d9685f3b3","Type":"ContainerStarted","Data":"bd3c02c600923b656d2a8af8b84b150851235f5c0f26fc6bc68f956ca20305f7"}
Jul 08 22:40:19.640394 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:19.638334    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6xlvg"]
Jul 08 22:40:19.643016 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:19.642990    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6xlvg"
Jul 08 22:40:19.645856 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:19.645831    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 08 22:40:19.646033 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:19.646016    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6vwcr\""
Jul 08 22:40:19.656608 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:19.656541    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6xlvg"]
Jul 08 22:40:19.828710 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:19.828680    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt7dn\" (UniqueName: \"kubernetes.io/projected/4d5a10ab-355c-4a59-8c39-59cd08eb23b2-kube-api-access-rt7dn\") pod \"dns-operator-controller-manager-864dd78c4c-6xlvg\" (UID: \"4d5a10ab-355c-4a59-8c39-59cd08eb23b2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6xlvg"
Jul 08 22:40:19.929718 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:19.929668    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt7dn\" (UniqueName: \"kubernetes.io/projected/4d5a10ab-355c-4a59-8c39-59cd08eb23b2-kube-api-access-rt7dn\") pod \"dns-operator-controller-manager-864dd78c4c-6xlvg\" (UID: \"4d5a10ab-355c-4a59-8c39-59cd08eb23b2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6xlvg"
Jul 08 22:40:19.939571 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:19.939532    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt7dn\" (UniqueName: \"kubernetes.io/projected/4d5a10ab-355c-4a59-8c39-59cd08eb23b2-kube-api-access-rt7dn\") pod \"dns-operator-controller-manager-864dd78c4c-6xlvg\" (UID: \"4d5a10ab-355c-4a59-8c39-59cd08eb23b2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6xlvg"
Jul 08 22:40:19.954183 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:19.954156    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6xlvg"
Jul 08 22:40:20.024248 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:20.024208    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n" event={"ID":"d4627a94-2bd6-486c-a0d2-3d9d9685f3b3","Type":"ContainerStarted","Data":"672ccb82692e96ceff7e227666d115a39e43c4a548b5c17c62932331527d17c8"}
Jul 08 22:40:20.024428 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:20.024357    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"
Jul 08 22:40:20.045043 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:20.044998    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n" podStartSLOduration=1.036965589 podStartE2EDuration="3.044980556s" totalImagesPullingTime="2.008014967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:40:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:40:20.042585851 +0000 UTC m=+623.819321242" watchObservedRunningTime="2026-07-08 22:40:20.044980556 +0000 UTC m=+623.821715946"
Jul 08 22:40:20.981360 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:20.981331    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6xlvg"]
Jul 08 22:40:20.983638 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:40:20.983610    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d5a10ab_355c_4a59_8c39_59cd08eb23b2.slice/crio-18bef55e12a26c862baef5f3cb907a9d20560c7357daeac8a6bf94d6ea51553d WatchSource:0}: Error finding container 18bef55e12a26c862baef5f3cb907a9d20560c7357daeac8a6bf94d6ea51553d: Status 404 returned error can't find the container with id 18bef55e12a26c862baef5f3cb907a9d20560c7357daeac8a6bf94d6ea51553d
Jul 08 22:40:21.029537 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:21.029501    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6xlvg" event={"ID":"4d5a10ab-355c-4a59-8c39-59cd08eb23b2","Type":"ContainerStarted","Data":"18bef55e12a26c862baef5f3cb907a9d20560c7357daeac8a6bf94d6ea51553d"}
Jul 08 22:40:21.031044 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:21.031018    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5" event={"ID":"623649d0-0859-4bca-b9b7-d87680964f6b","Type":"ContainerStarted","Data":"e758ff4de7a720f86d72b298f0adaf03805fee9862556c326a9f3d50c23dc7ea"}
Jul 08 22:40:21.053003 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:21.052950    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5" podStartSLOduration=1.554022637 podStartE2EDuration="7.052935283s" totalImagesPullingTime="5.498912646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:40:21.051165629 +0000 UTC m=+624.827901018" watchObservedRunningTime="2026-07-08 22:40:21.052935283 +0000 UTC m=+624.829670670"
Jul 08 22:40:22.035532 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:22.035508    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:23.137984 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:23.137950    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kzk4q"]
Jul 08 22:40:23.141272 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:23.141253    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kzk4q"
Jul 08 22:40:23.144245 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:23.144227    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-td72x\""
Jul 08 22:40:23.152036 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:23.152008    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kzk4q"]
Jul 08 22:40:23.156350 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:23.156325    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-426hg\" (UniqueName: \"kubernetes.io/projected/b387d5d9-9a5c-4202-a843-be797192bb69-kube-api-access-426hg\") pod \"authorino-operator-75cc8d5cb7-kzk4q\" (UID: \"b387d5d9-9a5c-4202-a843-be797192bb69\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kzk4q"
Jul 08 22:40:23.257037 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:23.257000    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-426hg\" (UniqueName: \"kubernetes.io/projected/b387d5d9-9a5c-4202-a843-be797192bb69-kube-api-access-426hg\") pod \"authorino-operator-75cc8d5cb7-kzk4q\" (UID: \"b387d5d9-9a5c-4202-a843-be797192bb69\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kzk4q"
Jul 08 22:40:23.269414 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:23.269386    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-426hg\" (UniqueName: \"kubernetes.io/projected/b387d5d9-9a5c-4202-a843-be797192bb69-kube-api-access-426hg\") pod \"authorino-operator-75cc8d5cb7-kzk4q\" (UID: \"b387d5d9-9a5c-4202-a843-be797192bb69\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kzk4q"
Jul 08 22:40:23.452549 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:23.452465    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kzk4q"
Jul 08 22:40:23.590051 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:23.590031    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kzk4q"]
Jul 08 22:40:23.592343 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:40:23.592315    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb387d5d9_9a5c_4202_a843_be797192bb69.slice/crio-87223abe71a43629db837b51052c641399dc7d08b42404c013d3aaf058712748 WatchSource:0}: Error finding container 87223abe71a43629db837b51052c641399dc7d08b42404c013d3aaf058712748: Status 404 returned error can't find the container with id 87223abe71a43629db837b51052c641399dc7d08b42404c013d3aaf058712748
Jul 08 22:40:23.874915 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:23.874882    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4rx8g"]
Jul 08 22:40:23.878044 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:23.878029    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4rx8g"
Jul 08 22:40:23.880363 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:23.880342    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 08 22:40:23.880522 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:23.880506    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rpbmg\""
Jul 08 22:40:23.880582 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:23.880544    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 08 22:40:23.884992 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:23.884961    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4rx8g"]
Jul 08 22:40:23.962914 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:23.962880    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f477de4-3333-4314-abbc-0a263e72d1cd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4rx8g\" (UID: \"4f477de4-3333-4314-abbc-0a263e72d1cd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4rx8g"
Jul 08 22:40:23.962914 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:23.962916    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvgcm\" (UniqueName: \"kubernetes.io/projected/4f477de4-3333-4314-abbc-0a263e72d1cd-kube-api-access-bvgcm\") pod \"kuadrant-console-plugin-66b5774985-4rx8g\" (UID: \"4f477de4-3333-4314-abbc-0a263e72d1cd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4rx8g"
Jul 08 22:40:23.963148 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:23.963019    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4f477de4-3333-4314-abbc-0a263e72d1cd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4rx8g\" (UID: \"4f477de4-3333-4314-abbc-0a263e72d1cd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4rx8g"
Jul 08 22:40:24.046116 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:24.046073    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6xlvg" event={"ID":"4d5a10ab-355c-4a59-8c39-59cd08eb23b2","Type":"ContainerStarted","Data":"0ced2305cd6b96b21b341f7d704c75eb07903e0043bf044a67229afe8f560e31"}
Jul 08 22:40:24.046304 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:24.046147    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6xlvg"
Jul 08 22:40:24.047257 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:24.047236    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kzk4q" event={"ID":"b387d5d9-9a5c-4202-a843-be797192bb69","Type":"ContainerStarted","Data":"87223abe71a43629db837b51052c641399dc7d08b42404c013d3aaf058712748"}
Jul 08 22:40:24.063571 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:24.063545    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4f477de4-3333-4314-abbc-0a263e72d1cd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4rx8g\" (UID: \"4f477de4-3333-4314-abbc-0a263e72d1cd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4rx8g"
Jul 08 22:40:24.063678 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:24.063585    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f477de4-3333-4314-abbc-0a263e72d1cd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4rx8g\" (UID: \"4f477de4-3333-4314-abbc-0a263e72d1cd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4rx8g"
Jul 08 22:40:24.063678 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:24.063613    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvgcm\" (UniqueName: \"kubernetes.io/projected/4f477de4-3333-4314-abbc-0a263e72d1cd-kube-api-access-bvgcm\") pod \"kuadrant-console-plugin-66b5774985-4rx8g\" (UID: \"4f477de4-3333-4314-abbc-0a263e72d1cd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4rx8g"
Jul 08 22:40:24.064501 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:24.064480    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4f477de4-3333-4314-abbc-0a263e72d1cd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4rx8g\" (UID: \"4f477de4-3333-4314-abbc-0a263e72d1cd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4rx8g"
Jul 08 22:40:24.064748 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:24.064699    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6xlvg" podStartSLOduration=2.530864763 podStartE2EDuration="5.064686924s" totalImagesPullingTime="2.533822161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:40:24.064401749 +0000 UTC m=+627.841137137" watchObservedRunningTime="2026-07-08 22:40:24.064686924 +0000 UTC m=+627.841422313"
Jul 08 22:40:24.066383 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:24.066363    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f477de4-3333-4314-abbc-0a263e72d1cd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4rx8g\" (UID: \"4f477de4-3333-4314-abbc-0a263e72d1cd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4rx8g"
Jul 08 22:40:24.078083 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:24.078060    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvgcm\" (UniqueName: \"kubernetes.io/projected/4f477de4-3333-4314-abbc-0a263e72d1cd-kube-api-access-bvgcm\") pod \"kuadrant-console-plugin-66b5774985-4rx8g\" (UID: \"4f477de4-3333-4314-abbc-0a263e72d1cd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4rx8g"
Jul 08 22:40:24.187993 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:24.187904    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4rx8g"
Jul 08 22:40:24.325482 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:24.325448    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4rx8g"]
Jul 08 22:40:24.328271 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:40:24.328245    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f477de4_3333_4314_abbc_0a263e72d1cd.slice/crio-d8eca5b9e441356668e3a906fa9e8c22c772f9dba4bcff6c74c938510c8a1f2e WatchSource:0}: Error finding container d8eca5b9e441356668e3a906fa9e8c22c772f9dba4bcff6c74c938510c8a1f2e: Status 404 returned error can't find the container with id d8eca5b9e441356668e3a906fa9e8c22c772f9dba4bcff6c74c938510c8a1f2e
Jul 08 22:40:25.053939 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:25.053904    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4rx8g" event={"ID":"4f477de4-3333-4314-abbc-0a263e72d1cd","Type":"ContainerStarted","Data":"d8eca5b9e441356668e3a906fa9e8c22c772f9dba4bcff6c74c938510c8a1f2e"}
Jul 08 22:40:26.060319 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:26.060293    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kzk4q" event={"ID":"b387d5d9-9a5c-4202-a843-be797192bb69","Type":"ContainerStarted","Data":"13d2b9c4132221d954c598da216e36f5e502ed049749c8a9ef30c4751d644605"}
Jul 08 22:40:26.060719 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:26.060357    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kzk4q"
Jul 08 22:40:26.078616 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:26.078572    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kzk4q" podStartSLOduration=0.792904729 podStartE2EDuration="3.078557079s" totalImagesPullingTime="2.28565235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:40:26.07744958 +0000 UTC m=+629.854184981" watchObservedRunningTime="2026-07-08 22:40:26.078557079 +0000 UTC m=+629.855292466"
Jul 08 22:40:31.033564 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:31.033535    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"
Jul 08 22:40:33.042411 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:33.042375    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:34.773975 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.773944    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgm9b"]
Jul 08 22:40:34.784482 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.784454    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"]
Jul 08 22:40:34.784700 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.784649    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5" podUID="623649d0-0859-4bca-b9b7-d87680964f6b" containerName="manager" containerID="cri-o://e758ff4de7a720f86d72b298f0adaf03805fee9862556c326a9f3d50c23dc7ea" gracePeriod=2
Jul 08 22:40:34.784846 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.784826    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgm9b"
Jul 08 22:40:34.787425 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:34.787390    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nbks5\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="623649d0-0859-4bca-b9b7-d87680964f6b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:34.789164 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.788834    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"]
Jul 08 22:40:34.790872 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:34.789391    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nbks5\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="623649d0-0859-4bca-b9b7-d87680964f6b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:34.790872 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.790775    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgm9b"]
Jul 08 22:40:34.801579 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.801554    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt"]
Jul 08 22:40:34.802300 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.802171    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="623649d0-0859-4bca-b9b7-d87680964f6b" containerName="manager"
Jul 08 22:40:34.802392 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.802379    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="623649d0-0859-4bca-b9b7-d87680964f6b" containerName="manager"
Jul 08 22:40:34.802592 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.802579    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="623649d0-0859-4bca-b9b7-d87680964f6b" containerName="manager"
Jul 08 22:40:34.806966 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.806937    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgm9b"]
Jul 08 22:40:34.807307 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.807153    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt"
Jul 08 22:40:34.809170 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:34.809122    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-ffhvj], unattached volumes=[], failed to process volumes=[extensions-socket-volume kube-api-access-ffhvj]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgm9b" podUID="86c0842a-7330-4da3-8ea7-f8c263b0d14f"
Jul 08 22:40:34.810371 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.810351    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgm9b"]
Jul 08 22:40:34.811017 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:34.810947    2558 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"86c0842a-7330-4da3-8ea7-f8c263b0d14f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-08T22:40:34Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-08T22:40:34Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-08T22:40:34Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-07-08T22:40:34Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/kuadrant/kuadrant-operator:v1.4.2\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/kuadrant\\\",\\\"name\\\":\\\"extensions-socket-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-ffhvj\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.136.6\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.136.6\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-07-08T22:40:34Z\\\"}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-86878c769f-lgm9b\": pods \"kuadrant-operator-controller-manager-86878c769f-lgm9b\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgm9b"
Jul 08 22:40:34.817594 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.817573    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt"]
Jul 08 22:40:34.825980 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.825956    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"]
Jul 08 22:40:34.826314 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.826285    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n" podUID="d4627a94-2bd6-486c-a0d2-3d9d9685f3b3" containerName="manager" containerID="cri-o://672ccb82692e96ceff7e227666d115a39e43c4a548b5c17c62932331527d17c8" gracePeriod=2
Jul 08 22:40:34.829974 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.829922    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"]
Jul 08 22:40:34.837746 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:34.837718    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nbks5\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="623649d0-0859-4bca-b9b7-d87680964f6b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:34.841598 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:34.841561    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-lgm9b\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="86c0842a-7330-4da3-8ea7-f8c263b0d14f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgm9b"
Jul 08 22:40:34.842178 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.842154    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528"]
Jul 08 22:40:34.844171 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:34.844003    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nbks5\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="623649d0-0859-4bca-b9b7-d87680964f6b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:34.847254 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.845080    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4627a94-2bd6-486c-a0d2-3d9d9685f3b3" containerName="manager"
Jul 08 22:40:34.847254 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.845103    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4627a94-2bd6-486c-a0d2-3d9d9685f3b3" containerName="manager"
Jul 08 22:40:34.847254 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.845457    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4627a94-2bd6-486c-a0d2-3d9d9685f3b3" containerName="manager"
Jul 08 22:40:34.847254 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:34.846159    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fkg7n\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="d4627a94-2bd6-486c-a0d2-3d9d9685f3b3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"
Jul 08 22:40:34.848098 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:34.848048    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-lgm9b\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="86c0842a-7330-4da3-8ea7-f8c263b0d14f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgm9b"
Jul 08 22:40:34.849084 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.849063    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528"
Jul 08 22:40:34.851766 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:34.851377    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fkg7n\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="d4627a94-2bd6-486c-a0d2-3d9d9685f3b3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"
Jul 08 22:40:34.855369 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:34.855326    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-lgm9b\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="86c0842a-7330-4da3-8ea7-f8c263b0d14f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgm9b"
Jul 08 22:40:34.863952 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.863930    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/705a5856-784d-4cbe-b117-b7fcf6e2333f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dmgdt\" (UID: \"705a5856-784d-4cbe-b117-b7fcf6e2333f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt"
Jul 08 22:40:34.864148 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.864120    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wphmm\" (UniqueName: \"kubernetes.io/projected/705a5856-784d-4cbe-b117-b7fcf6e2333f-kube-api-access-wphmm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dmgdt\" (UID: \"705a5856-784d-4cbe-b117-b7fcf6e2333f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt"
Jul 08 22:40:34.866198 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.866174    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528"]
Jul 08 22:40:34.883982 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:34.883936    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nbks5\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="623649d0-0859-4bca-b9b7-d87680964f6b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:34.965738 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.965700    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94f78b47-394e-4ab8-93ab-e092a1240f56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cm528\" (UID: \"94f78b47-394e-4ab8-93ab-e092a1240f56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528"
Jul 08 22:40:34.965949 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.965747    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p6jh\" (UniqueName: \"kubernetes.io/projected/94f78b47-394e-4ab8-93ab-e092a1240f56-kube-api-access-9p6jh\") pod \"kuadrant-operator-controller-manager-86878c769f-cm528\" (UID: \"94f78b47-394e-4ab8-93ab-e092a1240f56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528"
Jul 08 22:40:34.965949 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.965784    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/705a5856-784d-4cbe-b117-b7fcf6e2333f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dmgdt\" (UID: \"705a5856-784d-4cbe-b117-b7fcf6e2333f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt"
Jul 08 22:40:34.965949 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.965845    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wphmm\" (UniqueName: \"kubernetes.io/projected/705a5856-784d-4cbe-b117-b7fcf6e2333f-kube-api-access-wphmm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dmgdt\" (UID: \"705a5856-784d-4cbe-b117-b7fcf6e2333f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt"
Jul 08 22:40:34.966162 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.966141    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/705a5856-784d-4cbe-b117-b7fcf6e2333f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dmgdt\" (UID: \"705a5856-784d-4cbe-b117-b7fcf6e2333f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt"
Jul 08 22:40:34.975341 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:34.975310    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wphmm\" (UniqueName: \"kubernetes.io/projected/705a5856-784d-4cbe-b117-b7fcf6e2333f-kube-api-access-wphmm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dmgdt\" (UID: \"705a5856-784d-4cbe-b117-b7fcf6e2333f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt"
Jul 08 22:40:35.056275 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:35.056247    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6xlvg"
Jul 08 22:40:35.066620 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:35.066589    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94f78b47-394e-4ab8-93ab-e092a1240f56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cm528\" (UID: \"94f78b47-394e-4ab8-93ab-e092a1240f56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528"
Jul 08 22:40:35.066770 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:35.066631    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p6jh\" (UniqueName: \"kubernetes.io/projected/94f78b47-394e-4ab8-93ab-e092a1240f56-kube-api-access-9p6jh\") pod \"kuadrant-operator-controller-manager-86878c769f-cm528\" (UID: \"94f78b47-394e-4ab8-93ab-e092a1240f56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528"
Jul 08 22:40:35.067036 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:35.067016    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94f78b47-394e-4ab8-93ab-e092a1240f56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cm528\" (UID: \"94f78b47-394e-4ab8-93ab-e092a1240f56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528"
Jul 08 22:40:35.078009 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:35.077969    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nbks5\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="623649d0-0859-4bca-b9b7-d87680964f6b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:35.079853 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:35.079824    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fkg7n\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="d4627a94-2bd6-486c-a0d2-3d9d9685f3b3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"
Jul 08 22:40:35.080147 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:35.080108    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p6jh\" (UniqueName: \"kubernetes.io/projected/94f78b47-394e-4ab8-93ab-e092a1240f56-kube-api-access-9p6jh\") pod \"kuadrant-operator-controller-manager-86878c769f-cm528\" (UID: \"94f78b47-394e-4ab8-93ab-e092a1240f56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528"
Jul 08 22:40:35.081582 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:35.081552    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-lgm9b\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="86c0842a-7330-4da3-8ea7-f8c263b0d14f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgm9b"
Jul 08 22:40:35.104233 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:35.104198    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgm9b"
Jul 08 22:40:35.106858 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:35.106686    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fkg7n\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="d4627a94-2bd6-486c-a0d2-3d9d9685f3b3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"
Jul 08 22:40:35.108863 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:35.108794    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-lgm9b\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="86c0842a-7330-4da3-8ea7-f8c263b0d14f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgm9b"
Jul 08 22:40:35.111080 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:35.111053    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nbks5\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="623649d0-0859-4bca-b9b7-d87680964f6b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:35.121576 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:35.121536    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgm9b"
Jul 08 22:40:35.123781 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:35.123743    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nbks5\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="623649d0-0859-4bca-b9b7-d87680964f6b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:35.125981 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:35.125939    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fkg7n\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="d4627a94-2bd6-486c-a0d2-3d9d9685f3b3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"
Jul 08 22:40:35.127997 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:35.127962    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-lgm9b\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="86c0842a-7330-4da3-8ea7-f8c263b0d14f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgm9b"
Jul 08 22:40:35.196986 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:35.196940    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt"
Jul 08 22:40:35.205465 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:35.205443    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528"
Jul 08 22:40:36.109816 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:36.109771    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgm9b"
Jul 08 22:40:36.112235 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:36.112198    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nbks5\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="623649d0-0859-4bca-b9b7-d87680964f6b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:36.114678 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:36.114632    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fkg7n\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="d4627a94-2bd6-486c-a0d2-3d9d9685f3b3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"
Jul 08 22:40:36.116588 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:36.116512    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-lgm9b\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="86c0842a-7330-4da3-8ea7-f8c263b0d14f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgm9b"
Jul 08 22:40:36.119428 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:36.119402    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-lgm9b\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="86c0842a-7330-4da3-8ea7-f8c263b0d14f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgm9b"
Jul 08 22:40:36.121211 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:36.121184    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nbks5\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="623649d0-0859-4bca-b9b7-d87680964f6b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:36.122933 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:36.122900    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fkg7n\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="d4627a94-2bd6-486c-a0d2-3d9d9685f3b3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"
Jul 08 22:40:36.771869 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:36.771825    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nbks5\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="623649d0-0859-4bca-b9b7-d87680964f6b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:36.773870 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:36.773830    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fkg7n\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="d4627a94-2bd6-486c-a0d2-3d9d9685f3b3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"
Jul 08 22:40:36.775761 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:36.775736    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-lgm9b\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="86c0842a-7330-4da3-8ea7-f8c263b0d14f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lgm9b"
Jul 08 22:40:36.775951 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:36.775932    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86c0842a-7330-4da3-8ea7-f8c263b0d14f" path="/var/lib/kubelet/pods/86c0842a-7330-4da3-8ea7-f8c263b0d14f/volumes"
Jul 08 22:40:37.067094 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:37.067065    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kzk4q"
Jul 08 22:40:47.433182 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:47.433157    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:47.435345 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:47.435324    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"
Jul 08 22:40:47.435432 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:47.435359    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nbks5\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="623649d0-0859-4bca-b9b7-d87680964f6b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:47.437657 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:47.437631    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nbks5\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="623649d0-0859-4bca-b9b7-d87680964f6b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:47.439621 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:47.439587    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fkg7n\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="d4627a94-2bd6-486c-a0d2-3d9d9685f3b3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"
Jul 08 22:40:47.458782 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:47.458762    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528"]
Jul 08 22:40:47.461089 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:40:47.461056    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f78b47_394e_4ab8_93ab_e092a1240f56.slice/crio-25783156e30d0c02f8ef03f25e1637ec0c97c8bebc7578a44f06b736a993ec8b WatchSource:0}: Error finding container 25783156e30d0c02f8ef03f25e1637ec0c97c8bebc7578a44f06b736a993ec8b: Status 404 returned error can't find the container with id 25783156e30d0c02f8ef03f25e1637ec0c97c8bebc7578a44f06b736a993ec8b
Jul 08 22:40:47.579271 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:47.579238    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkrn8\" (UniqueName: \"kubernetes.io/projected/623649d0-0859-4bca-b9b7-d87680964f6b-kube-api-access-mkrn8\") pod \"623649d0-0859-4bca-b9b7-d87680964f6b\" (UID: \"623649d0-0859-4bca-b9b7-d87680964f6b\") "
Jul 08 22:40:47.579412 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:47.579280    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/623649d0-0859-4bca-b9b7-d87680964f6b-extensions-socket-volume\") pod \"623649d0-0859-4bca-b9b7-d87680964f6b\" (UID: \"623649d0-0859-4bca-b9b7-d87680964f6b\") "
Jul 08 22:40:47.579412 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:47.579361    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nch6\" (UniqueName: \"kubernetes.io/projected/d4627a94-2bd6-486c-a0d2-3d9d9685f3b3-kube-api-access-9nch6\") pod \"d4627a94-2bd6-486c-a0d2-3d9d9685f3b3\" (UID: \"d4627a94-2bd6-486c-a0d2-3d9d9685f3b3\") "
Jul 08 22:40:47.579770 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:47.579746    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/623649d0-0859-4bca-b9b7-d87680964f6b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "623649d0-0859-4bca-b9b7-d87680964f6b" (UID: "623649d0-0859-4bca-b9b7-d87680964f6b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:40:47.581393 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:47.581370    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/623649d0-0859-4bca-b9b7-d87680964f6b-kube-api-access-mkrn8" (OuterVolumeSpecName: "kube-api-access-mkrn8") pod "623649d0-0859-4bca-b9b7-d87680964f6b" (UID: "623649d0-0859-4bca-b9b7-d87680964f6b"). InnerVolumeSpecName "kube-api-access-mkrn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:40:47.581458 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:47.581384    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4627a94-2bd6-486c-a0d2-3d9d9685f3b3-kube-api-access-9nch6" (OuterVolumeSpecName: "kube-api-access-9nch6") pod "d4627a94-2bd6-486c-a0d2-3d9d9685f3b3" (UID: "d4627a94-2bd6-486c-a0d2-3d9d9685f3b3"). InnerVolumeSpecName "kube-api-access-9nch6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:40:47.626686 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:47.626657    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt"]
Jul 08 22:40:47.628891 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:40:47.628867    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod705a5856_784d_4cbe_b117_b7fcf6e2333f.slice/crio-f3d8a1733e5ecb44ad37c0fc9f71274554cdbf883cad4581184ebccd88bcfb14 WatchSource:0}: Error finding container f3d8a1733e5ecb44ad37c0fc9f71274554cdbf883cad4581184ebccd88bcfb14: Status 404 returned error can't find the container with id f3d8a1733e5ecb44ad37c0fc9f71274554cdbf883cad4581184ebccd88bcfb14
Jul 08 22:40:47.680019 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:47.679998    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nch6\" (UniqueName: \"kubernetes.io/projected/d4627a94-2bd6-486c-a0d2-3d9d9685f3b3-kube-api-access-9nch6\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:40:47.680019 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:47.680019    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkrn8\" (UniqueName: \"kubernetes.io/projected/623649d0-0859-4bca-b9b7-d87680964f6b-kube-api-access-mkrn8\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:40:47.680166 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:47.680029    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/623649d0-0859-4bca-b9b7-d87680964f6b-extensions-socket-volume\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:40:48.171242 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:48.171203    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt" event={"ID":"705a5856-784d-4cbe-b117-b7fcf6e2333f","Type":"ContainerStarted","Data":"dc180f9f3b470860a52d125ffef8697464cd89f00cf7d3347e42c30dd3c30382"}
Jul 08 22:40:48.171435 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:48.171291    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt" event={"ID":"705a5856-784d-4cbe-b117-b7fcf6e2333f","Type":"ContainerStarted","Data":"f3d8a1733e5ecb44ad37c0fc9f71274554cdbf883cad4581184ebccd88bcfb14"}
Jul 08 22:40:48.171435 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:48.171320    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt"
Jul 08 22:40:48.172728 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:48.172703    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4rx8g" event={"ID":"4f477de4-3333-4314-abbc-0a263e72d1cd","Type":"ContainerStarted","Data":"8ca957a7e3fd40cb4bee9caf05512bf1a697cd9efa6a5fb87ddb66a9fc77bd18"}
Jul 08 22:40:48.174301 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:48.174275    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528" event={"ID":"94f78b47-394e-4ab8-93ab-e092a1240f56","Type":"ContainerStarted","Data":"552831e15597940cc963b5f4c32524424f68fabac6e3a8eca603dd0abcbbe797"}
Jul 08 22:40:48.174467 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:48.174323    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528" event={"ID":"94f78b47-394e-4ab8-93ab-e092a1240f56","Type":"ContainerStarted","Data":"25783156e30d0c02f8ef03f25e1637ec0c97c8bebc7578a44f06b736a993ec8b"}
Jul 08 22:40:48.174467 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:48.174354    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528"
Jul 08 22:40:48.175520 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:48.175495    2558 generic.go:356] "Generic (PLEG): container finished" podID="623649d0-0859-4bca-b9b7-d87680964f6b" containerID="e758ff4de7a720f86d72b298f0adaf03805fee9862556c326a9f3d50c23dc7ea" exitCode=0
Jul 08 22:40:48.175633 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:48.175548    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:48.175633 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:48.175592    2558 scope.go:117] "RemoveContainer" containerID="e758ff4de7a720f86d72b298f0adaf03805fee9862556c326a9f3d50c23dc7ea"
Jul 08 22:40:48.176775 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:48.176754    2558 generic.go:356] "Generic (PLEG): container finished" podID="d4627a94-2bd6-486c-a0d2-3d9d9685f3b3" containerID="672ccb82692e96ceff7e227666d115a39e43c4a548b5c17c62932331527d17c8" exitCode=0
Jul 08 22:40:48.176879 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:48.176864    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"
Jul 08 22:40:48.185617 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:48.185389    2558 scope.go:117] "RemoveContainer" containerID="e758ff4de7a720f86d72b298f0adaf03805fee9862556c326a9f3d50c23dc7ea"
Jul 08 22:40:48.185871 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:48.185843    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e758ff4de7a720f86d72b298f0adaf03805fee9862556c326a9f3d50c23dc7ea\": container with ID starting with e758ff4de7a720f86d72b298f0adaf03805fee9862556c326a9f3d50c23dc7ea not found: ID does not exist" containerID="e758ff4de7a720f86d72b298f0adaf03805fee9862556c326a9f3d50c23dc7ea"
Jul 08 22:40:48.185952 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:48.185883    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e758ff4de7a720f86d72b298f0adaf03805fee9862556c326a9f3d50c23dc7ea"} err="failed to get container status \"e758ff4de7a720f86d72b298f0adaf03805fee9862556c326a9f3d50c23dc7ea\": rpc error: code = NotFound desc = could not find container \"e758ff4de7a720f86d72b298f0adaf03805fee9862556c326a9f3d50c23dc7ea\": container with ID starting with e758ff4de7a720f86d72b298f0adaf03805fee9862556c326a9f3d50c23dc7ea not found: ID does not exist"
Jul 08 22:40:48.185952 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:48.185909    2558 scope.go:117] "RemoveContainer" containerID="672ccb82692e96ceff7e227666d115a39e43c4a548b5c17c62932331527d17c8"
Jul 08 22:40:48.193009 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:48.192976    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nbks5\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="623649d0-0859-4bca-b9b7-d87680964f6b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:48.193153 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:48.193121    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt" podStartSLOduration=14.193111082 podStartE2EDuration="14.193111082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:40:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:40:48.190704631 +0000 UTC m=+651.967440021" watchObservedRunningTime="2026-07-08 22:40:48.193111082 +0000 UTC m=+651.969846528"
Jul 08 22:40:48.194962 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:48.194942    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fkg7n\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="d4627a94-2bd6-486c-a0d2-3d9d9685f3b3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"
Jul 08 22:40:48.195309 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:48.195293    2558 scope.go:117] "RemoveContainer" containerID="672ccb82692e96ceff7e227666d115a39e43c4a548b5c17c62932331527d17c8"
Jul 08 22:40:48.195574 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:48.195556    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"672ccb82692e96ceff7e227666d115a39e43c4a548b5c17c62932331527d17c8\": container with ID starting with 672ccb82692e96ceff7e227666d115a39e43c4a548b5c17c62932331527d17c8 not found: ID does not exist" containerID="672ccb82692e96ceff7e227666d115a39e43c4a548b5c17c62932331527d17c8"
Jul 08 22:40:48.195644 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:48.195585    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"672ccb82692e96ceff7e227666d115a39e43c4a548b5c17c62932331527d17c8"} err="failed to get container status \"672ccb82692e96ceff7e227666d115a39e43c4a548b5c17c62932331527d17c8\": rpc error: code = NotFound desc = could not find container \"672ccb82692e96ceff7e227666d115a39e43c4a548b5c17c62932331527d17c8\": container with ID starting with 672ccb82692e96ceff7e227666d115a39e43c4a548b5c17c62932331527d17c8 not found: ID does not exist"
Jul 08 22:40:48.213587 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:48.213549    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528" podStartSLOduration=14.21353746 podStartE2EDuration="14.21353746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:40:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:40:48.212473143 +0000 UTC m=+651.989208525" watchObservedRunningTime="2026-07-08 22:40:48.21353746 +0000 UTC m=+651.990272848"
Jul 08 22:40:48.214412 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:48.214392    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nbks5\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="623649d0-0859-4bca-b9b7-d87680964f6b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nbks5"
Jul 08 22:40:48.231318 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:48.231263    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4rx8g" podStartSLOduration=2.200278006 podStartE2EDuration="25.231249231s" totalImagesPullingTime="23.030971225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:40:48.231069739 +0000 UTC m=+652.007805156" watchObservedRunningTime="2026-07-08 22:40:48.231249231 +0000 UTC m=+652.007984620"
Jul 08 22:40:48.233000 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:40:48.232973    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fkg7n\" is forbidden: User \"system:node:ip-10-0-136-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-6.ec2.internal' and this object" podUID="d4627a94-2bd6-486c-a0d2-3d9d9685f3b3" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fkg7n"
Jul 08 22:40:48.773506 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:48.773473    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="623649d0-0859-4bca-b9b7-d87680964f6b" path="/var/lib/kubelet/pods/623649d0-0859-4bca-b9b7-d87680964f6b/volumes"
Jul 08 22:40:48.773862 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:48.773765    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4627a94-2bd6-486c-a0d2-3d9d9685f3b3" path="/var/lib/kubelet/pods/d4627a94-2bd6-486c-a0d2-3d9d9685f3b3/volumes"
Jul 08 22:40:59.184891 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:59.184861    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt"
Jul 08 22:40:59.185252 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:59.184942    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528"
Jul 08 22:40:59.266722 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:59.266682    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt"]
Jul 08 22:40:59.266956 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:59.266913    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt" podUID="705a5856-784d-4cbe-b117-b7fcf6e2333f" containerName="manager" containerID="cri-o://dc180f9f3b470860a52d125ffef8697464cd89f00cf7d3347e42c30dd3c30382" gracePeriod=10
Jul 08 22:40:59.513571 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:59.513549    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt"
Jul 08 22:40:59.687448 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:59.687419    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/705a5856-784d-4cbe-b117-b7fcf6e2333f-extensions-socket-volume\") pod \"705a5856-784d-4cbe-b117-b7fcf6e2333f\" (UID: \"705a5856-784d-4cbe-b117-b7fcf6e2333f\") "
Jul 08 22:40:59.687618 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:59.687493    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wphmm\" (UniqueName: \"kubernetes.io/projected/705a5856-784d-4cbe-b117-b7fcf6e2333f-kube-api-access-wphmm\") pod \"705a5856-784d-4cbe-b117-b7fcf6e2333f\" (UID: \"705a5856-784d-4cbe-b117-b7fcf6e2333f\") "
Jul 08 22:40:59.687898 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:59.687773    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/705a5856-784d-4cbe-b117-b7fcf6e2333f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "705a5856-784d-4cbe-b117-b7fcf6e2333f" (UID: "705a5856-784d-4cbe-b117-b7fcf6e2333f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:40:59.689738 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:59.689720    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/705a5856-784d-4cbe-b117-b7fcf6e2333f-kube-api-access-wphmm" (OuterVolumeSpecName: "kube-api-access-wphmm") pod "705a5856-784d-4cbe-b117-b7fcf6e2333f" (UID: "705a5856-784d-4cbe-b117-b7fcf6e2333f"). InnerVolumeSpecName "kube-api-access-wphmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:40:59.788414 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:59.788353    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wphmm\" (UniqueName: \"kubernetes.io/projected/705a5856-784d-4cbe-b117-b7fcf6e2333f-kube-api-access-wphmm\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:40:59.788414 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:40:59.788376    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/705a5856-784d-4cbe-b117-b7fcf6e2333f-extensions-socket-volume\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:41:00.232133 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:00.232101    2558 generic.go:356] "Generic (PLEG): container finished" podID="705a5856-784d-4cbe-b117-b7fcf6e2333f" containerID="dc180f9f3b470860a52d125ffef8697464cd89f00cf7d3347e42c30dd3c30382" exitCode=0
Jul 08 22:41:00.232535 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:00.232151    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt"
Jul 08 22:41:00.232535 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:00.232165    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt" event={"ID":"705a5856-784d-4cbe-b117-b7fcf6e2333f","Type":"ContainerDied","Data":"dc180f9f3b470860a52d125ffef8697464cd89f00cf7d3347e42c30dd3c30382"}
Jul 08 22:41:00.232535 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:00.232207    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt" event={"ID":"705a5856-784d-4cbe-b117-b7fcf6e2333f","Type":"ContainerDied","Data":"f3d8a1733e5ecb44ad37c0fc9f71274554cdbf883cad4581184ebccd88bcfb14"}
Jul 08 22:41:00.232535 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:00.232228    2558 scope.go:117] "RemoveContainer" containerID="dc180f9f3b470860a52d125ffef8697464cd89f00cf7d3347e42c30dd3c30382"
Jul 08 22:41:00.240899 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:00.240878    2558 scope.go:117] "RemoveContainer" containerID="dc180f9f3b470860a52d125ffef8697464cd89f00cf7d3347e42c30dd3c30382"
Jul 08 22:41:00.241140 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:41:00.241124    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc180f9f3b470860a52d125ffef8697464cd89f00cf7d3347e42c30dd3c30382\": container with ID starting with dc180f9f3b470860a52d125ffef8697464cd89f00cf7d3347e42c30dd3c30382 not found: ID does not exist" containerID="dc180f9f3b470860a52d125ffef8697464cd89f00cf7d3347e42c30dd3c30382"
Jul 08 22:41:00.241179 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:00.241149    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc180f9f3b470860a52d125ffef8697464cd89f00cf7d3347e42c30dd3c30382"} err="failed to get container status \"dc180f9f3b470860a52d125ffef8697464cd89f00cf7d3347e42c30dd3c30382\": rpc error: code = NotFound desc = could not find container \"dc180f9f3b470860a52d125ffef8697464cd89f00cf7d3347e42c30dd3c30382\": container with ID starting with dc180f9f3b470860a52d125ffef8697464cd89f00cf7d3347e42c30dd3c30382 not found: ID does not exist"
Jul 08 22:41:00.260267 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:00.260244    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt"]
Jul 08 22:41:00.264621 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:00.264600    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dmgdt"]
Jul 08 22:41:00.772591 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:00.772558    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="705a5856-784d-4cbe-b117-b7fcf6e2333f" path="/var/lib/kubelet/pods/705a5856-784d-4cbe-b117-b7fcf6e2333f/volumes"
Jul 08 22:41:18.036398 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.036365    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jgbg4"]
Jul 08 22:41:18.036877 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.036694    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="705a5856-784d-4cbe-b117-b7fcf6e2333f" containerName="manager"
Jul 08 22:41:18.036877 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.036707    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="705a5856-784d-4cbe-b117-b7fcf6e2333f" containerName="manager"
Jul 08 22:41:18.036877 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.036762    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="705a5856-784d-4cbe-b117-b7fcf6e2333f" containerName="manager"
Jul 08 22:41:18.114849 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.114788    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jgbg4"]
Jul 08 22:41:18.115018 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.114902    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jgbg4"
Jul 08 22:41:18.121883 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.121838    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 08 22:41:18.130406 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.130382    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jgbg4"]
Jul 08 22:41:18.132523 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.132500    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsdbv\" (UniqueName: \"kubernetes.io/projected/bf5de834-7fe9-4eb4-8663-d878f550541e-kube-api-access-gsdbv\") pod \"limitador-limitador-64c94fd64f-jgbg4\" (UID: \"bf5de834-7fe9-4eb4-8663-d878f550541e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jgbg4"
Jul 08 22:41:18.132642 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.132594    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bf5de834-7fe9-4eb4-8663-d878f550541e-config-file\") pod \"limitador-limitador-64c94fd64f-jgbg4\" (UID: \"bf5de834-7fe9-4eb4-8663-d878f550541e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jgbg4"
Jul 08 22:41:18.233595 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.233562    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsdbv\" (UniqueName: \"kubernetes.io/projected/bf5de834-7fe9-4eb4-8663-d878f550541e-kube-api-access-gsdbv\") pod \"limitador-limitador-64c94fd64f-jgbg4\" (UID: \"bf5de834-7fe9-4eb4-8663-d878f550541e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jgbg4"
Jul 08 22:41:18.233767 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.233642    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bf5de834-7fe9-4eb4-8663-d878f550541e-config-file\") pod \"limitador-limitador-64c94fd64f-jgbg4\" (UID: \"bf5de834-7fe9-4eb4-8663-d878f550541e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jgbg4"
Jul 08 22:41:18.234428 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.234407    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bf5de834-7fe9-4eb4-8663-d878f550541e-config-file\") pod \"limitador-limitador-64c94fd64f-jgbg4\" (UID: \"bf5de834-7fe9-4eb4-8663-d878f550541e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jgbg4"
Jul 08 22:41:18.241693 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.241671    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsdbv\" (UniqueName: \"kubernetes.io/projected/bf5de834-7fe9-4eb4-8663-d878f550541e-kube-api-access-gsdbv\") pod \"limitador-limitador-64c94fd64f-jgbg4\" (UID: \"bf5de834-7fe9-4eb4-8663-d878f550541e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jgbg4"
Jul 08 22:41:18.432907 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.432869    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jgbg4"
Jul 08 22:41:18.480994 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.480955    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:41:18.541778 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.541753    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:41:18.541922 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.541790    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:41:18.541922 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.541906    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-brlwv"
Jul 08 22:41:18.636237 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.636204    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg5sp\" (UniqueName: \"kubernetes.io/projected/6e9974af-8c2c-44af-a8d8-902c474c80e9-kube-api-access-lg5sp\") pod \"limitador-limitador-54d6d988d5-brlwv\" (UID: \"6e9974af-8c2c-44af-a8d8-902c474c80e9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-brlwv"
Jul 08 22:41:18.636409 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.636286    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6e9974af-8c2c-44af-a8d8-902c474c80e9-config-file\") pod \"limitador-limitador-54d6d988d5-brlwv\" (UID: \"6e9974af-8c2c-44af-a8d8-902c474c80e9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-brlwv"
Jul 08 22:41:18.668006 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.667977    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jgbg4"]
Jul 08 22:41:18.670668 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:41:18.670634    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf5de834_7fe9_4eb4_8663_d878f550541e.slice/crio-33e18a04d7f52cad9167a66eec87b195f6773005ecd44b2c46a1c67bebac37c0 WatchSource:0}: Error finding container 33e18a04d7f52cad9167a66eec87b195f6773005ecd44b2c46a1c67bebac37c0: Status 404 returned error can't find the container with id 33e18a04d7f52cad9167a66eec87b195f6773005ecd44b2c46a1c67bebac37c0
Jul 08 22:41:18.737285 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.737209    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg5sp\" (UniqueName: \"kubernetes.io/projected/6e9974af-8c2c-44af-a8d8-902c474c80e9-kube-api-access-lg5sp\") pod \"limitador-limitador-54d6d988d5-brlwv\" (UID: \"6e9974af-8c2c-44af-a8d8-902c474c80e9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-brlwv"
Jul 08 22:41:18.737285 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.737261    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6e9974af-8c2c-44af-a8d8-902c474c80e9-config-file\") pod \"limitador-limitador-54d6d988d5-brlwv\" (UID: \"6e9974af-8c2c-44af-a8d8-902c474c80e9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-brlwv"
Jul 08 22:41:18.737893 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.737871    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6e9974af-8c2c-44af-a8d8-902c474c80e9-config-file\") pod \"limitador-limitador-54d6d988d5-brlwv\" (UID: \"6e9974af-8c2c-44af-a8d8-902c474c80e9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-brlwv"
Jul 08 22:41:18.746366 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.746346    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg5sp\" (UniqueName: \"kubernetes.io/projected/6e9974af-8c2c-44af-a8d8-902c474c80e9-kube-api-access-lg5sp\") pod \"limitador-limitador-54d6d988d5-brlwv\" (UID: \"6e9974af-8c2c-44af-a8d8-902c474c80e9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-brlwv"
Jul 08 22:41:18.864279 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:18.864248    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-brlwv"
Jul 08 22:41:19.011821 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:19.009056    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-tkc86"]
Jul 08 22:41:19.041071 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:19.041041    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tkc86"]
Jul 08 22:41:19.041455 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:19.041133    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tkc86"
Jul 08 22:41:19.043848 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:19.043827    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lmnjk\""
Jul 08 22:41:19.098208 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:19.094632    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:41:19.140529 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:19.140489    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpsmc\" (UniqueName: \"kubernetes.io/projected/bda2d946-7166-48fe-8625-23cb8a39a00d-kube-api-access-vpsmc\") pod \"authorino-75d556bd77-tkc86\" (UID: \"bda2d946-7166-48fe-8625-23cb8a39a00d\") " pod="kuadrant-system/authorino-75d556bd77-tkc86"
Jul 08 22:41:19.241690 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:19.241618    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpsmc\" (UniqueName: \"kubernetes.io/projected/bda2d946-7166-48fe-8625-23cb8a39a00d-kube-api-access-vpsmc\") pod \"authorino-75d556bd77-tkc86\" (UID: \"bda2d946-7166-48fe-8625-23cb8a39a00d\") " pod="kuadrant-system/authorino-75d556bd77-tkc86"
Jul 08 22:41:19.250467 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:19.250436    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpsmc\" (UniqueName: \"kubernetes.io/projected/bda2d946-7166-48fe-8625-23cb8a39a00d-kube-api-access-vpsmc\") pod \"authorino-75d556bd77-tkc86\" (UID: \"bda2d946-7166-48fe-8625-23cb8a39a00d\") " pod="kuadrant-system/authorino-75d556bd77-tkc86"
Jul 08 22:41:19.313116 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:19.313075    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-brlwv" event={"ID":"6e9974af-8c2c-44af-a8d8-902c474c80e9","Type":"ContainerStarted","Data":"04285d31218d4df4a96ee0816bb7586464af9a9edd36e6767cfce1f182fad592"}
Jul 08 22:41:19.314501 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:19.314473    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jgbg4" event={"ID":"bf5de834-7fe9-4eb4-8663-d878f550541e","Type":"ContainerStarted","Data":"33e18a04d7f52cad9167a66eec87b195f6773005ecd44b2c46a1c67bebac37c0"}
Jul 08 22:41:19.351975 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:19.351934    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tkc86"
Jul 08 22:41:19.530726 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:19.530387    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tkc86"]
Jul 08 22:41:20.324368 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:20.324294    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tkc86" event={"ID":"bda2d946-7166-48fe-8625-23cb8a39a00d","Type":"ContainerStarted","Data":"afd7395228e42efdb6196de3e12c6ca2f63b6fba571bbe884b387f0f909e3762"}
Jul 08 22:41:24.346850 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:24.346813    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-brlwv" event={"ID":"6e9974af-8c2c-44af-a8d8-902c474c80e9","Type":"ContainerStarted","Data":"fb3ffb2c4c1e648fc5f3be8543afb14d2975f3d9333bbf64bb510af73d28311d"}
Jul 08 22:41:24.347308 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:24.346935    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-brlwv"
Jul 08 22:41:24.348387 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:24.348360    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jgbg4" event={"ID":"bf5de834-7fe9-4eb4-8663-d878f550541e","Type":"ContainerStarted","Data":"18eee67ea54344065e481b8016968131ee52f30b7bdcc20c714d0d5bce66a5df"}
Jul 08 22:41:24.348487 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:24.348408    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jgbg4"
Jul 08 22:41:24.349716 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:24.349690    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tkc86" event={"ID":"bda2d946-7166-48fe-8625-23cb8a39a00d","Type":"ContainerStarted","Data":"b34e81b03b5ffa6295f386305fdbd6f6d750dd6114ade0f4b90c3c75e4e22606"}
Jul 08 22:41:24.364867 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:24.364824    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-brlwv" podStartSLOduration=1.887791668 podStartE2EDuration="6.364792567s" totalImagesPullingTime="4.477000899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:41:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:41:24.364016996 +0000 UTC m=+688.140752385" watchObservedRunningTime="2026-07-08 22:41:24.364792567 +0000 UTC m=+688.141527955"
Jul 08 22:41:24.382188 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:24.382142    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-jgbg4" podStartSLOduration=1.471370342 podStartE2EDuration="6.382128304s" totalImagesPullingTime="4.910757962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:41:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:41:24.380596227 +0000 UTC m=+688.157331635" watchObservedRunningTime="2026-07-08 22:41:24.382128304 +0000 UTC m=+688.158863692"
Jul 08 22:41:24.397038 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:24.396998    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-tkc86" podStartSLOduration=2.362108241 podStartE2EDuration="6.396982142s" totalImagesPullingTime="4.034873901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:41:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:41:24.39603979 +0000 UTC m=+688.172775180" watchObservedRunningTime="2026-07-08 22:41:24.396982142 +0000 UTC m=+688.173717529"
Jul 08 22:41:35.355135 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:35.355104    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-brlwv"
Jul 08 22:41:35.355581 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:35.355192    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jgbg4"
Jul 08 22:41:35.428163 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:35.428129    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jgbg4"]
Jul 08 22:41:35.428353 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:35.428314    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-jgbg4" podUID="bf5de834-7fe9-4eb4-8663-d878f550541e" containerName="limitador" containerID="cri-o://18eee67ea54344065e481b8016968131ee52f30b7bdcc20c714d0d5bce66a5df" gracePeriod=30
Jul 08 22:41:35.974009 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:35.973986    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jgbg4"
Jul 08 22:41:36.090110 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:36.090077    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsdbv\" (UniqueName: \"kubernetes.io/projected/bf5de834-7fe9-4eb4-8663-d878f550541e-kube-api-access-gsdbv\") pod \"bf5de834-7fe9-4eb4-8663-d878f550541e\" (UID: \"bf5de834-7fe9-4eb4-8663-d878f550541e\") "
Jul 08 22:41:36.090289 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:36.090158    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bf5de834-7fe9-4eb4-8663-d878f550541e-config-file\") pod \"bf5de834-7fe9-4eb4-8663-d878f550541e\" (UID: \"bf5de834-7fe9-4eb4-8663-d878f550541e\") "
Jul 08 22:41:36.090469 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:36.090448    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf5de834-7fe9-4eb4-8663-d878f550541e-config-file" (OuterVolumeSpecName: "config-file") pod "bf5de834-7fe9-4eb4-8663-d878f550541e" (UID: "bf5de834-7fe9-4eb4-8663-d878f550541e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:41:36.092133 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:36.092105    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf5de834-7fe9-4eb4-8663-d878f550541e-kube-api-access-gsdbv" (OuterVolumeSpecName: "kube-api-access-gsdbv") pod "bf5de834-7fe9-4eb4-8663-d878f550541e" (UID: "bf5de834-7fe9-4eb4-8663-d878f550541e"). InnerVolumeSpecName "kube-api-access-gsdbv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:41:36.190990 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:36.190959    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsdbv\" (UniqueName: \"kubernetes.io/projected/bf5de834-7fe9-4eb4-8663-d878f550541e-kube-api-access-gsdbv\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:41:36.190990 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:36.190986    2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bf5de834-7fe9-4eb4-8663-d878f550541e-config-file\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:41:36.402866 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:36.402758    2558 generic.go:356] "Generic (PLEG): container finished" podID="bf5de834-7fe9-4eb4-8663-d878f550541e" containerID="18eee67ea54344065e481b8016968131ee52f30b7bdcc20c714d0d5bce66a5df" exitCode=0
Jul 08 22:41:36.402866 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:36.402831    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jgbg4"
Jul 08 22:41:36.402866 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:36.402847    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jgbg4" event={"ID":"bf5de834-7fe9-4eb4-8663-d878f550541e","Type":"ContainerDied","Data":"18eee67ea54344065e481b8016968131ee52f30b7bdcc20c714d0d5bce66a5df"}
Jul 08 22:41:36.403353 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:36.402903    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jgbg4" event={"ID":"bf5de834-7fe9-4eb4-8663-d878f550541e","Type":"ContainerDied","Data":"33e18a04d7f52cad9167a66eec87b195f6773005ecd44b2c46a1c67bebac37c0"}
Jul 08 22:41:36.403353 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:36.402929    2558 scope.go:117] "RemoveContainer" containerID="18eee67ea54344065e481b8016968131ee52f30b7bdcc20c714d0d5bce66a5df"
Jul 08 22:41:36.413821 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:36.413781    2558 scope.go:117] "RemoveContainer" containerID="18eee67ea54344065e481b8016968131ee52f30b7bdcc20c714d0d5bce66a5df"
Jul 08 22:41:36.414643 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:41:36.414616    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18eee67ea54344065e481b8016968131ee52f30b7bdcc20c714d0d5bce66a5df\": container with ID starting with 18eee67ea54344065e481b8016968131ee52f30b7bdcc20c714d0d5bce66a5df not found: ID does not exist" containerID="18eee67ea54344065e481b8016968131ee52f30b7bdcc20c714d0d5bce66a5df"
Jul 08 22:41:36.414735 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:36.414652    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18eee67ea54344065e481b8016968131ee52f30b7bdcc20c714d0d5bce66a5df"} err="failed to get container status \"18eee67ea54344065e481b8016968131ee52f30b7bdcc20c714d0d5bce66a5df\": rpc error: code = NotFound desc = could not find container \"18eee67ea54344065e481b8016968131ee52f30b7bdcc20c714d0d5bce66a5df\": container with ID starting with 18eee67ea54344065e481b8016968131ee52f30b7bdcc20c714d0d5bce66a5df not found: ID does not exist"
Jul 08 22:41:36.428127 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:36.428104    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jgbg4"]
Jul 08 22:41:36.431204 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:36.431186    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jgbg4"]
Jul 08 22:41:36.772637 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:36.772561    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf5de834-7fe9-4eb4-8663-d878f550541e" path="/var/lib/kubelet/pods/bf5de834-7fe9-4eb4-8663-d878f550541e/volumes"
Jul 08 22:41:52.777213 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:52.777134    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dmhbz"]
Jul 08 22:41:52.777635 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:52.777467    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf5de834-7fe9-4eb4-8663-d878f550541e" containerName="limitador"
Jul 08 22:41:52.777635 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:52.777479    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf5de834-7fe9-4eb4-8663-d878f550541e" containerName="limitador"
Jul 08 22:41:52.777635 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:52.777552    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf5de834-7fe9-4eb4-8663-d878f550541e" containerName="limitador"
Jul 08 22:41:52.780454 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:52.780437    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dmhbz"
Jul 08 22:41:52.786939 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:52.786916    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dmhbz"]
Jul 08 22:41:52.938556 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:52.938522    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jr54\" (UniqueName: \"kubernetes.io/projected/73505638-e532-47af-be08-3308cd068a78-kube-api-access-2jr54\") pod \"authorino-5d4b67c446-dmhbz\" (UID: \"73505638-e532-47af-be08-3308cd068a78\") " pod="kuadrant-system/authorino-5d4b67c446-dmhbz"
Jul 08 22:41:53.035520 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.035440    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dmhbz"]
Jul 08 22:41:53.035704 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:41:53.035683    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2jr54], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-dmhbz" podUID="73505638-e532-47af-be08-3308cd068a78"
Jul 08 22:41:53.039103 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.039080    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jr54\" (UniqueName: \"kubernetes.io/projected/73505638-e532-47af-be08-3308cd068a78-kube-api-access-2jr54\") pod \"authorino-5d4b67c446-dmhbz\" (UID: \"73505638-e532-47af-be08-3308cd068a78\") " pod="kuadrant-system/authorino-5d4b67c446-dmhbz"
Jul 08 22:41:53.050463 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.050440    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jr54\" (UniqueName: \"kubernetes.io/projected/73505638-e532-47af-be08-3308cd068a78-kube-api-access-2jr54\") pod \"authorino-5d4b67c446-dmhbz\" (UID: \"73505638-e532-47af-be08-3308cd068a78\") " pod="kuadrant-system/authorino-5d4b67c446-dmhbz"
Jul 08 22:41:53.056199 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.056178    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5799c685bb-7zbgf"]
Jul 08 22:41:53.059614 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.059597    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5799c685bb-7zbgf"
Jul 08 22:41:53.068648 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.068625    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5799c685bb-7zbgf"]
Jul 08 22:41:53.140006 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.139972    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5799c685bb-7zbgf"]
Jul 08 22:41:53.140189 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:41:53.140169    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-tctz6], unattached volumes=[], failed to process volumes=[kube-api-access-tctz6]: context canceled" pod="kuadrant-system/authorino-5799c685bb-7zbgf" podUID="ff5f20fe-a0e7-45fc-94a6-ee5c20779e0f"
Jul 08 22:41:53.164738 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.164709    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-598f86c9c4-xb7gg"]
Jul 08 22:41:53.167918 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.167901    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-598f86c9c4-xb7gg"
Jul 08 22:41:53.170772 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.170748    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 08 22:41:53.177900 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.177881    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-598f86c9c4-xb7gg"]
Jul 08 22:41:53.240853 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.240819    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tctz6\" (UniqueName: \"kubernetes.io/projected/ff5f20fe-a0e7-45fc-94a6-ee5c20779e0f-kube-api-access-tctz6\") pod \"authorino-5799c685bb-7zbgf\" (UID: \"ff5f20fe-a0e7-45fc-94a6-ee5c20779e0f\") " pod="kuadrant-system/authorino-5799c685bb-7zbgf"
Jul 08 22:41:53.341594 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.341561    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk6tp\" (UniqueName: \"kubernetes.io/projected/1eec368a-6393-4300-9972-bb173d2e1c24-kube-api-access-fk6tp\") pod \"authorino-598f86c9c4-xb7gg\" (UID: \"1eec368a-6393-4300-9972-bb173d2e1c24\") " pod="kuadrant-system/authorino-598f86c9c4-xb7gg"
Jul 08 22:41:53.341762 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.341602    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1eec368a-6393-4300-9972-bb173d2e1c24-tls-cert\") pod \"authorino-598f86c9c4-xb7gg\" (UID: \"1eec368a-6393-4300-9972-bb173d2e1c24\") " pod="kuadrant-system/authorino-598f86c9c4-xb7gg"
Jul 08 22:41:53.341762 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.341629    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tctz6\" (UniqueName: \"kubernetes.io/projected/ff5f20fe-a0e7-45fc-94a6-ee5c20779e0f-kube-api-access-tctz6\") pod \"authorino-5799c685bb-7zbgf\" (UID: \"ff5f20fe-a0e7-45fc-94a6-ee5c20779e0f\") " pod="kuadrant-system/authorino-5799c685bb-7zbgf"
Jul 08 22:41:53.350573 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.350549    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tctz6\" (UniqueName: \"kubernetes.io/projected/ff5f20fe-a0e7-45fc-94a6-ee5c20779e0f-kube-api-access-tctz6\") pod \"authorino-5799c685bb-7zbgf\" (UID: \"ff5f20fe-a0e7-45fc-94a6-ee5c20779e0f\") " pod="kuadrant-system/authorino-5799c685bb-7zbgf"
Jul 08 22:41:53.442438 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.442398    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk6tp\" (UniqueName: \"kubernetes.io/projected/1eec368a-6393-4300-9972-bb173d2e1c24-kube-api-access-fk6tp\") pod \"authorino-598f86c9c4-xb7gg\" (UID: \"1eec368a-6393-4300-9972-bb173d2e1c24\") " pod="kuadrant-system/authorino-598f86c9c4-xb7gg"
Jul 08 22:41:53.442438 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.442443    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1eec368a-6393-4300-9972-bb173d2e1c24-tls-cert\") pod \"authorino-598f86c9c4-xb7gg\" (UID: \"1eec368a-6393-4300-9972-bb173d2e1c24\") " pod="kuadrant-system/authorino-598f86c9c4-xb7gg"
Jul 08 22:41:53.444971 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.444942    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1eec368a-6393-4300-9972-bb173d2e1c24-tls-cert\") pod \"authorino-598f86c9c4-xb7gg\" (UID: \"1eec368a-6393-4300-9972-bb173d2e1c24\") " pod="kuadrant-system/authorino-598f86c9c4-xb7gg"
Jul 08 22:41:53.451394 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.451371    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk6tp\" (UniqueName: \"kubernetes.io/projected/1eec368a-6393-4300-9972-bb173d2e1c24-kube-api-access-fk6tp\") pod \"authorino-598f86c9c4-xb7gg\" (UID: \"1eec368a-6393-4300-9972-bb173d2e1c24\") " pod="kuadrant-system/authorino-598f86c9c4-xb7gg"
Jul 08 22:41:53.477233 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.477205    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-598f86c9c4-xb7gg"
Jul 08 22:41:53.479794 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.479776    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5799c685bb-7zbgf"
Jul 08 22:41:53.479893 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.479782    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dmhbz"
Jul 08 22:41:53.487021 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.487001    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5799c685bb-7zbgf"
Jul 08 22:41:53.497066 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.497035    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dmhbz"
Jul 08 22:41:53.608898 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.608733    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-598f86c9c4-xb7gg"]
Jul 08 22:41:53.611602 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:41:53.611576    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1eec368a_6393_4300_9972_bb173d2e1c24.slice/crio-de4b0fc47ad03486626665d0b8a2f679d8a5f0adf2255fbd3a7241c7b74b8405 WatchSource:0}: Error finding container de4b0fc47ad03486626665d0b8a2f679d8a5f0adf2255fbd3a7241c7b74b8405: Status 404 returned error can't find the container with id de4b0fc47ad03486626665d0b8a2f679d8a5f0adf2255fbd3a7241c7b74b8405
Jul 08 22:41:53.644349 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.644324    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tctz6\" (UniqueName: \"kubernetes.io/projected/ff5f20fe-a0e7-45fc-94a6-ee5c20779e0f-kube-api-access-tctz6\") pod \"ff5f20fe-a0e7-45fc-94a6-ee5c20779e0f\" (UID: \"ff5f20fe-a0e7-45fc-94a6-ee5c20779e0f\") "
Jul 08 22:41:53.644466 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.644362    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jr54\" (UniqueName: \"kubernetes.io/projected/73505638-e532-47af-be08-3308cd068a78-kube-api-access-2jr54\") pod \"73505638-e532-47af-be08-3308cd068a78\" (UID: \"73505638-e532-47af-be08-3308cd068a78\") "
Jul 08 22:41:53.646516 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.646494    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73505638-e532-47af-be08-3308cd068a78-kube-api-access-2jr54" (OuterVolumeSpecName: "kube-api-access-2jr54") pod "73505638-e532-47af-be08-3308cd068a78" (UID: "73505638-e532-47af-be08-3308cd068a78"). InnerVolumeSpecName "kube-api-access-2jr54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:41:53.646605 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.646554    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff5f20fe-a0e7-45fc-94a6-ee5c20779e0f-kube-api-access-tctz6" (OuterVolumeSpecName: "kube-api-access-tctz6") pod "ff5f20fe-a0e7-45fc-94a6-ee5c20779e0f" (UID: "ff5f20fe-a0e7-45fc-94a6-ee5c20779e0f"). InnerVolumeSpecName "kube-api-access-tctz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:41:53.745444 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.745394    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tctz6\" (UniqueName: \"kubernetes.io/projected/ff5f20fe-a0e7-45fc-94a6-ee5c20779e0f-kube-api-access-tctz6\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:41:53.745590 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:53.745458    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jr54\" (UniqueName: \"kubernetes.io/projected/73505638-e532-47af-be08-3308cd068a78-kube-api-access-2jr54\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:41:54.486135 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:54.486039    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-598f86c9c4-xb7gg" event={"ID":"1eec368a-6393-4300-9972-bb173d2e1c24","Type":"ContainerStarted","Data":"8c9773aadd6beb1d4d12d0c1afe7cab2cdd867bf0c491484bf5d4ddc77c9cecd"}
Jul 08 22:41:54.486135 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:54.486065    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dmhbz"
Jul 08 22:41:54.486135 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:54.486085    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-598f86c9c4-xb7gg" event={"ID":"1eec368a-6393-4300-9972-bb173d2e1c24","Type":"ContainerStarted","Data":"de4b0fc47ad03486626665d0b8a2f679d8a5f0adf2255fbd3a7241c7b74b8405"}
Jul 08 22:41:54.486664 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:54.486327    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5799c685bb-7zbgf"
Jul 08 22:41:54.505963 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:54.505916    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-598f86c9c4-xb7gg" podStartSLOduration=1.052679507 podStartE2EDuration="1.505900584s" totalImagesPullingTime="453.221077ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:41:54.503903471 +0000 UTC m=+718.280638873" watchObservedRunningTime="2026-07-08 22:41:54.505900584 +0000 UTC m=+718.282635984"
Jul 08 22:41:54.530766 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:54.530735    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tkc86"]
Jul 08 22:41:54.530929 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:54.530913    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-tkc86" podUID="bda2d946-7166-48fe-8625-23cb8a39a00d" containerName="authorino" containerID="cri-o://b34e81b03b5ffa6295f386305fdbd6f6d750dd6114ade0f4b90c3c75e4e22606" gracePeriod=30
Jul 08 22:41:54.544909 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:54.544878    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5799c685bb-7zbgf"]
Jul 08 22:41:54.547608 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:54.547579    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5799c685bb-7zbgf"]
Jul 08 22:41:54.574167 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:54.574139    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dmhbz"]
Jul 08 22:41:54.576454 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:54.576431    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dmhbz"]
Jul 08 22:41:54.772470 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:54.772396    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73505638-e532-47af-be08-3308cd068a78" path="/var/lib/kubelet/pods/73505638-e532-47af-be08-3308cd068a78/volumes"
Jul 08 22:41:54.772622 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:54.772603    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff5f20fe-a0e7-45fc-94a6-ee5c20779e0f" path="/var/lib/kubelet/pods/ff5f20fe-a0e7-45fc-94a6-ee5c20779e0f/volumes"
Jul 08 22:41:54.780424 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:54.780402    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tkc86"
Jul 08 22:41:54.955068 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:54.955040    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpsmc\" (UniqueName: \"kubernetes.io/projected/bda2d946-7166-48fe-8625-23cb8a39a00d-kube-api-access-vpsmc\") pod \"bda2d946-7166-48fe-8625-23cb8a39a00d\" (UID: \"bda2d946-7166-48fe-8625-23cb8a39a00d\") "
Jul 08 22:41:54.957252 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:54.957217    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bda2d946-7166-48fe-8625-23cb8a39a00d-kube-api-access-vpsmc" (OuterVolumeSpecName: "kube-api-access-vpsmc") pod "bda2d946-7166-48fe-8625-23cb8a39a00d" (UID: "bda2d946-7166-48fe-8625-23cb8a39a00d"). InnerVolumeSpecName "kube-api-access-vpsmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:41:55.056245 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:55.056219    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpsmc\" (UniqueName: \"kubernetes.io/projected/bda2d946-7166-48fe-8625-23cb8a39a00d-kube-api-access-vpsmc\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:41:55.492071 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:55.491953    2558 generic.go:356] "Generic (PLEG): container finished" podID="bda2d946-7166-48fe-8625-23cb8a39a00d" containerID="b34e81b03b5ffa6295f386305fdbd6f6d750dd6114ade0f4b90c3c75e4e22606" exitCode=0
Jul 08 22:41:55.492071 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:55.491999    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-tkc86"
Jul 08 22:41:55.492071 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:55.492048    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tkc86" event={"ID":"bda2d946-7166-48fe-8625-23cb8a39a00d","Type":"ContainerDied","Data":"b34e81b03b5ffa6295f386305fdbd6f6d750dd6114ade0f4b90c3c75e4e22606"}
Jul 08 22:41:55.492559 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:55.492100    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-tkc86" event={"ID":"bda2d946-7166-48fe-8625-23cb8a39a00d","Type":"ContainerDied","Data":"afd7395228e42efdb6196de3e12c6ca2f63b6fba571bbe884b387f0f909e3762"}
Jul 08 22:41:55.492559 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:55.492123    2558 scope.go:117] "RemoveContainer" containerID="b34e81b03b5ffa6295f386305fdbd6f6d750dd6114ade0f4b90c3c75e4e22606"
Jul 08 22:41:55.501191 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:55.501176    2558 scope.go:117] "RemoveContainer" containerID="b34e81b03b5ffa6295f386305fdbd6f6d750dd6114ade0f4b90c3c75e4e22606"
Jul 08 22:41:55.501472 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:41:55.501453    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b34e81b03b5ffa6295f386305fdbd6f6d750dd6114ade0f4b90c3c75e4e22606\": container with ID starting with b34e81b03b5ffa6295f386305fdbd6f6d750dd6114ade0f4b90c3c75e4e22606 not found: ID does not exist" containerID="b34e81b03b5ffa6295f386305fdbd6f6d750dd6114ade0f4b90c3c75e4e22606"
Jul 08 22:41:55.501531 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:55.501479    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b34e81b03b5ffa6295f386305fdbd6f6d750dd6114ade0f4b90c3c75e4e22606"} err="failed to get container status \"b34e81b03b5ffa6295f386305fdbd6f6d750dd6114ade0f4b90c3c75e4e22606\": rpc error: code = NotFound desc = could not find container \"b34e81b03b5ffa6295f386305fdbd6f6d750dd6114ade0f4b90c3c75e4e22606\": container with ID starting with b34e81b03b5ffa6295f386305fdbd6f6d750dd6114ade0f4b90c3c75e4e22606 not found: ID does not exist"
Jul 08 22:41:55.513108 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:55.513084    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tkc86"]
Jul 08 22:41:55.516871 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:55.516851    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-tkc86"]
Jul 08 22:41:56.777506 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:56.777475    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bda2d946-7166-48fe-8625-23cb8a39a00d" path="/var/lib/kubelet/pods/bda2d946-7166-48fe-8625-23cb8a39a00d/volumes"
Jul 08 22:41:58.911248 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:58.911209    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6fdd45464d-h949w"]
Jul 08 22:41:58.911697 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:58.911549    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bda2d946-7166-48fe-8625-23cb8a39a00d" containerName="authorino"
Jul 08 22:41:58.911697 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:58.911562    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bda2d946-7166-48fe-8625-23cb8a39a00d" containerName="authorino"
Jul 08 22:41:58.911697 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:58.911615    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bda2d946-7166-48fe-8625-23cb8a39a00d" containerName="authorino"
Jul 08 22:41:58.917681 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:58.917651    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fdd45464d-h949w"
Jul 08 22:41:58.924558 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:58.924534    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 22:41:58.924675 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:58.924582    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nqptr\""
Jul 08 22:41:58.924675 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:58.924585    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 22:41:58.927944 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:58.927921    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fdd45464d-h949w"]
Jul 08 22:41:59.091107 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:59.091067    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6rg6\" (UniqueName: \"kubernetes.io/projected/fe314db9-4a38-48f7-8b15-8aeea4b27916-kube-api-access-p6rg6\") pod \"maas-controller-6fdd45464d-h949w\" (UID: \"fe314db9-4a38-48f7-8b15-8aeea4b27916\") " pod="opendatahub/maas-controller-6fdd45464d-h949w"
Jul 08 22:41:59.091278 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:59.091136    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe314db9-4a38-48f7-8b15-8aeea4b27916-webhook-cert\") pod \"maas-controller-6fdd45464d-h949w\" (UID: \"fe314db9-4a38-48f7-8b15-8aeea4b27916\") " pod="opendatahub/maas-controller-6fdd45464d-h949w"
Jul 08 22:41:59.192071 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:59.191994    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe314db9-4a38-48f7-8b15-8aeea4b27916-webhook-cert\") pod \"maas-controller-6fdd45464d-h949w\" (UID: \"fe314db9-4a38-48f7-8b15-8aeea4b27916\") " pod="opendatahub/maas-controller-6fdd45464d-h949w"
Jul 08 22:41:59.192071 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:59.192062    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6rg6\" (UniqueName: \"kubernetes.io/projected/fe314db9-4a38-48f7-8b15-8aeea4b27916-kube-api-access-p6rg6\") pod \"maas-controller-6fdd45464d-h949w\" (UID: \"fe314db9-4a38-48f7-8b15-8aeea4b27916\") " pod="opendatahub/maas-controller-6fdd45464d-h949w"
Jul 08 22:41:59.194565 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:59.194534    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe314db9-4a38-48f7-8b15-8aeea4b27916-webhook-cert\") pod \"maas-controller-6fdd45464d-h949w\" (UID: \"fe314db9-4a38-48f7-8b15-8aeea4b27916\") " pod="opendatahub/maas-controller-6fdd45464d-h949w"
Jul 08 22:41:59.201634 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:59.201612    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6rg6\" (UniqueName: \"kubernetes.io/projected/fe314db9-4a38-48f7-8b15-8aeea4b27916-kube-api-access-p6rg6\") pod \"maas-controller-6fdd45464d-h949w\" (UID: \"fe314db9-4a38-48f7-8b15-8aeea4b27916\") " pod="opendatahub/maas-controller-6fdd45464d-h949w"
Jul 08 22:41:59.228026 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:59.227993    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fdd45464d-h949w"
Jul 08 22:41:59.356598 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:59.356576    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fdd45464d-h949w"]
Jul 08 22:41:59.358967 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:41:59.358935    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe314db9_4a38_48f7_8b15_8aeea4b27916.slice/crio-9e18e84e4058eb9bc9c14da6f2abc981ec4a05b17624e0e36655c76bbbb41263 WatchSource:0}: Error finding container 9e18e84e4058eb9bc9c14da6f2abc981ec4a05b17624e0e36655c76bbbb41263: Status 404 returned error can't find the container with id 9e18e84e4058eb9bc9c14da6f2abc981ec4a05b17624e0e36655c76bbbb41263
Jul 08 22:41:59.510413 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:41:59.510322    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fdd45464d-h949w" event={"ID":"fe314db9-4a38-48f7-8b15-8aeea4b27916","Type":"ContainerStarted","Data":"9e18e84e4058eb9bc9c14da6f2abc981ec4a05b17624e0e36655c76bbbb41263"}
Jul 08 22:42:02.530895 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:02.530858    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fdd45464d-h949w" event={"ID":"fe314db9-4a38-48f7-8b15-8aeea4b27916","Type":"ContainerStarted","Data":"37c1c25faa651f102cf4413aeb190f6df2887bf51826a80cca04fe4fec5d8dc3"}
Jul 08 22:42:02.531353 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:02.531008    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6fdd45464d-h949w"
Jul 08 22:42:02.559791 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:02.559731    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6fdd45464d-h949w" podStartSLOduration=1.969059624 podStartE2EDuration="4.559716048s" totalImagesPullingTime="2.590656424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:42:02.558959906 +0000 UTC m=+726.335695315" watchObservedRunningTime="2026-07-08 22:42:02.559716048 +0000 UTC m=+726.336451433"
Jul 08 22:42:13.336827 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:13.335096    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6fdd45464d-h949w"]
Jul 08 22:42:13.336827 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:13.335404    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6fdd45464d-h949w" podUID="fe314db9-4a38-48f7-8b15-8aeea4b27916" containerName="manager" containerID="cri-o://37c1c25faa651f102cf4413aeb190f6df2887bf51826a80cca04fe4fec5d8dc3" gracePeriod=30
Jul 08 22:42:13.341491 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:13.341458    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6fdd45464d-h949w"
Jul 08 22:42:13.580339 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:13.580309    2558 generic.go:356] "Generic (PLEG): container finished" podID="fe314db9-4a38-48f7-8b15-8aeea4b27916" containerID="37c1c25faa651f102cf4413aeb190f6df2887bf51826a80cca04fe4fec5d8dc3" exitCode=0
Jul 08 22:42:13.580483 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:13.580364    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fdd45464d-h949w" event={"ID":"fe314db9-4a38-48f7-8b15-8aeea4b27916","Type":"ContainerDied","Data":"37c1c25faa651f102cf4413aeb190f6df2887bf51826a80cca04fe4fec5d8dc3"}
Jul 08 22:42:13.580483 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:13.580411    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fdd45464d-h949w" event={"ID":"fe314db9-4a38-48f7-8b15-8aeea4b27916","Type":"ContainerDied","Data":"9e18e84e4058eb9bc9c14da6f2abc981ec4a05b17624e0e36655c76bbbb41263"}
Jul 08 22:42:13.580483 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:13.580437    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e18e84e4058eb9bc9c14da6f2abc981ec4a05b17624e0e36655c76bbbb41263"
Jul 08 22:42:13.585048 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:13.585026    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fdd45464d-h949w"
Jul 08 22:42:13.601150 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:13.601090    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe314db9-4a38-48f7-8b15-8aeea4b27916-webhook-cert\") pod \"fe314db9-4a38-48f7-8b15-8aeea4b27916\" (UID: \"fe314db9-4a38-48f7-8b15-8aeea4b27916\") "
Jul 08 22:42:13.601150 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:13.601134    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6rg6\" (UniqueName: \"kubernetes.io/projected/fe314db9-4a38-48f7-8b15-8aeea4b27916-kube-api-access-p6rg6\") pod \"fe314db9-4a38-48f7-8b15-8aeea4b27916\" (UID: \"fe314db9-4a38-48f7-8b15-8aeea4b27916\") "
Jul 08 22:42:13.603983 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:13.603950    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe314db9-4a38-48f7-8b15-8aeea4b27916-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fe314db9-4a38-48f7-8b15-8aeea4b27916" (UID: "fe314db9-4a38-48f7-8b15-8aeea4b27916"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:42:13.604125 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:13.603988    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe314db9-4a38-48f7-8b15-8aeea4b27916-kube-api-access-p6rg6" (OuterVolumeSpecName: "kube-api-access-p6rg6") pod "fe314db9-4a38-48f7-8b15-8aeea4b27916" (UID: "fe314db9-4a38-48f7-8b15-8aeea4b27916"). InnerVolumeSpecName "kube-api-access-p6rg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:42:13.702208 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:13.702173    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe314db9-4a38-48f7-8b15-8aeea4b27916-webhook-cert\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:42:13.702208 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:13.702202    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6rg6\" (UniqueName: \"kubernetes.io/projected/fe314db9-4a38-48f7-8b15-8aeea4b27916-kube-api-access-p6rg6\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:42:14.584364 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:14.584333    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fdd45464d-h949w"
Jul 08 22:42:14.608159 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:14.608130    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6fdd45464d-h949w"]
Jul 08 22:42:14.615295 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:14.615260    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6fdd45464d-h949w"]
Jul 08 22:42:14.772414 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:14.772383    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe314db9-4a38-48f7-8b15-8aeea4b27916" path="/var/lib/kubelet/pods/fe314db9-4a38-48f7-8b15-8aeea4b27916/volumes"
Jul 08 22:42:35.468191 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:35.468152    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-b7bd46cc6-wkh2j"]
Jul 08 22:42:35.468702 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:35.468614    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe314db9-4a38-48f7-8b15-8aeea4b27916" containerName="manager"
Jul 08 22:42:35.468702 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:35.468632    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe314db9-4a38-48f7-8b15-8aeea4b27916" containerName="manager"
Jul 08 22:42:35.468840 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:35.468717    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe314db9-4a38-48f7-8b15-8aeea4b27916" containerName="manager"
Jul 08 22:42:35.472703 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:35.472683    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b7bd46cc6-wkh2j"
Jul 08 22:42:35.475535 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:35.475502    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 08 22:42:35.475535 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:35.475523    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 22:42:35.475778 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:35.475762    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 22:42:35.476609 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:35.476590    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-l9zqm\""
Jul 08 22:42:35.482066 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:35.482045    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b7bd46cc6-wkh2j"]
Jul 08 22:42:35.588562 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:35.588527    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bda5bb6-b71c-42c5-b233-cd5f18e040fb-maas-api-tls\") pod \"maas-api-b7bd46cc6-wkh2j\" (UID: \"0bda5bb6-b71c-42c5-b233-cd5f18e040fb\") " pod="odh-ai-gateway-infra/maas-api-b7bd46cc6-wkh2j"
Jul 08 22:42:35.588721 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:35.588586    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46dkr\" (UniqueName: \"kubernetes.io/projected/0bda5bb6-b71c-42c5-b233-cd5f18e040fb-kube-api-access-46dkr\") pod \"maas-api-b7bd46cc6-wkh2j\" (UID: \"0bda5bb6-b71c-42c5-b233-cd5f18e040fb\") " pod="odh-ai-gateway-infra/maas-api-b7bd46cc6-wkh2j"
Jul 08 22:42:35.588721 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:35.588653    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bda5bb6-b71c-42c5-b233-cd5f18e040fb-openshift-service-ca\") pod \"maas-api-b7bd46cc6-wkh2j\" (UID: \"0bda5bb6-b71c-42c5-b233-cd5f18e040fb\") " pod="odh-ai-gateway-infra/maas-api-b7bd46cc6-wkh2j"
Jul 08 22:42:35.690054 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:35.690019    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bda5bb6-b71c-42c5-b233-cd5f18e040fb-openshift-service-ca\") pod \"maas-api-b7bd46cc6-wkh2j\" (UID: \"0bda5bb6-b71c-42c5-b233-cd5f18e040fb\") " pod="odh-ai-gateway-infra/maas-api-b7bd46cc6-wkh2j"
Jul 08 22:42:35.690219 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:35.690079    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bda5bb6-b71c-42c5-b233-cd5f18e040fb-maas-api-tls\") pod \"maas-api-b7bd46cc6-wkh2j\" (UID: \"0bda5bb6-b71c-42c5-b233-cd5f18e040fb\") " pod="odh-ai-gateway-infra/maas-api-b7bd46cc6-wkh2j"
Jul 08 22:42:35.690219 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:35.690141    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46dkr\" (UniqueName: \"kubernetes.io/projected/0bda5bb6-b71c-42c5-b233-cd5f18e040fb-kube-api-access-46dkr\") pod \"maas-api-b7bd46cc6-wkh2j\" (UID: \"0bda5bb6-b71c-42c5-b233-cd5f18e040fb\") " pod="odh-ai-gateway-infra/maas-api-b7bd46cc6-wkh2j"
Jul 08 22:42:35.690909 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:35.690819    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bda5bb6-b71c-42c5-b233-cd5f18e040fb-openshift-service-ca\") pod \"maas-api-b7bd46cc6-wkh2j\" (UID: \"0bda5bb6-b71c-42c5-b233-cd5f18e040fb\") " pod="odh-ai-gateway-infra/maas-api-b7bd46cc6-wkh2j"
Jul 08 22:42:35.692614 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:35.692594    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0bda5bb6-b71c-42c5-b233-cd5f18e040fb-maas-api-tls\") pod \"maas-api-b7bd46cc6-wkh2j\" (UID: \"0bda5bb6-b71c-42c5-b233-cd5f18e040fb\") " pod="odh-ai-gateway-infra/maas-api-b7bd46cc6-wkh2j"
Jul 08 22:42:35.701545 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:35.701522    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46dkr\" (UniqueName: \"kubernetes.io/projected/0bda5bb6-b71c-42c5-b233-cd5f18e040fb-kube-api-access-46dkr\") pod \"maas-api-b7bd46cc6-wkh2j\" (UID: \"0bda5bb6-b71c-42c5-b233-cd5f18e040fb\") " pod="odh-ai-gateway-infra/maas-api-b7bd46cc6-wkh2j"
Jul 08 22:42:35.783296 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:35.783227    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b7bd46cc6-wkh2j"
Jul 08 22:42:35.931668 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:35.931640    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b7bd46cc6-wkh2j"]
Jul 08 22:42:35.934905 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:42:35.934859    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bda5bb6_b71c_42c5_b233_cd5f18e040fb.slice/crio-acce2d0cbdd5d458e590eb01ea3e40ec6b81558c50c9cc749d68420ba4626b3b WatchSource:0}: Error finding container acce2d0cbdd5d458e590eb01ea3e40ec6b81558c50c9cc749d68420ba4626b3b: Status 404 returned error can't find the container with id acce2d0cbdd5d458e590eb01ea3e40ec6b81558c50c9cc749d68420ba4626b3b
Jul 08 22:42:36.046314 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:36.046226    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:42:36.121311 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:36.121274    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qd29p"]
Jul 08 22:42:36.124304 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:36.124288    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-qd29p"
Jul 08 22:42:36.126815 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:36.126784    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 08 22:42:36.126938 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:36.126844    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kc6v8\""
Jul 08 22:42:36.134031 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:36.134009    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qd29p"]
Jul 08 22:42:36.195860 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:36.195830    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2csc\" (UniqueName: \"kubernetes.io/projected/5545e99e-04d8-4894-990c-207bf98af8c8-kube-api-access-d2csc\") pod \"payload-pre-processing-7964457696-qd29p\" (UID: \"5545e99e-04d8-4894-990c-207bf98af8c8\") " pod="openshift-ingress/payload-pre-processing-7964457696-qd29p"
Jul 08 22:42:36.196029 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:36.195993    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5545e99e-04d8-4894-990c-207bf98af8c8-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qd29p\" (UID: \"5545e99e-04d8-4894-990c-207bf98af8c8\") " pod="openshift-ingress/payload-pre-processing-7964457696-qd29p"
Jul 08 22:42:36.297127 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:36.297092    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2csc\" (UniqueName: \"kubernetes.io/projected/5545e99e-04d8-4894-990c-207bf98af8c8-kube-api-access-d2csc\") pod \"payload-pre-processing-7964457696-qd29p\" (UID: \"5545e99e-04d8-4894-990c-207bf98af8c8\") " pod="openshift-ingress/payload-pre-processing-7964457696-qd29p"
Jul 08 22:42:36.297273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:36.297142    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5545e99e-04d8-4894-990c-207bf98af8c8-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qd29p\" (UID: \"5545e99e-04d8-4894-990c-207bf98af8c8\") " pod="openshift-ingress/payload-pre-processing-7964457696-qd29p"
Jul 08 22:42:36.297866 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:36.297846    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5545e99e-04d8-4894-990c-207bf98af8c8-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qd29p\" (UID: \"5545e99e-04d8-4894-990c-207bf98af8c8\") " pod="openshift-ingress/payload-pre-processing-7964457696-qd29p"
Jul 08 22:42:36.305902 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:36.305880    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2csc\" (UniqueName: \"kubernetes.io/projected/5545e99e-04d8-4894-990c-207bf98af8c8-kube-api-access-d2csc\") pod \"payload-pre-processing-7964457696-qd29p\" (UID: \"5545e99e-04d8-4894-990c-207bf98af8c8\") " pod="openshift-ingress/payload-pre-processing-7964457696-qd29p"
Jul 08 22:42:36.435846 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:36.435809    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-qd29p"
Jul 08 22:42:36.570046 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:36.569994    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qd29p"]
Jul 08 22:42:36.572051 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:42:36.572021    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5545e99e_04d8_4894_990c_207bf98af8c8.slice/crio-c4e73bc2dc477ddf7a8d73bdd607de948bddb1c1395123dfb54d17ab726261eb WatchSource:0}: Error finding container c4e73bc2dc477ddf7a8d73bdd607de948bddb1c1395123dfb54d17ab726261eb: Status 404 returned error can't find the container with id c4e73bc2dc477ddf7a8d73bdd607de948bddb1c1395123dfb54d17ab726261eb
Jul 08 22:42:36.679763 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:36.679720    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-qd29p" event={"ID":"5545e99e-04d8-4894-990c-207bf98af8c8","Type":"ContainerStarted","Data":"c4e73bc2dc477ddf7a8d73bdd607de948bddb1c1395123dfb54d17ab726261eb"}
Jul 08 22:42:36.681037 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:36.681010    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b7bd46cc6-wkh2j" event={"ID":"0bda5bb6-b71c-42c5-b233-cd5f18e040fb","Type":"ContainerStarted","Data":"acce2d0cbdd5d458e590eb01ea3e40ec6b81558c50c9cc749d68420ba4626b3b"}
Jul 08 22:42:38.692915 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:38.692874    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-qd29p" event={"ID":"5545e99e-04d8-4894-990c-207bf98af8c8","Type":"ContainerStarted","Data":"fbb3c5d158cae8f3da49f1a15b98edd9419c93ac198078d0067b5a5ec36f92d1"}
Jul 08 22:42:38.693359 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:38.693035    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-qd29p"
Jul 08 22:42:38.694573 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:38.694548    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b7bd46cc6-wkh2j" event={"ID":"0bda5bb6-b71c-42c5-b233-cd5f18e040fb","Type":"ContainerStarted","Data":"f0e6f980633ffe61325dcb2f77f973e6931cc5d7f8c44e3cb2ba73c9b380e9a7"}
Jul 08 22:42:38.694954 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:38.694675    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-b7bd46cc6-wkh2j"
Jul 08 22:42:38.717245 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:38.717203    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-qd29p" podStartSLOduration=1.020642511 podStartE2EDuration="2.717189131s" totalImagesPullingTime="1.69654662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:42:38.716023272 +0000 UTC m=+762.492758651" watchObservedRunningTime="2026-07-08 22:42:38.717189131 +0000 UTC m=+762.493924519"
Jul 08 22:42:38.748865 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:38.748823    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-b7bd46cc6-wkh2j" podStartSLOduration=1.413546717 podStartE2EDuration="3.748783063s" totalImagesPullingTime="2.335236346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:42:38.747726806 +0000 UTC m=+762.524462193" watchObservedRunningTime="2026-07-08 22:42:38.748783063 +0000 UTC m=+762.525518451"
Jul 08 22:42:44.704036 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:44.704009    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-b7bd46cc6-wkh2j"
Jul 08 22:42:49.701298 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:42:49.701269    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-qd29p"
Jul 08 22:43:06.750429 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:06.750394    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:43:25.056699 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.056626    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"]
Jul 08 22:43:25.059989 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.059970    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:25.064042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.064014    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 22:43:25.064042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.064031    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 22:43:25.064042 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.064038    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 08 22:43:25.064283 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.064043    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vvz8b\""
Jul 08 22:43:25.071584 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.071561    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"]
Jul 08 22:43:25.200720 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.200688    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bad63d88-ada3-4032-bcfa-c53739cfaf8b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bg5ct\" (UID: \"bad63d88-ada3-4032-bcfa-c53739cfaf8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:25.200720 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.200726    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bad63d88-ada3-4032-bcfa-c53739cfaf8b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bg5ct\" (UID: \"bad63d88-ada3-4032-bcfa-c53739cfaf8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:25.200954 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.200753    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bad63d88-ada3-4032-bcfa-c53739cfaf8b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bg5ct\" (UID: \"bad63d88-ada3-4032-bcfa-c53739cfaf8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:25.200954 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.200856    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bad63d88-ada3-4032-bcfa-c53739cfaf8b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bg5ct\" (UID: \"bad63d88-ada3-4032-bcfa-c53739cfaf8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:25.200954 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.200909    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bad63d88-ada3-4032-bcfa-c53739cfaf8b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bg5ct\" (UID: \"bad63d88-ada3-4032-bcfa-c53739cfaf8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:25.201048 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.200958    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g25mw\" (UniqueName: \"kubernetes.io/projected/bad63d88-ada3-4032-bcfa-c53739cfaf8b-kube-api-access-g25mw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bg5ct\" (UID: \"bad63d88-ada3-4032-bcfa-c53739cfaf8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:25.301444 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.301411    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bad63d88-ada3-4032-bcfa-c53739cfaf8b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bg5ct\" (UID: \"bad63d88-ada3-4032-bcfa-c53739cfaf8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:25.301444 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.301446    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g25mw\" (UniqueName: \"kubernetes.io/projected/bad63d88-ada3-4032-bcfa-c53739cfaf8b-kube-api-access-g25mw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bg5ct\" (UID: \"bad63d88-ada3-4032-bcfa-c53739cfaf8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:25.301664 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.301476    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bad63d88-ada3-4032-bcfa-c53739cfaf8b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bg5ct\" (UID: \"bad63d88-ada3-4032-bcfa-c53739cfaf8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:25.301664 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.301509    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bad63d88-ada3-4032-bcfa-c53739cfaf8b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bg5ct\" (UID: \"bad63d88-ada3-4032-bcfa-c53739cfaf8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:25.301664 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.301550    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bad63d88-ada3-4032-bcfa-c53739cfaf8b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bg5ct\" (UID: \"bad63d88-ada3-4032-bcfa-c53739cfaf8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:25.301664 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.301578    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bad63d88-ada3-4032-bcfa-c53739cfaf8b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bg5ct\" (UID: \"bad63d88-ada3-4032-bcfa-c53739cfaf8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:25.301958 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.301936    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bad63d88-ada3-4032-bcfa-c53739cfaf8b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bg5ct\" (UID: \"bad63d88-ada3-4032-bcfa-c53739cfaf8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:25.302019 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.301954    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bad63d88-ada3-4032-bcfa-c53739cfaf8b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bg5ct\" (UID: \"bad63d88-ada3-4032-bcfa-c53739cfaf8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:25.302019 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.301977    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bad63d88-ada3-4032-bcfa-c53739cfaf8b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bg5ct\" (UID: \"bad63d88-ada3-4032-bcfa-c53739cfaf8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:25.303863 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.303833    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bad63d88-ada3-4032-bcfa-c53739cfaf8b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bg5ct\" (UID: \"bad63d88-ada3-4032-bcfa-c53739cfaf8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:25.304208 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.304186    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bad63d88-ada3-4032-bcfa-c53739cfaf8b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bg5ct\" (UID: \"bad63d88-ada3-4032-bcfa-c53739cfaf8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:25.310563 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.310508    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g25mw\" (UniqueName: \"kubernetes.io/projected/bad63d88-ada3-4032-bcfa-c53739cfaf8b-kube-api-access-g25mw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bg5ct\" (UID: \"bad63d88-ada3-4032-bcfa-c53739cfaf8b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:25.370164 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.370133    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:25.505251 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.505228    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"]
Jul 08 22:43:25.507449 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:43:25.507418    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbad63d88_ada3_4032_bcfa_c53739cfaf8b.slice/crio-89bb9b8f19b239714ad8e393ba5b49ba6e0f44943971fc589b7a6ae2c9df5da1 WatchSource:0}: Error finding container 89bb9b8f19b239714ad8e393ba5b49ba6e0f44943971fc589b7a6ae2c9df5da1: Status 404 returned error can't find the container with id 89bb9b8f19b239714ad8e393ba5b49ba6e0f44943971fc589b7a6ae2c9df5da1
Jul 08 22:43:25.841992 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.841949    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:43:25.910547 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:25.910495    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct" event={"ID":"bad63d88-ada3-4032-bcfa-c53739cfaf8b","Type":"ContainerStarted","Data":"89bb9b8f19b239714ad8e393ba5b49ba6e0f44943971fc589b7a6ae2c9df5da1"}
Jul 08 22:43:26.915967 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:26.915884    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct" event={"ID":"bad63d88-ada3-4032-bcfa-c53739cfaf8b","Type":"ContainerStarted","Data":"0c5d5657469e91507219b45b3a0597e936a2da339e94e6a7d1e5f6618b9e90c8"}
Jul 08 22:43:26.934222 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:26.934165    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct" podStartSLOduration=0.791685917 podStartE2EDuration="1.934149815s" totalImagesPullingTime="1.142463898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:43:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:43:26.932900009 +0000 UTC m=+810.709635394" watchObservedRunningTime="2026-07-08 22:43:26.934149815 +0000 UTC m=+810.710885204"
Jul 08 22:43:35.370672 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:35.370637    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:35.371131 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:35.370695    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:35.383015 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:35.382995    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:35.971600 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:35.971571    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bg5ct"
Jul 08 22:43:36.452994 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.452956    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"]
Jul 08 22:43:36.456726 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.456704    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:36.459188 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.459167    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 08 22:43:36.467391 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.467369    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"]
Jul 08 22:43:36.604963 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.604931    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxnk7\" (UniqueName: \"kubernetes.io/projected/6db9e90c-cf86-4512-acd5-7702c7c36d96-kube-api-access-nxnk7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbwkz\" (UID: \"6db9e90c-cf86-4512-acd5-7702c7c36d96\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:36.604963 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.604971    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6db9e90c-cf86-4512-acd5-7702c7c36d96-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbwkz\" (UID: \"6db9e90c-cf86-4512-acd5-7702c7c36d96\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:36.605183 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.604998    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6db9e90c-cf86-4512-acd5-7702c7c36d96-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbwkz\" (UID: \"6db9e90c-cf86-4512-acd5-7702c7c36d96\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:36.605183 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.605079    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6db9e90c-cf86-4512-acd5-7702c7c36d96-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbwkz\" (UID: \"6db9e90c-cf86-4512-acd5-7702c7c36d96\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:36.605183 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.605150    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6db9e90c-cf86-4512-acd5-7702c7c36d96-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbwkz\" (UID: \"6db9e90c-cf86-4512-acd5-7702c7c36d96\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:36.605288 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.605186    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6db9e90c-cf86-4512-acd5-7702c7c36d96-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbwkz\" (UID: \"6db9e90c-cf86-4512-acd5-7702c7c36d96\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:36.706053 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.705966    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6db9e90c-cf86-4512-acd5-7702c7c36d96-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbwkz\" (UID: \"6db9e90c-cf86-4512-acd5-7702c7c36d96\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:36.706053 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.706003    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6db9e90c-cf86-4512-acd5-7702c7c36d96-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbwkz\" (UID: \"6db9e90c-cf86-4512-acd5-7702c7c36d96\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:36.706273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.706069    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxnk7\" (UniqueName: \"kubernetes.io/projected/6db9e90c-cf86-4512-acd5-7702c7c36d96-kube-api-access-nxnk7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbwkz\" (UID: \"6db9e90c-cf86-4512-acd5-7702c7c36d96\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:36.706273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.706091    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6db9e90c-cf86-4512-acd5-7702c7c36d96-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbwkz\" (UID: \"6db9e90c-cf86-4512-acd5-7702c7c36d96\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:36.706273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.706110    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6db9e90c-cf86-4512-acd5-7702c7c36d96-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbwkz\" (UID: \"6db9e90c-cf86-4512-acd5-7702c7c36d96\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:36.706273 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.706138    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6db9e90c-cf86-4512-acd5-7702c7c36d96-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbwkz\" (UID: \"6db9e90c-cf86-4512-acd5-7702c7c36d96\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:36.706538 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.706517    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6db9e90c-cf86-4512-acd5-7702c7c36d96-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbwkz\" (UID: \"6db9e90c-cf86-4512-acd5-7702c7c36d96\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:36.706591 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.706548    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6db9e90c-cf86-4512-acd5-7702c7c36d96-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbwkz\" (UID: \"6db9e90c-cf86-4512-acd5-7702c7c36d96\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:36.706591 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.706575    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6db9e90c-cf86-4512-acd5-7702c7c36d96-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbwkz\" (UID: \"6db9e90c-cf86-4512-acd5-7702c7c36d96\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:36.708632 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.708596    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6db9e90c-cf86-4512-acd5-7702c7c36d96-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbwkz\" (UID: \"6db9e90c-cf86-4512-acd5-7702c7c36d96\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:36.708725 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.708671    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6db9e90c-cf86-4512-acd5-7702c7c36d96-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbwkz\" (UID: \"6db9e90c-cf86-4512-acd5-7702c7c36d96\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:36.714243 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.714219    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxnk7\" (UniqueName: \"kubernetes.io/projected/6db9e90c-cf86-4512-acd5-7702c7c36d96-kube-api-access-nxnk7\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbwkz\" (UID: \"6db9e90c-cf86-4512-acd5-7702c7c36d96\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:36.767134 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.767108    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:36.909316 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.909294    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"]
Jul 08 22:43:36.911504 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:43:36.911475    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6db9e90c_cf86_4512_acd5_7702c7c36d96.slice/crio-b436bf60e64c322791eccdab302856897db920033598fb42f02b8aa1a9853d48 WatchSource:0}: Error finding container b436bf60e64c322791eccdab302856897db920033598fb42f02b8aa1a9853d48: Status 404 returned error can't find the container with id b436bf60e64c322791eccdab302856897db920033598fb42f02b8aa1a9853d48
Jul 08 22:43:36.965858 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:36.965762    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz" event={"ID":"6db9e90c-cf86-4512-acd5-7702c7c36d96","Type":"ContainerStarted","Data":"b436bf60e64c322791eccdab302856897db920033598fb42f02b8aa1a9853d48"}
Jul 08 22:43:37.647131 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:37.647095    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:43:37.973112 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:37.973029    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz" event={"ID":"6db9e90c-cf86-4512-acd5-7702c7c36d96","Type":"ContainerStarted","Data":"45aa5386338035f38e66fc9c135c492da03c25e12b3a23072aa8745a56d34ad5"}
Jul 08 22:43:37.994975 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:37.994929    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz" podStartSLOduration=1.81386925 podStartE2EDuration="1.994911532s" totalImagesPullingTime="181.042282ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:43:37.994449147 +0000 UTC m=+821.771184538" watchObservedRunningTime="2026-07-08 22:43:37.994911532 +0000 UTC m=+821.771646919"
Jul 08 22:43:45.153160 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.153125    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"]
Jul 08 22:43:45.156680 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.156665    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:45.167016 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.166998    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 08 22:43:45.176925 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.176902    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"]
Jul 08 22:43:45.286179 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.286140    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4394a6c0-1c2f-4179-8e49-28c2b0cfd237-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4\" (UID: \"4394a6c0-1c2f-4179-8e49-28c2b0cfd237\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:45.286343 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.286196    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx6bw\" (UniqueName: \"kubernetes.io/projected/4394a6c0-1c2f-4179-8e49-28c2b0cfd237-kube-api-access-qx6bw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4\" (UID: \"4394a6c0-1c2f-4179-8e49-28c2b0cfd237\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:45.286343 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.286237    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4394a6c0-1c2f-4179-8e49-28c2b0cfd237-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4\" (UID: \"4394a6c0-1c2f-4179-8e49-28c2b0cfd237\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:45.286343 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.286280    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4394a6c0-1c2f-4179-8e49-28c2b0cfd237-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4\" (UID: \"4394a6c0-1c2f-4179-8e49-28c2b0cfd237\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:45.286343 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.286297    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4394a6c0-1c2f-4179-8e49-28c2b0cfd237-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4\" (UID: \"4394a6c0-1c2f-4179-8e49-28c2b0cfd237\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:45.286343 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.286316    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4394a6c0-1c2f-4179-8e49-28c2b0cfd237-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4\" (UID: \"4394a6c0-1c2f-4179-8e49-28c2b0cfd237\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:45.387214 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.387181    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4394a6c0-1c2f-4179-8e49-28c2b0cfd237-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4\" (UID: \"4394a6c0-1c2f-4179-8e49-28c2b0cfd237\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:45.387398 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.387228    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4394a6c0-1c2f-4179-8e49-28c2b0cfd237-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4\" (UID: \"4394a6c0-1c2f-4179-8e49-28c2b0cfd237\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:45.387398 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.387259    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4394a6c0-1c2f-4179-8e49-28c2b0cfd237-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4\" (UID: \"4394a6c0-1c2f-4179-8e49-28c2b0cfd237\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:45.387398 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.387298    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4394a6c0-1c2f-4179-8e49-28c2b0cfd237-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4\" (UID: \"4394a6c0-1c2f-4179-8e49-28c2b0cfd237\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:45.387398 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.387370    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx6bw\" (UniqueName: \"kubernetes.io/projected/4394a6c0-1c2f-4179-8e49-28c2b0cfd237-kube-api-access-qx6bw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4\" (UID: \"4394a6c0-1c2f-4179-8e49-28c2b0cfd237\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:45.387681 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.387402    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4394a6c0-1c2f-4179-8e49-28c2b0cfd237-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4\" (UID: \"4394a6c0-1c2f-4179-8e49-28c2b0cfd237\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:45.387742 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.387686    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4394a6c0-1c2f-4179-8e49-28c2b0cfd237-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4\" (UID: \"4394a6c0-1c2f-4179-8e49-28c2b0cfd237\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:45.387742 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.387728    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4394a6c0-1c2f-4179-8e49-28c2b0cfd237-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4\" (UID: \"4394a6c0-1c2f-4179-8e49-28c2b0cfd237\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:45.387879 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.387823    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4394a6c0-1c2f-4179-8e49-28c2b0cfd237-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4\" (UID: \"4394a6c0-1c2f-4179-8e49-28c2b0cfd237\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:45.389696 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.389676    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4394a6c0-1c2f-4179-8e49-28c2b0cfd237-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4\" (UID: \"4394a6c0-1c2f-4179-8e49-28c2b0cfd237\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:45.389981 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.389965    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4394a6c0-1c2f-4179-8e49-28c2b0cfd237-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4\" (UID: \"4394a6c0-1c2f-4179-8e49-28c2b0cfd237\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:45.397231 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.397211    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx6bw\" (UniqueName: \"kubernetes.io/projected/4394a6c0-1c2f-4179-8e49-28c2b0cfd237-kube-api-access-qx6bw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4\" (UID: \"4394a6c0-1c2f-4179-8e49-28c2b0cfd237\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:45.467695 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.467617    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:45.600411 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:45.600389    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"]
Jul 08 22:43:45.602492 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:43:45.602456    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4394a6c0_1c2f_4179_8e49_28c2b0cfd237.slice/crio-d55401c72cc88764bac4ddcd24406b0377bf9496efe453399ed1a0187c748c6f WatchSource:0}: Error finding container d55401c72cc88764bac4ddcd24406b0377bf9496efe453399ed1a0187c748c6f: Status 404 returned error can't find the container with id d55401c72cc88764bac4ddcd24406b0377bf9496efe453399ed1a0187c748c6f
Jul 08 22:43:46.009226 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:46.009191    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4" event={"ID":"4394a6c0-1c2f-4179-8e49-28c2b0cfd237","Type":"ContainerStarted","Data":"0f1a9f6efc816d630c1c30da38f0a9b54eec1d6d428f28483da6a5c93e005b9d"}
Jul 08 22:43:46.009390 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:46.009268    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4" event={"ID":"4394a6c0-1c2f-4179-8e49-28c2b0cfd237","Type":"ContainerStarted","Data":"d55401c72cc88764bac4ddcd24406b0377bf9496efe453399ed1a0187c748c6f"}
Jul 08 22:43:46.030493 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:46.030446    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4" podStartSLOduration=0.851570587 podStartE2EDuration="1.030432863s" totalImagesPullingTime="178.862276ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:43:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:43:46.029573951 +0000 UTC m=+829.806309351" watchObservedRunningTime="2026-07-08 22:43:46.030432863 +0000 UTC m=+829.807168251"
Jul 08 22:43:46.760206 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:46.760173    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:43:46.773103 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:46.773078    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:46.773254 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:46.773121    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:46.780470 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:46.780440    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:47.025365 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:47.025276    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbwkz"
Jul 08 22:43:55.468053 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:55.468018    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:55.468496 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:55.468080    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:55.480532 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:55.480502    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:43:56.066817 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:43:56.066774    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4"
Jul 08 22:44:05.452265 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:05.452229    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:44:13.335107 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.335075    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"]
Jul 08 22:44:13.340594 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.340573    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:13.343453 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.343432    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 08 22:44:13.349315 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.349293    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"]
Jul 08 22:44:13.419573 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.419536    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/baf56c61-1793-4450-a649-5531bef11456-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7\" (UID: \"baf56c61-1793-4450-a649-5531bef11456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:13.419727 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.419581    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scq8m\" (UniqueName: \"kubernetes.io/projected/baf56c61-1793-4450-a649-5531bef11456-kube-api-access-scq8m\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7\" (UID: \"baf56c61-1793-4450-a649-5531bef11456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:13.419727 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.419627    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/baf56c61-1793-4450-a649-5531bef11456-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7\" (UID: \"baf56c61-1793-4450-a649-5531bef11456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:13.419727 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.419667    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/baf56c61-1793-4450-a649-5531bef11456-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7\" (UID: \"baf56c61-1793-4450-a649-5531bef11456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:13.419727 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.419687    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/baf56c61-1793-4450-a649-5531bef11456-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7\" (UID: \"baf56c61-1793-4450-a649-5531bef11456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:13.419893 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.419732    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/baf56c61-1793-4450-a649-5531bef11456-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7\" (UID: \"baf56c61-1793-4450-a649-5531bef11456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:13.520328 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.520295    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/baf56c61-1793-4450-a649-5531bef11456-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7\" (UID: \"baf56c61-1793-4450-a649-5531bef11456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:13.520466 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.520333    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/baf56c61-1793-4450-a649-5531bef11456-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7\" (UID: \"baf56c61-1793-4450-a649-5531bef11456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:13.520466 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.520359    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scq8m\" (UniqueName: \"kubernetes.io/projected/baf56c61-1793-4450-a649-5531bef11456-kube-api-access-scq8m\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7\" (UID: \"baf56c61-1793-4450-a649-5531bef11456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:13.520466 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.520390    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/baf56c61-1793-4450-a649-5531bef11456-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7\" (UID: \"baf56c61-1793-4450-a649-5531bef11456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:13.520466 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.520430    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/baf56c61-1793-4450-a649-5531bef11456-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7\" (UID: \"baf56c61-1793-4450-a649-5531bef11456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:13.520466 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.520445    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/baf56c61-1793-4450-a649-5531bef11456-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7\" (UID: \"baf56c61-1793-4450-a649-5531bef11456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:13.520893 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.520860    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/baf56c61-1793-4450-a649-5531bef11456-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7\" (UID: \"baf56c61-1793-4450-a649-5531bef11456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:13.520998 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.520876    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/baf56c61-1793-4450-a649-5531bef11456-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7\" (UID: \"baf56c61-1793-4450-a649-5531bef11456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:13.520998 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.520906    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/baf56c61-1793-4450-a649-5531bef11456-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7\" (UID: \"baf56c61-1793-4450-a649-5531bef11456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:13.522830 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.522784    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/baf56c61-1793-4450-a649-5531bef11456-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7\" (UID: \"baf56c61-1793-4450-a649-5531bef11456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:13.523004 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.522988    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/baf56c61-1793-4450-a649-5531bef11456-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7\" (UID: \"baf56c61-1793-4450-a649-5531bef11456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:13.528325 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.528303    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scq8m\" (UniqueName: \"kubernetes.io/projected/baf56c61-1793-4450-a649-5531bef11456-kube-api-access-scq8m\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7\" (UID: \"baf56c61-1793-4450-a649-5531bef11456\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:13.651159 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.651069    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:13.785495 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:13.785467    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"]
Jul 08 22:44:13.787228 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:44:13.787200    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbaf56c61_1793_4450_a649_5531bef11456.slice/crio-2844fcac8df9ada3dce910fa6b5cc33d49c72a6c38b942f10e70d870d9616079 WatchSource:0}: Error finding container 2844fcac8df9ada3dce910fa6b5cc33d49c72a6c38b942f10e70d870d9616079: Status 404 returned error can't find the container with id 2844fcac8df9ada3dce910fa6b5cc33d49c72a6c38b942f10e70d870d9616079
Jul 08 22:44:14.140013 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:14.139973    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7" event={"ID":"baf56c61-1793-4450-a649-5531bef11456","Type":"ContainerStarted","Data":"bcfdc18c005d1e407fda04f3c5e9747233f740756f5385fd427b6f19bbc53452"}
Jul 08 22:44:14.140013 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:14.140020    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7" event={"ID":"baf56c61-1793-4450-a649-5531bef11456","Type":"ContainerStarted","Data":"2844fcac8df9ada3dce910fa6b5cc33d49c72a6c38b942f10e70d870d9616079"}
Jul 08 22:44:14.160385 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:14.160339    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7" podStartSLOduration=0.991934557 podStartE2EDuration="1.160324474s" totalImagesPullingTime="168.389917ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:44:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:44:14.15931921 +0000 UTC m=+857.936054604" watchObservedRunningTime="2026-07-08 22:44:14.160324474 +0000 UTC m=+857.937059863"
Jul 08 22:44:15.750357 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:15.750321    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:44:23.652138 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:23.652101    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:23.652597 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:23.652150    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:23.664353 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:23.664332    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:44:24.197182 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:44:24.197147    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7"
Jul 08 22:45:26.509006 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:45:26.508957    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-598f86c9c4-xb7gg"]
Jul 08 22:45:26.511599 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:45:26.509178    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-598f86c9c4-xb7gg" podUID="1eec368a-6393-4300-9972-bb173d2e1c24" containerName="authorino" containerID="cri-o://8c9773aadd6beb1d4d12d0c1afe7cab2cdd867bf0c491484bf5d4ddc77c9cecd" gracePeriod=30
Jul 08 22:45:26.773426 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:45:26.773369    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-598f86c9c4-xb7gg"
Jul 08 22:45:26.851147 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:45:26.851118    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1eec368a-6393-4300-9972-bb173d2e1c24-tls-cert\") pod \"1eec368a-6393-4300-9972-bb173d2e1c24\" (UID: \"1eec368a-6393-4300-9972-bb173d2e1c24\") "
Jul 08 22:45:26.851305 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:45:26.851240    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fk6tp\" (UniqueName: \"kubernetes.io/projected/1eec368a-6393-4300-9972-bb173d2e1c24-kube-api-access-fk6tp\") pod \"1eec368a-6393-4300-9972-bb173d2e1c24\" (UID: \"1eec368a-6393-4300-9972-bb173d2e1c24\") "
Jul 08 22:45:26.854010 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:45:26.853982    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eec368a-6393-4300-9972-bb173d2e1c24-kube-api-access-fk6tp" (OuterVolumeSpecName: "kube-api-access-fk6tp") pod "1eec368a-6393-4300-9972-bb173d2e1c24" (UID: "1eec368a-6393-4300-9972-bb173d2e1c24"). InnerVolumeSpecName "kube-api-access-fk6tp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:45:26.862420 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:45:26.862399    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1eec368a-6393-4300-9972-bb173d2e1c24-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1eec368a-6393-4300-9972-bb173d2e1c24" (UID: "1eec368a-6393-4300-9972-bb173d2e1c24"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:45:26.952018 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:45:26.951981    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fk6tp\" (UniqueName: \"kubernetes.io/projected/1eec368a-6393-4300-9972-bb173d2e1c24-kube-api-access-fk6tp\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:45:26.952018 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:45:26.952012    2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1eec368a-6393-4300-9972-bb173d2e1c24-tls-cert\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:45:27.484585 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:45:27.484543    2558 generic.go:356] "Generic (PLEG): container finished" podID="1eec368a-6393-4300-9972-bb173d2e1c24" containerID="8c9773aadd6beb1d4d12d0c1afe7cab2cdd867bf0c491484bf5d4ddc77c9cecd" exitCode=0
Jul 08 22:45:27.484779 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:45:27.484603    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-598f86c9c4-xb7gg"
Jul 08 22:45:27.484779 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:45:27.484624    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-598f86c9c4-xb7gg" event={"ID":"1eec368a-6393-4300-9972-bb173d2e1c24","Type":"ContainerDied","Data":"8c9773aadd6beb1d4d12d0c1afe7cab2cdd867bf0c491484bf5d4ddc77c9cecd"}
Jul 08 22:45:27.484779 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:45:27.484679    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-598f86c9c4-xb7gg" event={"ID":"1eec368a-6393-4300-9972-bb173d2e1c24","Type":"ContainerDied","Data":"de4b0fc47ad03486626665d0b8a2f679d8a5f0adf2255fbd3a7241c7b74b8405"}
Jul 08 22:45:27.484779 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:45:27.484698    2558 scope.go:117] "RemoveContainer" containerID="8c9773aadd6beb1d4d12d0c1afe7cab2cdd867bf0c491484bf5d4ddc77c9cecd"
Jul 08 22:45:27.494437 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:45:27.494419    2558 scope.go:117] "RemoveContainer" containerID="8c9773aadd6beb1d4d12d0c1afe7cab2cdd867bf0c491484bf5d4ddc77c9cecd"
Jul 08 22:45:27.494722 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:45:27.494701    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c9773aadd6beb1d4d12d0c1afe7cab2cdd867bf0c491484bf5d4ddc77c9cecd\": container with ID starting with 8c9773aadd6beb1d4d12d0c1afe7cab2cdd867bf0c491484bf5d4ddc77c9cecd not found: ID does not exist" containerID="8c9773aadd6beb1d4d12d0c1afe7cab2cdd867bf0c491484bf5d4ddc77c9cecd"
Jul 08 22:45:27.494882 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:45:27.494727    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c9773aadd6beb1d4d12d0c1afe7cab2cdd867bf0c491484bf5d4ddc77c9cecd"} err="failed to get container status \"8c9773aadd6beb1d4d12d0c1afe7cab2cdd867bf0c491484bf5d4ddc77c9cecd\": rpc error: code = NotFound desc = could not find container \"8c9773aadd6beb1d4d12d0c1afe7cab2cdd867bf0c491484bf5d4ddc77c9cecd\": container with ID starting with 8c9773aadd6beb1d4d12d0c1afe7cab2cdd867bf0c491484bf5d4ddc77c9cecd not found: ID does not exist"
Jul 08 22:45:27.505657 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:45:27.505633    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-598f86c9c4-xb7gg"]
Jul 08 22:45:27.511752 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:45:27.511731    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-598f86c9c4-xb7gg"]
Jul 08 22:45:28.773493 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:45:28.773458    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1eec368a-6393-4300-9972-bb173d2e1c24" path="/var/lib/kubelet/pods/1eec368a-6393-4300-9972-bb173d2e1c24/volumes"
Jul 08 22:45:52.252252 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:45:52.252215    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:46:02.442874 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:02.442834    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:46:12.544905 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:12.544870    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:46:22.845624 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:22.845544    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:46:33.443531 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:33.443487    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:46:37.610555 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:37.610513    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-678658b869-lswll"]
Jul 08 22:46:37.610953 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:37.610890    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eec368a-6393-4300-9972-bb173d2e1c24" containerName="authorino"
Jul 08 22:46:37.610953 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:37.610902    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eec368a-6393-4300-9972-bb173d2e1c24" containerName="authorino"
Jul 08 22:46:37.611023 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:37.610968    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eec368a-6393-4300-9972-bb173d2e1c24" containerName="authorino"
Jul 08 22:46:37.614049 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:37.614032    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-678658b869-lswll"
Jul 08 22:46:37.616862 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:37.616835    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 22:46:37.617762 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:37.617747    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nqptr\""
Jul 08 22:46:37.617848 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:37.617775    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 22:46:37.623666 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:37.623640    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-678658b869-lswll"]
Jul 08 22:46:37.681858 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:37.681794    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99958f87-4620-4350-9eb1-b271041b065f-webhook-cert\") pod \"maas-controller-678658b869-lswll\" (UID: \"99958f87-4620-4350-9eb1-b271041b065f\") " pod="opendatahub/maas-controller-678658b869-lswll"
Jul 08 22:46:37.682055 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:37.681873    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qssms\" (UniqueName: \"kubernetes.io/projected/99958f87-4620-4350-9eb1-b271041b065f-kube-api-access-qssms\") pod \"maas-controller-678658b869-lswll\" (UID: \"99958f87-4620-4350-9eb1-b271041b065f\") " pod="opendatahub/maas-controller-678658b869-lswll"
Jul 08 22:46:37.782969 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:37.782933    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99958f87-4620-4350-9eb1-b271041b065f-webhook-cert\") pod \"maas-controller-678658b869-lswll\" (UID: \"99958f87-4620-4350-9eb1-b271041b065f\") " pod="opendatahub/maas-controller-678658b869-lswll"
Jul 08 22:46:37.783159 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:37.782996    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qssms\" (UniqueName: \"kubernetes.io/projected/99958f87-4620-4350-9eb1-b271041b065f-kube-api-access-qssms\") pod \"maas-controller-678658b869-lswll\" (UID: \"99958f87-4620-4350-9eb1-b271041b065f\") " pod="opendatahub/maas-controller-678658b869-lswll"
Jul 08 22:46:37.785526 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:37.785494    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99958f87-4620-4350-9eb1-b271041b065f-webhook-cert\") pod \"maas-controller-678658b869-lswll\" (UID: \"99958f87-4620-4350-9eb1-b271041b065f\") " pod="opendatahub/maas-controller-678658b869-lswll"
Jul 08 22:46:37.792495 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:37.792474    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qssms\" (UniqueName: \"kubernetes.io/projected/99958f87-4620-4350-9eb1-b271041b065f-kube-api-access-qssms\") pod \"maas-controller-678658b869-lswll\" (UID: \"99958f87-4620-4350-9eb1-b271041b065f\") " pod="opendatahub/maas-controller-678658b869-lswll"
Jul 08 22:46:37.925416 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:37.925330    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-678658b869-lswll"
Jul 08 22:46:38.057858 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:38.057834    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-678658b869-lswll"]
Jul 08 22:46:38.060075 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:46:38.060050    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99958f87_4620_4350_9eb1_b271041b065f.slice/crio-912f73672b0af8a7787a026852ee64eff68bb91fa31d50868accebcf76c0af9c WatchSource:0}: Error finding container 912f73672b0af8a7787a026852ee64eff68bb91fa31d50868accebcf76c0af9c: Status 404 returned error can't find the container with id 912f73672b0af8a7787a026852ee64eff68bb91fa31d50868accebcf76c0af9c
Jul 08 22:46:38.061853 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:38.061836    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 22:46:38.809564 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:38.809536    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-678658b869-lswll" event={"ID":"99958f87-4620-4350-9eb1-b271041b065f","Type":"ContainerStarted","Data":"912f73672b0af8a7787a026852ee64eff68bb91fa31d50868accebcf76c0af9c"}
Jul 08 22:46:39.815550 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:39.815509    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-678658b869-lswll" event={"ID":"99958f87-4620-4350-9eb1-b271041b065f","Type":"ContainerStarted","Data":"61e75c98ed1036ab5f02c6fb6ab940515c24a8e0c765164d47e68ae233d8b3cd"}
Jul 08 22:46:39.815959 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:39.815706    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-678658b869-lswll"
Jul 08 22:46:39.835668 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:39.835622    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-678658b869-lswll" podStartSLOduration=2.117233467 podStartE2EDuration="2.835607657s" totalImagesPullingTime="718.37419ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:46:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:46:39.833766155 +0000 UTC m=+1003.610501543" watchObservedRunningTime="2026-07-08 22:46:39.835607657 +0000 UTC m=+1003.612343090"
Jul 08 22:46:50.824956 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:46:50.824926    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-678658b869-lswll"
Jul 08 22:47:02.741475 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:47:02.741440    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:47:14.742842 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:47:14.742793    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:47:46.755590 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:47:46.755553    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:47:56.047672 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:47:56.047591    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:48:03.836860 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:48:03.836824    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:48:09.448580 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:48:09.448537    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:48:19.154960 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:48:19.154915    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:48:30.745643 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:48:30.745605    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:48:41.034063 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:48:41.034027    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:48:50.936014 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:48:50.935976    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:48:56.732786 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:48:56.732753    2558 scope.go:117] "RemoveContainer" containerID="37c1c25faa651f102cf4413aeb190f6df2887bf51826a80cca04fe4fec5d8dc3"
Jul 08 22:49:12.540650 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:49:12.540618    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:49:23.942505 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:49:23.942350    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:49:46.340775 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:49:46.340739    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:49:57.031075 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:49:57.031044    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:50:12.547588 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:50:12.547550    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:50:21.853246 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:50:21.853210    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:50:32.944071 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:50:32.944035    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:50:42.335963 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:50:42.335928    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:50:51.643452 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:50:51.643370    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:51:17.120998 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:51:17.120963    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528"]
Jul 08 22:51:17.121604 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:51:17.121149    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528" podUID="94f78b47-394e-4ab8-93ab-e092a1240f56" containerName="manager" containerID="cri-o://552831e15597940cc963b5f4c32524424f68fabac6e3a8eca603dd0abcbbe797" gracePeriod=10
Jul 08 22:51:19.184052 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:51:19.184012    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528" podUID="94f78b47-394e-4ab8-93ab-e092a1240f56" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.29:8081/readyz\": dial tcp 10.133.0.29:8081: connect: connection refused"
Jul 08 22:51:19.375298 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:51:19.375273    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528"
Jul 08 22:51:19.483499 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:51:19.483408    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94f78b47-394e-4ab8-93ab-e092a1240f56-extensions-socket-volume\") pod \"94f78b47-394e-4ab8-93ab-e092a1240f56\" (UID: \"94f78b47-394e-4ab8-93ab-e092a1240f56\") "
Jul 08 22:51:19.483499 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:51:19.483445    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9p6jh\" (UniqueName: \"kubernetes.io/projected/94f78b47-394e-4ab8-93ab-e092a1240f56-kube-api-access-9p6jh\") pod \"94f78b47-394e-4ab8-93ab-e092a1240f56\" (UID: \"94f78b47-394e-4ab8-93ab-e092a1240f56\") "
Jul 08 22:51:19.483774 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:51:19.483751    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94f78b47-394e-4ab8-93ab-e092a1240f56-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "94f78b47-394e-4ab8-93ab-e092a1240f56" (UID: "94f78b47-394e-4ab8-93ab-e092a1240f56"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:51:19.485585 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:51:19.485560    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94f78b47-394e-4ab8-93ab-e092a1240f56-kube-api-access-9p6jh" (OuterVolumeSpecName: "kube-api-access-9p6jh") pod "94f78b47-394e-4ab8-93ab-e092a1240f56" (UID: "94f78b47-394e-4ab8-93ab-e092a1240f56"). InnerVolumeSpecName "kube-api-access-9p6jh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:51:19.584856 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:51:19.584819    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94f78b47-394e-4ab8-93ab-e092a1240f56-extensions-socket-volume\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:51:19.584856 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:51:19.584851    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9p6jh\" (UniqueName: \"kubernetes.io/projected/94f78b47-394e-4ab8-93ab-e092a1240f56-kube-api-access-9p6jh\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:51:20.088714 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:51:20.088676    2558 generic.go:356] "Generic (PLEG): container finished" podID="94f78b47-394e-4ab8-93ab-e092a1240f56" containerID="552831e15597940cc963b5f4c32524424f68fabac6e3a8eca603dd0abcbbe797" exitCode=0
Jul 08 22:51:20.088714 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:51:20.088719    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528"
Jul 08 22:51:20.088939 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:51:20.088761    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528" event={"ID":"94f78b47-394e-4ab8-93ab-e092a1240f56","Type":"ContainerDied","Data":"552831e15597940cc963b5f4c32524424f68fabac6e3a8eca603dd0abcbbe797"}
Jul 08 22:51:20.088939 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:51:20.088841    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528" event={"ID":"94f78b47-394e-4ab8-93ab-e092a1240f56","Type":"ContainerDied","Data":"25783156e30d0c02f8ef03f25e1637ec0c97c8bebc7578a44f06b736a993ec8b"}
Jul 08 22:51:20.088939 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:51:20.088871    2558 scope.go:117] "RemoveContainer" containerID="552831e15597940cc963b5f4c32524424f68fabac6e3a8eca603dd0abcbbe797"
Jul 08 22:51:20.104510 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:51:20.104492    2558 scope.go:117] "RemoveContainer" containerID="552831e15597940cc963b5f4c32524424f68fabac6e3a8eca603dd0abcbbe797"
Jul 08 22:51:20.104741 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:51:20.104725    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"552831e15597940cc963b5f4c32524424f68fabac6e3a8eca603dd0abcbbe797\": container with ID starting with 552831e15597940cc963b5f4c32524424f68fabac6e3a8eca603dd0abcbbe797 not found: ID does not exist" containerID="552831e15597940cc963b5f4c32524424f68fabac6e3a8eca603dd0abcbbe797"
Jul 08 22:51:20.104791 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:51:20.104748    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"552831e15597940cc963b5f4c32524424f68fabac6e3a8eca603dd0abcbbe797"} err="failed to get container status \"552831e15597940cc963b5f4c32524424f68fabac6e3a8eca603dd0abcbbe797\": rpc error: code = NotFound desc = could not find container \"552831e15597940cc963b5f4c32524424f68fabac6e3a8eca603dd0abcbbe797\": container with ID starting with 552831e15597940cc963b5f4c32524424f68fabac6e3a8eca603dd0abcbbe797 not found: ID does not exist"
Jul 08 22:51:20.113460 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:51:20.113439    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528"]
Jul 08 22:51:20.119767 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:51:20.119744    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm528"]
Jul 08 22:51:20.772415 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:51:20.772382    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94f78b47-394e-4ab8-93ab-e092a1240f56" path="/var/lib/kubelet/pods/94f78b47-394e-4ab8-93ab-e092a1240f56/volumes"
Jul 08 22:52:18.228562 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:52:18.228487    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jvfxp"]
Jul 08 22:52:18.228970 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:52:18.228845    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94f78b47-394e-4ab8-93ab-e092a1240f56" containerName="manager"
Jul 08 22:52:18.228970 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:52:18.228856    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="94f78b47-394e-4ab8-93ab-e092a1240f56" containerName="manager"
Jul 08 22:52:18.228970 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:52:18.228906    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="94f78b47-394e-4ab8-93ab-e092a1240f56" containerName="manager"
Jul 08 22:52:18.233181 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:52:18.233160    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jvfxp"
Jul 08 22:52:18.235997 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:52:18.235974    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5lldk\""
Jul 08 22:52:18.245549 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:52:18.245530    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jvfxp"]
Jul 08 22:52:18.382693 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:52:18.382664    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vf6b\" (UniqueName: \"kubernetes.io/projected/ce4bce49-2975-4a0c-b87b-de83ee429bef-kube-api-access-7vf6b\") pod \"kuadrant-operator-controller-manager-86878c769f-jvfxp\" (UID: \"ce4bce49-2975-4a0c-b87b-de83ee429bef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jvfxp"
Jul 08 22:52:18.382895 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:52:18.382698    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce4bce49-2975-4a0c-b87b-de83ee429bef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jvfxp\" (UID: \"ce4bce49-2975-4a0c-b87b-de83ee429bef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jvfxp"
Jul 08 22:52:18.483972 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:52:18.483896    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vf6b\" (UniqueName: \"kubernetes.io/projected/ce4bce49-2975-4a0c-b87b-de83ee429bef-kube-api-access-7vf6b\") pod \"kuadrant-operator-controller-manager-86878c769f-jvfxp\" (UID: \"ce4bce49-2975-4a0c-b87b-de83ee429bef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jvfxp"
Jul 08 22:52:18.483972 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:52:18.483933    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce4bce49-2975-4a0c-b87b-de83ee429bef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jvfxp\" (UID: \"ce4bce49-2975-4a0c-b87b-de83ee429bef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jvfxp"
Jul 08 22:52:18.484283 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:52:18.484252    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce4bce49-2975-4a0c-b87b-de83ee429bef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jvfxp\" (UID: \"ce4bce49-2975-4a0c-b87b-de83ee429bef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jvfxp"
Jul 08 22:52:18.495285 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:52:18.495265    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vf6b\" (UniqueName: \"kubernetes.io/projected/ce4bce49-2975-4a0c-b87b-de83ee429bef-kube-api-access-7vf6b\") pod \"kuadrant-operator-controller-manager-86878c769f-jvfxp\" (UID: \"ce4bce49-2975-4a0c-b87b-de83ee429bef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jvfxp"
Jul 08 22:52:18.543555 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:52:18.543532    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jvfxp"
Jul 08 22:52:18.688619 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:52:18.688594    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jvfxp"]
Jul 08 22:52:18.690288 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:52:18.690261    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce4bce49_2975_4a0c_b87b_de83ee429bef.slice/crio-900cafc11a74a3f1886ed04e00390b8ea88c371914cc350059ec1132aba770e7 WatchSource:0}: Error finding container 900cafc11a74a3f1886ed04e00390b8ea88c371914cc350059ec1132aba770e7: Status 404 returned error can't find the container with id 900cafc11a74a3f1886ed04e00390b8ea88c371914cc350059ec1132aba770e7
Jul 08 22:52:19.353233 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:52:19.353203    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jvfxp" event={"ID":"ce4bce49-2975-4a0c-b87b-de83ee429bef","Type":"ContainerStarted","Data":"3017cbcdeed3203ab39892cc8a7191f356f4dc388485c07286819064c754a71c"}
Jul 08 22:52:19.353615 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:52:19.353253    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jvfxp" event={"ID":"ce4bce49-2975-4a0c-b87b-de83ee429bef","Type":"ContainerStarted","Data":"900cafc11a74a3f1886ed04e00390b8ea88c371914cc350059ec1132aba770e7"}
Jul 08 22:52:19.353615 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:52:19.353299    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jvfxp"
Jul 08 22:52:19.375010 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:52:19.374965    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jvfxp" podStartSLOduration=1.374950502 podStartE2EDuration="1.374950502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:52:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:52:19.373639113 +0000 UTC m=+1343.150374513" watchObservedRunningTime="2026-07-08 22:52:19.374950502 +0000 UTC m=+1343.151685891"
Jul 08 22:52:30.360206 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:52:30.360172    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jvfxp"
Jul 08 22:52:39.338341 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:52:39.338302    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:52:48.537474 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:52:48.537441    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:53:01.041571 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:53:01.041537    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:53:09.639399 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:53:09.639362    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:53:19.234071 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:53:19.234039    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:53:28.033589 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:53:28.033553    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:53:38.842538 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:53:38.842505    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:53:48.438502 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:53:48.438419    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:53:58.936211 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:53:58.936175    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:54:09.141206 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:54:09.141172    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:54:20.533448 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:54:20.533416    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:54:28.632207 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:54:28.632174    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:54:46.534548 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:54:46.534514    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:54:55.043246 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:54:55.043212    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:55:04.641505 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:55:04.641475    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:55:16.634524 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:55:16.634483    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:55:30.543329 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:55:30.543296    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:55:42.541064 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:55:42.541025    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:55:51.737888 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:55:51.737851    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:55:59.644038 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:55:59.644002    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:56:09.139706 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:56:09.139668    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:56:18.837344 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:56:18.837305    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:56:31.942740 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:56:31.942695    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:56:40.951916 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:56:40.951880    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:56:50.436975 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:56:50.436897    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:57:02.534022 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:57:02.533976    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:57:14.441286 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:57:14.441247    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:57:23.635318 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:57:23.635284    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:57:36.233574 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:57:36.233535    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:57:48.136057 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:57:48.136026    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:57:58.433992 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:57:58.433952    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:58:11.142096 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:11.142054    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:58:22.843856 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:22.843752    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:58:29.490676 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:29.490643    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d"]
Jul 08 22:58:29.494765 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:29.494741    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d"
Jul 08 22:58:29.497343 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:29.497316    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-1ee383f3-serving-cert\""
Jul 08 22:58:29.501243 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:29.501217    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92r8q\" (UniqueName: \"kubernetes.io/projected/4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e-kube-api-access-92r8q\") pod \"maas-api-e2e-ait-1ee383f3-77977445-5dm7d\" (UID: \"4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d"
Jul 08 22:58:29.501381 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:29.501360    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e-maas-api-tls\") pod \"maas-api-e2e-ait-1ee383f3-77977445-5dm7d\" (UID: \"4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d"
Jul 08 22:58:29.501445 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:29.501422    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e-openshift-service-ca\") pod \"maas-api-e2e-ait-1ee383f3-77977445-5dm7d\" (UID: \"4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d"
Jul 08 22:58:29.507878 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:29.507850    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d"]
Jul 08 22:58:29.602580 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:29.602539    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e-maas-api-tls\") pod \"maas-api-e2e-ait-1ee383f3-77977445-5dm7d\" (UID: \"4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d"
Jul 08 22:58:29.602757 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:29.602619    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e-openshift-service-ca\") pod \"maas-api-e2e-ait-1ee383f3-77977445-5dm7d\" (UID: \"4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d"
Jul 08 22:58:29.602757 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:29.602655    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92r8q\" (UniqueName: \"kubernetes.io/projected/4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e-kube-api-access-92r8q\") pod \"maas-api-e2e-ait-1ee383f3-77977445-5dm7d\" (UID: \"4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d"
Jul 08 22:58:29.603311 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:29.603284    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e-openshift-service-ca\") pod \"maas-api-e2e-ait-1ee383f3-77977445-5dm7d\" (UID: \"4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d"
Jul 08 22:58:29.605352 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:29.605325    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e-maas-api-tls\") pod \"maas-api-e2e-ait-1ee383f3-77977445-5dm7d\" (UID: \"4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d"
Jul 08 22:58:29.613713 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:29.613691    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92r8q\" (UniqueName: \"kubernetes.io/projected/4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e-kube-api-access-92r8q\") pod \"maas-api-e2e-ait-1ee383f3-77977445-5dm7d\" (UID: \"4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d"
Jul 08 22:58:29.808025 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:29.807994    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d"
Jul 08 22:58:29.942768 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:29.942720    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d"]
Jul 08 22:58:29.944699 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:58:29.944673    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb90dd8_a9eb_4be7_874f_6afc2e7ab96e.slice/crio-209a11c41241167a1b0d2779070f89efaa467cbc80054cd38a3284c5d1b2f68f WatchSource:0}: Error finding container 209a11c41241167a1b0d2779070f89efaa467cbc80054cd38a3284c5d1b2f68f: Status 404 returned error can't find the container with id 209a11c41241167a1b0d2779070f89efaa467cbc80054cd38a3284c5d1b2f68f
Jul 08 22:58:29.946036 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:29.946016    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 22:58:30.045330 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:30.045296    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d" event={"ID":"4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e","Type":"ContainerStarted","Data":"209a11c41241167a1b0d2779070f89efaa467cbc80054cd38a3284c5d1b2f68f"}
Jul 08 22:58:31.050769 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:31.050732    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d" event={"ID":"4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e","Type":"ContainerStarted","Data":"b5e34a1708439a34ec46bfa6c6e2e0778d05e075eafa55ed681ce88f832018e6"}
Jul 08 22:58:31.051164 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:31.050821    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d"
Jul 08 22:58:31.068461 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:31.068409    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d" podStartSLOduration=1.573982456 podStartE2EDuration="2.068390212s" totalImagesPullingTime="494.407756ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:58:31.067451597 +0000 UTC m=+1714.844186987" watchObservedRunningTime="2026-07-08 22:58:31.068390212 +0000 UTC m=+1714.845125601"
Jul 08 22:58:33.037612 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:33.037577    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:58:34.929818 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:34.929764    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d"]
Jul 08 22:58:34.930303 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:34.930023    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d" podUID="4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e" containerName="maas-api" containerID="cri-o://b5e34a1708439a34ec46bfa6c6e2e0778d05e075eafa55ed681ce88f832018e6" gracePeriod=30
Jul 08 22:58:35.069515 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:35.069485    2558 generic.go:356] "Generic (PLEG): container finished" podID="4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e" containerID="b5e34a1708439a34ec46bfa6c6e2e0778d05e075eafa55ed681ce88f832018e6" exitCode=0
Jul 08 22:58:35.069657 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:35.069556    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d" event={"ID":"4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e","Type":"ContainerDied","Data":"b5e34a1708439a34ec46bfa6c6e2e0778d05e075eafa55ed681ce88f832018e6"}
Jul 08 22:58:35.180946 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:35.180893    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d"
Jul 08 22:58:35.257272 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:35.257231    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e-openshift-service-ca\") pod \"4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e\" (UID: \"4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e\") "
Jul 08 22:58:35.257411 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:35.257298    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92r8q\" (UniqueName: \"kubernetes.io/projected/4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e-kube-api-access-92r8q\") pod \"4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e\" (UID: \"4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e\") "
Jul 08 22:58:35.257411 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:35.257378    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e-maas-api-tls\") pod \"4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e\" (UID: \"4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e\") "
Jul 08 22:58:35.257627 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:35.257595    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e" (UID: "4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:58:35.259698 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:35.259675    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e" (UID: "4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:58:35.259698 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:35.259681    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e-kube-api-access-92r8q" (OuterVolumeSpecName: "kube-api-access-92r8q") pod "4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e" (UID: "4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e"). InnerVolumeSpecName "kube-api-access-92r8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:58:35.358694 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:35.358665    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e-maas-api-tls\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:58:35.358694 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:35.358693    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e-openshift-service-ca\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:58:35.358694 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:35.358701    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92r8q\" (UniqueName: \"kubernetes.io/projected/4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e-kube-api-access-92r8q\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:58:36.074909 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:36.074880    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d"
Jul 08 22:58:36.075296 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:36.074912    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d" event={"ID":"4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e","Type":"ContainerDied","Data":"209a11c41241167a1b0d2779070f89efaa467cbc80054cd38a3284c5d1b2f68f"}
Jul 08 22:58:36.075296 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:36.074969    2558 scope.go:117] "RemoveContainer" containerID="b5e34a1708439a34ec46bfa6c6e2e0778d05e075eafa55ed681ce88f832018e6"
Jul 08 22:58:36.095215 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:36.095192    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d"]
Jul 08 22:58:36.100466 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:36.100448    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1ee383f3-77977445-5dm7d"]
Jul 08 22:58:36.773621 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:36.773538    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e" path="/var/lib/kubelet/pods/4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e/volumes"
Jul 08 22:58:41.907353 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:41.907315    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf"]
Jul 08 22:58:41.907909 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:41.907888    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e" containerName="maas-api"
Jul 08 22:58:41.908076 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:41.908057    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e" containerName="maas-api"
Jul 08 22:58:41.908215 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:41.908204    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fb90dd8-a9eb-4be7-874f-6afc2e7ab96e" containerName="maas-api"
Jul 08 22:58:41.912653 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:41.912633    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf"
Jul 08 22:58:41.915122 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:41.915100    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-638bd430-serving-cert\""
Jul 08 22:58:41.922237 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:41.922213    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf"]
Jul 08 22:58:42.021002 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:42.020964    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2-openshift-service-ca\") pod \"maas-api-e2e-ait-638bd430-54656fc647-xp7gf\" (UID: \"6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf"
Jul 08 22:58:42.021186 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:42.021016    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2-maas-api-tls\") pod \"maas-api-e2e-ait-638bd430-54656fc647-xp7gf\" (UID: \"6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf"
Jul 08 22:58:42.021186 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:42.021090    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7vrr\" (UniqueName: \"kubernetes.io/projected/6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2-kube-api-access-z7vrr\") pod \"maas-api-e2e-ait-638bd430-54656fc647-xp7gf\" (UID: \"6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf"
Jul 08 22:58:42.122277 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:42.122238    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2-openshift-service-ca\") pod \"maas-api-e2e-ait-638bd430-54656fc647-xp7gf\" (UID: \"6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf"
Jul 08 22:58:42.122277 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:42.122277    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2-maas-api-tls\") pod \"maas-api-e2e-ait-638bd430-54656fc647-xp7gf\" (UID: \"6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf"
Jul 08 22:58:42.122492 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:42.122306    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7vrr\" (UniqueName: \"kubernetes.io/projected/6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2-kube-api-access-z7vrr\") pod \"maas-api-e2e-ait-638bd430-54656fc647-xp7gf\" (UID: \"6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf"
Jul 08 22:58:42.122492 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:58:42.122400    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-serving-cert: secret "maas-api-e2e-ait-638bd430-serving-cert" not found
Jul 08 22:58:42.122492 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:58:42.122461    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2-maas-api-tls podName:6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2 nodeName:}" failed. No retries permitted until 2026-07-08 22:58:42.622444407 +0000 UTC m=+1726.399179773 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2-maas-api-tls") pod "maas-api-e2e-ait-638bd430-54656fc647-xp7gf" (UID: "6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2") : secret "maas-api-e2e-ait-638bd430-serving-cert" not found
Jul 08 22:58:42.122880 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:42.122863    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2-openshift-service-ca\") pod \"maas-api-e2e-ait-638bd430-54656fc647-xp7gf\" (UID: \"6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf"
Jul 08 22:58:42.131074 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:42.131050    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7vrr\" (UniqueName: \"kubernetes.io/projected/6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2-kube-api-access-z7vrr\") pod \"maas-api-e2e-ait-638bd430-54656fc647-xp7gf\" (UID: \"6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf"
Jul 08 22:58:42.626745 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:42.626699    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2-maas-api-tls\") pod \"maas-api-e2e-ait-638bd430-54656fc647-xp7gf\" (UID: \"6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf"
Jul 08 22:58:42.629241 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:42.629209    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2-maas-api-tls\") pod \"maas-api-e2e-ait-638bd430-54656fc647-xp7gf\" (UID: \"6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf"
Jul 08 22:58:42.824166 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:42.824134    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf"
Jul 08 22:58:42.961779 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:42.961755    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf"]
Jul 08 22:58:42.964029 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:58:42.963978    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c3a4ee5_68e1_4a6b_9c46_a1a4d56d3cd2.slice/crio-930cf4f0330f92060dc150fecd8f7dd67e910c59bd185ac7111ed272438339b7 WatchSource:0}: Error finding container 930cf4f0330f92060dc150fecd8f7dd67e910c59bd185ac7111ed272438339b7: Status 404 returned error can't find the container with id 930cf4f0330f92060dc150fecd8f7dd67e910c59bd185ac7111ed272438339b7
Jul 08 22:58:43.109783 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:43.109751    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf" event={"ID":"6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2","Type":"ContainerStarted","Data":"930cf4f0330f92060dc150fecd8f7dd67e910c59bd185ac7111ed272438339b7"}
Jul 08 22:58:43.742418 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:43.739145    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:58:44.116437 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:44.116402    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf" event={"ID":"6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2","Type":"ContainerStarted","Data":"84933b77cee60be2a5e08027bd66a2cc390551cb2a1ecf2d7fcf136bf4b26149"}
Jul 08 22:58:44.116879 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:44.116517    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf"
Jul 08 22:58:44.132051 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:44.132000    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf" podStartSLOduration=2.786267283 podStartE2EDuration="3.131984432s" totalImagesPullingTime="345.717149ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:58:44.130941261 +0000 UTC m=+1727.907676666" watchObservedRunningTime="2026-07-08 22:58:44.131984432 +0000 UTC m=+1727.908719819"
Jul 08 22:58:47.334902 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:47.334871    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf"]
Jul 08 22:58:47.335359 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:47.335092    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf" podUID="6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2" containerName="maas-api" containerID="cri-o://84933b77cee60be2a5e08027bd66a2cc390551cb2a1ecf2d7fcf136bf4b26149" gracePeriod=30
Jul 08 22:58:47.586411 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:47.586350    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf"
Jul 08 22:58:47.675143 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:47.675105    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2-openshift-service-ca\") pod \"6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2\" (UID: \"6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2\") "
Jul 08 22:58:47.675143 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:47.675152    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7vrr\" (UniqueName: \"kubernetes.io/projected/6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2-kube-api-access-z7vrr\") pod \"6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2\" (UID: \"6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2\") "
Jul 08 22:58:47.675385 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:47.675238    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2-maas-api-tls\") pod \"6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2\" (UID: \"6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2\") "
Jul 08 22:58:47.675545 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:47.675520    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2" (UID: "6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:58:47.677486 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:47.677456    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2" (UID: "6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:58:47.677486 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:47.677456    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2-kube-api-access-z7vrr" (OuterVolumeSpecName: "kube-api-access-z7vrr") pod "6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2" (UID: "6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2"). InnerVolumeSpecName "kube-api-access-z7vrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:58:47.776632 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:47.776602    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2-openshift-service-ca\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:58:47.776632 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:47.776627    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7vrr\" (UniqueName: \"kubernetes.io/projected/6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2-kube-api-access-z7vrr\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:58:47.776632 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:47.776636    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2-maas-api-tls\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:58:48.136217 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:48.136183    2558 generic.go:356] "Generic (PLEG): container finished" podID="6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2" containerID="84933b77cee60be2a5e08027bd66a2cc390551cb2a1ecf2d7fcf136bf4b26149" exitCode=0
Jul 08 22:58:48.136392 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:48.136245    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf"
Jul 08 22:58:48.136392 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:48.136276    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf" event={"ID":"6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2","Type":"ContainerDied","Data":"84933b77cee60be2a5e08027bd66a2cc390551cb2a1ecf2d7fcf136bf4b26149"}
Jul 08 22:58:48.136392 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:48.136331    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf" event={"ID":"6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2","Type":"ContainerDied","Data":"930cf4f0330f92060dc150fecd8f7dd67e910c59bd185ac7111ed272438339b7"}
Jul 08 22:58:48.136392 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:48.136353    2558 scope.go:117] "RemoveContainer" containerID="84933b77cee60be2a5e08027bd66a2cc390551cb2a1ecf2d7fcf136bf4b26149"
Jul 08 22:58:48.150889 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:48.150870    2558 scope.go:117] "RemoveContainer" containerID="84933b77cee60be2a5e08027bd66a2cc390551cb2a1ecf2d7fcf136bf4b26149"
Jul 08 22:58:48.151123 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:58:48.151100    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84933b77cee60be2a5e08027bd66a2cc390551cb2a1ecf2d7fcf136bf4b26149\": container with ID starting with 84933b77cee60be2a5e08027bd66a2cc390551cb2a1ecf2d7fcf136bf4b26149 not found: ID does not exist" containerID="84933b77cee60be2a5e08027bd66a2cc390551cb2a1ecf2d7fcf136bf4b26149"
Jul 08 22:58:48.151196 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:48.151135    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84933b77cee60be2a5e08027bd66a2cc390551cb2a1ecf2d7fcf136bf4b26149"} err="failed to get container status \"84933b77cee60be2a5e08027bd66a2cc390551cb2a1ecf2d7fcf136bf4b26149\": rpc error: code = NotFound desc = could not find container \"84933b77cee60be2a5e08027bd66a2cc390551cb2a1ecf2d7fcf136bf4b26149\": container with ID starting with 84933b77cee60be2a5e08027bd66a2cc390551cb2a1ecf2d7fcf136bf4b26149 not found: ID does not exist"
Jul 08 22:58:48.162264 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:48.162233    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf"]
Jul 08 22:58:48.165624 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:48.165605    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-638bd430-54656fc647-xp7gf"]
Jul 08 22:58:48.773348 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:58:48.773319    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2" path="/var/lib/kubelet/pods/6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2/volumes"
Jul 08 22:59:00.200218 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:00.200154    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws"]
Jul 08 22:59:00.200721 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:00.200702    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2" containerName="maas-api"
Jul 08 22:59:00.200819 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:00.200725    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2" containerName="maas-api"
Jul 08 22:59:00.200881 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:00.200857    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c3a4ee5-68e1-4a6b-9c46-a1a4d56d3cd2" containerName="maas-api"
Jul 08 22:59:00.204249 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:00.204228    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws"
Jul 08 22:59:00.206994 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:00.206975    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-b75060c7-serving-cert\""
Jul 08 22:59:00.213599 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:00.213578    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws"]
Jul 08 22:59:00.392723 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:00.392682    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhkhr\" (UniqueName: \"kubernetes.io/projected/1887696f-6189-4337-b1a5-f3b8122e2ed1-kube-api-access-jhkhr\") pod \"maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws\" (UID: \"1887696f-6189-4337-b1a5-f3b8122e2ed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws"
Jul 08 22:59:00.392723 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:00.392719    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1887696f-6189-4337-b1a5-f3b8122e2ed1-openshift-service-ca\") pod \"maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws\" (UID: \"1887696f-6189-4337-b1a5-f3b8122e2ed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws"
Jul 08 22:59:00.393093 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:00.392789    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1887696f-6189-4337-b1a5-f3b8122e2ed1-maas-api-tls\") pod \"maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws\" (UID: \"1887696f-6189-4337-b1a5-f3b8122e2ed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws"
Jul 08 22:59:00.493524 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:00.493408    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhkhr\" (UniqueName: \"kubernetes.io/projected/1887696f-6189-4337-b1a5-f3b8122e2ed1-kube-api-access-jhkhr\") pod \"maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws\" (UID: \"1887696f-6189-4337-b1a5-f3b8122e2ed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws"
Jul 08 22:59:00.493524 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:00.493444    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1887696f-6189-4337-b1a5-f3b8122e2ed1-openshift-service-ca\") pod \"maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws\" (UID: \"1887696f-6189-4337-b1a5-f3b8122e2ed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws"
Jul 08 22:59:00.493524 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:00.493486    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1887696f-6189-4337-b1a5-f3b8122e2ed1-maas-api-tls\") pod \"maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws\" (UID: \"1887696f-6189-4337-b1a5-f3b8122e2ed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws"
Jul 08 22:59:00.494293 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:00.494264    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1887696f-6189-4337-b1a5-f3b8122e2ed1-openshift-service-ca\") pod \"maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws\" (UID: \"1887696f-6189-4337-b1a5-f3b8122e2ed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws"
Jul 08 22:59:00.496065 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:00.496041    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1887696f-6189-4337-b1a5-f3b8122e2ed1-maas-api-tls\") pod \"maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws\" (UID: \"1887696f-6189-4337-b1a5-f3b8122e2ed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws"
Jul 08 22:59:00.502013 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:00.501981    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhkhr\" (UniqueName: \"kubernetes.io/projected/1887696f-6189-4337-b1a5-f3b8122e2ed1-kube-api-access-jhkhr\") pod \"maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws\" (UID: \"1887696f-6189-4337-b1a5-f3b8122e2ed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws"
Jul 08 22:59:00.516333 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:00.516305    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws"
Jul 08 22:59:00.653267 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:00.651977    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws"]
Jul 08 22:59:00.655485 ip-10-0-136-6 kubenswrapper[2558]: W0708 22:59:00.655449    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1887696f_6189_4337_b1a5_f3b8122e2ed1.slice/crio-c42c32ba95604443cd18f0124015da1c224c8013b9331b5a8cc97178d2b5e740 WatchSource:0}: Error finding container c42c32ba95604443cd18f0124015da1c224c8013b9331b5a8cc97178d2b5e740: Status 404 returned error can't find the container with id c42c32ba95604443cd18f0124015da1c224c8013b9331b5a8cc97178d2b5e740
Jul 08 22:59:01.197642 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:01.197600    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws" event={"ID":"1887696f-6189-4337-b1a5-f3b8122e2ed1","Type":"ContainerStarted","Data":"8fa40629d72e94ac52b00b88859ad0c629e6f15b97f82748e4057712257bd063"}
Jul 08 22:59:01.197845 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:01.197670    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws" event={"ID":"1887696f-6189-4337-b1a5-f3b8122e2ed1","Type":"ContainerStarted","Data":"c42c32ba95604443cd18f0124015da1c224c8013b9331b5a8cc97178d2b5e740"}
Jul 08 22:59:01.197845 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:01.197726    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws"
Jul 08 22:59:01.215445 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:01.215388    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws" podStartSLOduration=0.87187033 podStartE2EDuration="1.215368678s" totalImagesPullingTime="343.498348ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:59:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:59:01.214950809 +0000 UTC m=+1744.991686197" watchObservedRunningTime="2026-07-08 22:59:01.215368678 +0000 UTC m=+1744.992104069"
Jul 08 22:59:02.943229 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:02.943200    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 22:59:04.934046 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:04.934014    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws"]
Jul 08 22:59:04.934510 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:04.934240    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws" podUID="1887696f-6189-4337-b1a5-f3b8122e2ed1" containerName="maas-api" containerID="cri-o://8fa40629d72e94ac52b00b88859ad0c629e6f15b97f82748e4057712257bd063" gracePeriod=30
Jul 08 22:59:05.181411 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:05.181389    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws"
Jul 08 22:59:05.217587 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:05.217502    2558 generic.go:356] "Generic (PLEG): container finished" podID="1887696f-6189-4337-b1a5-f3b8122e2ed1" containerID="8fa40629d72e94ac52b00b88859ad0c629e6f15b97f82748e4057712257bd063" exitCode=0
Jul 08 22:59:05.217742 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:05.217597    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws" event={"ID":"1887696f-6189-4337-b1a5-f3b8122e2ed1","Type":"ContainerDied","Data":"8fa40629d72e94ac52b00b88859ad0c629e6f15b97f82748e4057712257bd063"}
Jul 08 22:59:05.217742 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:05.217624    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws"
Jul 08 22:59:05.217742 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:05.217645    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws" event={"ID":"1887696f-6189-4337-b1a5-f3b8122e2ed1","Type":"ContainerDied","Data":"c42c32ba95604443cd18f0124015da1c224c8013b9331b5a8cc97178d2b5e740"}
Jul 08 22:59:05.217742 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:05.217672    2558 scope.go:117] "RemoveContainer" containerID="8fa40629d72e94ac52b00b88859ad0c629e6f15b97f82748e4057712257bd063"
Jul 08 22:59:05.226319 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:05.226303    2558 scope.go:117] "RemoveContainer" containerID="8fa40629d72e94ac52b00b88859ad0c629e6f15b97f82748e4057712257bd063"
Jul 08 22:59:05.226583 ip-10-0-136-6 kubenswrapper[2558]: E0708 22:59:05.226564    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fa40629d72e94ac52b00b88859ad0c629e6f15b97f82748e4057712257bd063\": container with ID starting with 8fa40629d72e94ac52b00b88859ad0c629e6f15b97f82748e4057712257bd063 not found: ID does not exist" containerID="8fa40629d72e94ac52b00b88859ad0c629e6f15b97f82748e4057712257bd063"
Jul 08 22:59:05.226629 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:05.226597    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa40629d72e94ac52b00b88859ad0c629e6f15b97f82748e4057712257bd063"} err="failed to get container status \"8fa40629d72e94ac52b00b88859ad0c629e6f15b97f82748e4057712257bd063\": rpc error: code = NotFound desc = could not find container \"8fa40629d72e94ac52b00b88859ad0c629e6f15b97f82748e4057712257bd063\": container with ID starting with 8fa40629d72e94ac52b00b88859ad0c629e6f15b97f82748e4057712257bd063 not found: ID does not exist"
Jul 08 22:59:05.238029 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:05.238008    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhkhr\" (UniqueName: \"kubernetes.io/projected/1887696f-6189-4337-b1a5-f3b8122e2ed1-kube-api-access-jhkhr\") pod \"1887696f-6189-4337-b1a5-f3b8122e2ed1\" (UID: \"1887696f-6189-4337-b1a5-f3b8122e2ed1\") "
Jul 08 22:59:05.238139 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:05.238098    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1887696f-6189-4337-b1a5-f3b8122e2ed1-maas-api-tls\") pod \"1887696f-6189-4337-b1a5-f3b8122e2ed1\" (UID: \"1887696f-6189-4337-b1a5-f3b8122e2ed1\") "
Jul 08 22:59:05.238139 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:05.238123    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1887696f-6189-4337-b1a5-f3b8122e2ed1-openshift-service-ca\") pod \"1887696f-6189-4337-b1a5-f3b8122e2ed1\" (UID: \"1887696f-6189-4337-b1a5-f3b8122e2ed1\") "
Jul 08 22:59:05.238509 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:05.238485    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1887696f-6189-4337-b1a5-f3b8122e2ed1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1887696f-6189-4337-b1a5-f3b8122e2ed1" (UID: "1887696f-6189-4337-b1a5-f3b8122e2ed1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:59:05.240308 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:05.240277    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1887696f-6189-4337-b1a5-f3b8122e2ed1-kube-api-access-jhkhr" (OuterVolumeSpecName: "kube-api-access-jhkhr") pod "1887696f-6189-4337-b1a5-f3b8122e2ed1" (UID: "1887696f-6189-4337-b1a5-f3b8122e2ed1"). InnerVolumeSpecName "kube-api-access-jhkhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:59:05.240395 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:05.240313    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1887696f-6189-4337-b1a5-f3b8122e2ed1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1887696f-6189-4337-b1a5-f3b8122e2ed1" (UID: "1887696f-6189-4337-b1a5-f3b8122e2ed1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:59:05.339366 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:05.339335    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1887696f-6189-4337-b1a5-f3b8122e2ed1-maas-api-tls\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:59:05.339366 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:05.339362    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1887696f-6189-4337-b1a5-f3b8122e2ed1-openshift-service-ca\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:59:05.339366 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:05.339373    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhkhr\" (UniqueName: \"kubernetes.io/projected/1887696f-6189-4337-b1a5-f3b8122e2ed1-kube-api-access-jhkhr\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 22:59:05.545175 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:05.543359    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws"]
Jul 08 22:59:05.547353 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:05.547331    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b75060c7-6b4d756c4-ks8ws"]
Jul 08 22:59:06.774577 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:06.774496    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1887696f-6189-4337-b1a5-f3b8122e2ed1" path="/var/lib/kubelet/pods/1887696f-6189-4337-b1a5-f3b8122e2ed1/volumes"
Jul 08 22:59:11.542023 ip-10-0-136-6 kubenswrapper[2558]: I0708 22:59:11.541986    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:00:00.134184 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:00.134140    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725860-sxnrj"]
Jul 08 23:00:00.134759 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:00.134664    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1887696f-6189-4337-b1a5-f3b8122e2ed1" containerName="maas-api"
Jul 08 23:00:00.134759 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:00.134685    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1887696f-6189-4337-b1a5-f3b8122e2ed1" containerName="maas-api"
Jul 08 23:00:00.134932 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:00.134780    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1887696f-6189-4337-b1a5-f3b8122e2ed1" containerName="maas-api"
Jul 08 23:00:00.137856 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:00.137833    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-sxnrj"
Jul 08 23:00:00.143752 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:00.143716    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725860-sxnrj"]
Jul 08 23:00:00.228980 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:00.228939    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz58t\" (UniqueName: \"kubernetes.io/projected/23fe5c8a-8854-45f3-b4d8-fff8444c227b-kube-api-access-dz58t\") pod \"maas-api-key-cleanup-29725860-sxnrj\" (UID: \"23fe5c8a-8854-45f3-b4d8-fff8444c227b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-sxnrj"
Jul 08 23:00:00.330289 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:00.330253    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz58t\" (UniqueName: \"kubernetes.io/projected/23fe5c8a-8854-45f3-b4d8-fff8444c227b-kube-api-access-dz58t\") pod \"maas-api-key-cleanup-29725860-sxnrj\" (UID: \"23fe5c8a-8854-45f3-b4d8-fff8444c227b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-sxnrj"
Jul 08 23:00:00.339129 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:00.339100    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz58t\" (UniqueName: \"kubernetes.io/projected/23fe5c8a-8854-45f3-b4d8-fff8444c227b-kube-api-access-dz58t\") pod \"maas-api-key-cleanup-29725860-sxnrj\" (UID: \"23fe5c8a-8854-45f3-b4d8-fff8444c227b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-sxnrj"
Jul 08 23:00:00.449308 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:00.449213    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-sxnrj"
Jul 08 23:00:00.584577 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:00.584548    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725860-sxnrj"]
Jul 08 23:00:00.586910 ip-10-0-136-6 kubenswrapper[2558]: W0708 23:00:00.586881    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23fe5c8a_8854_45f3_b4d8_fff8444c227b.slice/crio-ce21cb9463d4606a7cd554f13d101a384f51c0df2ecd4717fc26dfc46ec6acf7 WatchSource:0}: Error finding container ce21cb9463d4606a7cd554f13d101a384f51c0df2ecd4717fc26dfc46ec6acf7: Status 404 returned error can't find the container with id ce21cb9463d4606a7cd554f13d101a384f51c0df2ecd4717fc26dfc46ec6acf7
Jul 08 23:00:01.476651 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:01.476612    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-sxnrj" event={"ID":"23fe5c8a-8854-45f3-b4d8-fff8444c227b","Type":"ContainerStarted","Data":"ce21cb9463d4606a7cd554f13d101a384f51c0df2ecd4717fc26dfc46ec6acf7"}
Jul 08 23:00:09.521876 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:09.521763    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-sxnrj" event={"ID":"23fe5c8a-8854-45f3-b4d8-fff8444c227b","Type":"ContainerStarted","Data":"5fc70a67366249bc9ce2a3bf1f11773da133478d74b662af96aeec19920e28a9"}
Jul 08 23:00:09.536075 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:09.536023    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-sxnrj" podStartSLOduration=1.282493495 podStartE2EDuration="9.536009063s" totalImagesPullingTime="8.253515568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:00:09.534981145 +0000 UTC m=+1813.311716537" watchObservedRunningTime="2026-07-08 23:00:09.536009063 +0000 UTC m=+1813.312744454"
Jul 08 23:00:33.039487 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:33.039440    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:00:42.237976 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:42.237939    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:00:48.714472 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:48.714441    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf"]
Jul 08 23:00:48.720721 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:48.720705    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf"
Jul 08 23:00:48.723466 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:48.723437    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-014044e8-serving-cert\""
Jul 08 23:00:48.734743 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:48.734721    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf"]
Jul 08 23:00:48.787014 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:48.786982    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q45bv\" (UniqueName: \"kubernetes.io/projected/fb20792c-8f1d-4655-928a-3c41dde8964f-kube-api-access-q45bv\") pod \"maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf\" (UID: \"fb20792c-8f1d-4655-928a-3c41dde8964f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf"
Jul 08 23:00:48.787014 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:48.787017    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb20792c-8f1d-4655-928a-3c41dde8964f-maas-api-tls\") pod \"maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf\" (UID: \"fb20792c-8f1d-4655-928a-3c41dde8964f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf"
Jul 08 23:00:48.787205 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:48.787055    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb20792c-8f1d-4655-928a-3c41dde8964f-openshift-service-ca\") pod \"maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf\" (UID: \"fb20792c-8f1d-4655-928a-3c41dde8964f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf"
Jul 08 23:00:48.888489 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:48.888454    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q45bv\" (UniqueName: \"kubernetes.io/projected/fb20792c-8f1d-4655-928a-3c41dde8964f-kube-api-access-q45bv\") pod \"maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf\" (UID: \"fb20792c-8f1d-4655-928a-3c41dde8964f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf"
Jul 08 23:00:48.888489 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:48.888493    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb20792c-8f1d-4655-928a-3c41dde8964f-maas-api-tls\") pod \"maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf\" (UID: \"fb20792c-8f1d-4655-928a-3c41dde8964f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf"
Jul 08 23:00:48.888754 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:48.888547    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb20792c-8f1d-4655-928a-3c41dde8964f-openshift-service-ca\") pod \"maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf\" (UID: \"fb20792c-8f1d-4655-928a-3c41dde8964f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf"
Jul 08 23:00:48.889267 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:48.889241    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb20792c-8f1d-4655-928a-3c41dde8964f-openshift-service-ca\") pod \"maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf\" (UID: \"fb20792c-8f1d-4655-928a-3c41dde8964f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf"
Jul 08 23:00:48.891256 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:48.891239    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb20792c-8f1d-4655-928a-3c41dde8964f-maas-api-tls\") pod \"maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf\" (UID: \"fb20792c-8f1d-4655-928a-3c41dde8964f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf"
Jul 08 23:00:48.897203 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:48.897171    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q45bv\" (UniqueName: \"kubernetes.io/projected/fb20792c-8f1d-4655-928a-3c41dde8964f-kube-api-access-q45bv\") pod \"maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf\" (UID: \"fb20792c-8f1d-4655-928a-3c41dde8964f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf"
Jul 08 23:00:49.031132 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:49.031030    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf"
Jul 08 23:00:49.166034 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:49.166006    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf"]
Jul 08 23:00:49.167990 ip-10-0-136-6 kubenswrapper[2558]: W0708 23:00:49.167962    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb20792c_8f1d_4655_928a_3c41dde8964f.slice/crio-cfef560bf7e27a85388d82ac6908697f8768704abf620da5045956706884b917 WatchSource:0}: Error finding container cfef560bf7e27a85388d82ac6908697f8768704abf620da5045956706884b917: Status 404 returned error can't find the container with id cfef560bf7e27a85388d82ac6908697f8768704abf620da5045956706884b917
Jul 08 23:00:49.713781 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:49.713750    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf" event={"ID":"fb20792c-8f1d-4655-928a-3c41dde8964f","Type":"ContainerStarted","Data":"cfef560bf7e27a85388d82ac6908697f8768704abf620da5045956706884b917"}
Jul 08 23:00:50.720116 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:50.720080    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf" event={"ID":"fb20792c-8f1d-4655-928a-3c41dde8964f","Type":"ContainerStarted","Data":"8958e19360f895b48b1d506250985204e9383b578fe378abb65e9b1708a73509"}
Jul 08 23:00:50.720481 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:50.720216    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf"
Jul 08 23:00:50.737345 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:50.737304    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf" podStartSLOduration=2.224187328 podStartE2EDuration="2.737290723s" totalImagesPullingTime="513.103395ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:00:50.73602612 +0000 UTC m=+1854.512761528" watchObservedRunningTime="2026-07-08 23:00:50.737290723 +0000 UTC m=+1854.514026110"
Jul 08 23:00:51.341144 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:51.341110    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:00:56.730554 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:00:56.730524    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf"
Jul 08 23:01:00.010076 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:00.010036    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725860-sxnrj"]
Jul 08 23:01:00.010540 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:00.010294    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-sxnrj" podUID="23fe5c8a-8854-45f3-b4d8-fff8444c227b" containerName="cleanup" containerID="cri-o://5fc70a67366249bc9ce2a3bf1f11773da133478d74b662af96aeec19920e28a9" gracePeriod=30
Jul 08 23:01:00.518489 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:00.518457    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf"]
Jul 08 23:01:00.518677 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:00.518656    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf" podUID="fb20792c-8f1d-4655-928a-3c41dde8964f" containerName="maas-api" containerID="cri-o://8958e19360f895b48b1d506250985204e9383b578fe378abb65e9b1708a73509" gracePeriod=30
Jul 08 23:01:00.766006 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:00.765975    2558 generic.go:356] "Generic (PLEG): container finished" podID="fb20792c-8f1d-4655-928a-3c41dde8964f" containerID="8958e19360f895b48b1d506250985204e9383b578fe378abb65e9b1708a73509" exitCode=0
Jul 08 23:01:00.766128 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:00.766033    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf" event={"ID":"fb20792c-8f1d-4655-928a-3c41dde8964f","Type":"ContainerDied","Data":"8958e19360f895b48b1d506250985204e9383b578fe378abb65e9b1708a73509"}
Jul 08 23:01:00.766128 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:00.766080    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf" event={"ID":"fb20792c-8f1d-4655-928a-3c41dde8964f","Type":"ContainerDied","Data":"cfef560bf7e27a85388d82ac6908697f8768704abf620da5045956706884b917"}
Jul 08 23:01:00.766128 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:00.766101    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cfef560bf7e27a85388d82ac6908697f8768704abf620da5045956706884b917"
Jul 08 23:01:00.768660 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:00.768610    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf"
Jul 08 23:01:00.903638 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:00.903612    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q45bv\" (UniqueName: \"kubernetes.io/projected/fb20792c-8f1d-4655-928a-3c41dde8964f-kube-api-access-q45bv\") pod \"fb20792c-8f1d-4655-928a-3c41dde8964f\" (UID: \"fb20792c-8f1d-4655-928a-3c41dde8964f\") "
Jul 08 23:01:00.903638 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:00.903642    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb20792c-8f1d-4655-928a-3c41dde8964f-maas-api-tls\") pod \"fb20792c-8f1d-4655-928a-3c41dde8964f\" (UID: \"fb20792c-8f1d-4655-928a-3c41dde8964f\") "
Jul 08 23:01:00.903865 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:00.903671    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb20792c-8f1d-4655-928a-3c41dde8964f-openshift-service-ca\") pod \"fb20792c-8f1d-4655-928a-3c41dde8964f\" (UID: \"fb20792c-8f1d-4655-928a-3c41dde8964f\") "
Jul 08 23:01:00.904080 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:00.904057    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb20792c-8f1d-4655-928a-3c41dde8964f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fb20792c-8f1d-4655-928a-3c41dde8964f" (UID: "fb20792c-8f1d-4655-928a-3c41dde8964f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:01:00.905859 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:00.905838    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb20792c-8f1d-4655-928a-3c41dde8964f-kube-api-access-q45bv" (OuterVolumeSpecName: "kube-api-access-q45bv") pod "fb20792c-8f1d-4655-928a-3c41dde8964f" (UID: "fb20792c-8f1d-4655-928a-3c41dde8964f"). InnerVolumeSpecName "kube-api-access-q45bv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:01:00.905930 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:00.905911    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb20792c-8f1d-4655-928a-3c41dde8964f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fb20792c-8f1d-4655-928a-3c41dde8964f" (UID: "fb20792c-8f1d-4655-928a-3c41dde8964f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:01:01.004763 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:01.004728    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q45bv\" (UniqueName: \"kubernetes.io/projected/fb20792c-8f1d-4655-928a-3c41dde8964f-kube-api-access-q45bv\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:01:01.004763 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:01.004759    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb20792c-8f1d-4655-928a-3c41dde8964f-maas-api-tls\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:01:01.004763 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:01.004768    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb20792c-8f1d-4655-928a-3c41dde8964f-openshift-service-ca\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:01:01.771895 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:01.771862    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf"
Jul 08 23:01:01.794584 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:01.794557    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf"]
Jul 08 23:01:01.797600 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:01.797579    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-014044e8-74d5dd45cb-2qwsf"]
Jul 08 23:01:02.773711 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:02.773676    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb20792c-8f1d-4655-928a-3c41dde8964f" path="/var/lib/kubelet/pods/fb20792c-8f1d-4655-928a-3c41dde8964f/volumes"
Jul 08 23:01:04.741329 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:04.741297    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:01:28.882971 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:28.882933    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc"]
Jul 08 23:01:28.883575 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:28.883405    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb20792c-8f1d-4655-928a-3c41dde8964f" containerName="maas-api"
Jul 08 23:01:28.883575 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:28.883423    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb20792c-8f1d-4655-928a-3c41dde8964f" containerName="maas-api"
Jul 08 23:01:28.883575 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:28.883511    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb20792c-8f1d-4655-928a-3c41dde8964f" containerName="maas-api"
Jul 08 23:01:28.886426 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:28.886405    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc"
Jul 08 23:01:28.888657 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:28.888635    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-3444d81d-serving-cert\""
Jul 08 23:01:28.896137 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:28.896110    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc"]
Jul 08 23:01:28.956942 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:28.956905    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef12703f-137e-45ef-b70b-1423b8ceb260-openshift-service-ca\") pod \"maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc\" (UID: \"ef12703f-137e-45ef-b70b-1423b8ceb260\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc"
Jul 08 23:01:28.956942 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:28.956940    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef12703f-137e-45ef-b70b-1423b8ceb260-maas-api-tls\") pod \"maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc\" (UID: \"ef12703f-137e-45ef-b70b-1423b8ceb260\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc"
Jul 08 23:01:28.957148 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:28.956999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m284\" (UniqueName: \"kubernetes.io/projected/ef12703f-137e-45ef-b70b-1423b8ceb260-kube-api-access-5m284\") pod \"maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc\" (UID: \"ef12703f-137e-45ef-b70b-1423b8ceb260\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc"
Jul 08 23:01:29.057790 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:29.057753    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef12703f-137e-45ef-b70b-1423b8ceb260-openshift-service-ca\") pod \"maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc\" (UID: \"ef12703f-137e-45ef-b70b-1423b8ceb260\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc"
Jul 08 23:01:29.057790 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:29.057790    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef12703f-137e-45ef-b70b-1423b8ceb260-maas-api-tls\") pod \"maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc\" (UID: \"ef12703f-137e-45ef-b70b-1423b8ceb260\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc"
Jul 08 23:01:29.058006 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:29.057850    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m284\" (UniqueName: \"kubernetes.io/projected/ef12703f-137e-45ef-b70b-1423b8ceb260-kube-api-access-5m284\") pod \"maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc\" (UID: \"ef12703f-137e-45ef-b70b-1423b8ceb260\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc"
Jul 08 23:01:29.058006 ip-10-0-136-6 kubenswrapper[2558]: E0708 23:01:29.057976    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-serving-cert: secret "maas-api-e2e-mt-3444d81d-serving-cert" not found
Jul 08 23:01:29.058071 ip-10-0-136-6 kubenswrapper[2558]: E0708 23:01:29.058039    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef12703f-137e-45ef-b70b-1423b8ceb260-maas-api-tls podName:ef12703f-137e-45ef-b70b-1423b8ceb260 nodeName:}" failed. No retries permitted until 2026-07-08 23:01:29.558023172 +0000 UTC m=+1893.334758541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ef12703f-137e-45ef-b70b-1423b8ceb260-maas-api-tls") pod "maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc" (UID: "ef12703f-137e-45ef-b70b-1423b8ceb260") : secret "maas-api-e2e-mt-3444d81d-serving-cert" not found
Jul 08 23:01:29.058382 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:29.058364    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef12703f-137e-45ef-b70b-1423b8ceb260-openshift-service-ca\") pod \"maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc\" (UID: \"ef12703f-137e-45ef-b70b-1423b8ceb260\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc"
Jul 08 23:01:29.068765 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:29.068730    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m284\" (UniqueName: \"kubernetes.io/projected/ef12703f-137e-45ef-b70b-1423b8ceb260-kube-api-access-5m284\") pod \"maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc\" (UID: \"ef12703f-137e-45ef-b70b-1423b8ceb260\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc"
Jul 08 23:01:29.563509 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:29.563475    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef12703f-137e-45ef-b70b-1423b8ceb260-maas-api-tls\") pod \"maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc\" (UID: \"ef12703f-137e-45ef-b70b-1423b8ceb260\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc"
Jul 08 23:01:29.566064 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:29.566041    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef12703f-137e-45ef-b70b-1423b8ceb260-maas-api-tls\") pod \"maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc\" (UID: \"ef12703f-137e-45ef-b70b-1423b8ceb260\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc"
Jul 08 23:01:29.798313 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:29.798282    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc"
Jul 08 23:01:29.935941 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:29.935915    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc"]
Jul 08 23:01:29.938213 ip-10-0-136-6 kubenswrapper[2558]: W0708 23:01:29.938184    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef12703f_137e_45ef_b70b_1423b8ceb260.slice/crio-c307f83a45d2dda8cd86651073c19cc42e8ae600ea669bc4f13f64256385e000 WatchSource:0}: Error finding container c307f83a45d2dda8cd86651073c19cc42e8ae600ea669bc4f13f64256385e000: Status 404 returned error can't find the container with id c307f83a45d2dda8cd86651073c19cc42e8ae600ea669bc4f13f64256385e000
Jul 08 23:01:30.218963 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:30.218939    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-sxnrj"
Jul 08 23:01:30.271324 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:30.271297    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dz58t\" (UniqueName: \"kubernetes.io/projected/23fe5c8a-8854-45f3-b4d8-fff8444c227b-kube-api-access-dz58t\") pod \"23fe5c8a-8854-45f3-b4d8-fff8444c227b\" (UID: \"23fe5c8a-8854-45f3-b4d8-fff8444c227b\") "
Jul 08 23:01:30.273460 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:30.273431    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23fe5c8a-8854-45f3-b4d8-fff8444c227b-kube-api-access-dz58t" (OuterVolumeSpecName: "kube-api-access-dz58t") pod "23fe5c8a-8854-45f3-b4d8-fff8444c227b" (UID: "23fe5c8a-8854-45f3-b4d8-fff8444c227b"). InnerVolumeSpecName "kube-api-access-dz58t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:01:30.372208 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:30.372123    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dz58t\" (UniqueName: \"kubernetes.io/projected/23fe5c8a-8854-45f3-b4d8-fff8444c227b-kube-api-access-dz58t\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:01:30.905071 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:30.905028    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc" event={"ID":"ef12703f-137e-45ef-b70b-1423b8ceb260","Type":"ContainerStarted","Data":"951a61cddbbcdd52c63ded7838f655c50e2c20d758f13cbc3092e34d23f3d348"}
Jul 08 23:01:30.905253 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:30.905138    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc"
Jul 08 23:01:30.905253 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:30.905163    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc" event={"ID":"ef12703f-137e-45ef-b70b-1423b8ceb260","Type":"ContainerStarted","Data":"c307f83a45d2dda8cd86651073c19cc42e8ae600ea669bc4f13f64256385e000"}
Jul 08 23:01:30.906238 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:30.906221    2558 generic.go:356] "Generic (PLEG): container finished" podID="23fe5c8a-8854-45f3-b4d8-fff8444c227b" containerID="5fc70a67366249bc9ce2a3bf1f11773da133478d74b662af96aeec19920e28a9" exitCode=137
Jul 08 23:01:30.906375 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:30.906253    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-sxnrj" event={"ID":"23fe5c8a-8854-45f3-b4d8-fff8444c227b","Type":"ContainerDied","Data":"5fc70a67366249bc9ce2a3bf1f11773da133478d74b662af96aeec19920e28a9"}
Jul 08 23:01:30.906375 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:30.906275    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-sxnrj"
Jul 08 23:01:30.906375 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:30.906290    2558 scope.go:117] "RemoveContainer" containerID="5fc70a67366249bc9ce2a3bf1f11773da133478d74b662af96aeec19920e28a9"
Jul 08 23:01:30.906375 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:30.906281    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-sxnrj" event={"ID":"23fe5c8a-8854-45f3-b4d8-fff8444c227b","Type":"ContainerDied","Data":"ce21cb9463d4606a7cd554f13d101a384f51c0df2ecd4717fc26dfc46ec6acf7"}
Jul 08 23:01:30.914518 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:30.914502    2558 scope.go:117] "RemoveContainer" containerID="5fc70a67366249bc9ce2a3bf1f11773da133478d74b662af96aeec19920e28a9"
Jul 08 23:01:30.914741 ip-10-0-136-6 kubenswrapper[2558]: E0708 23:01:30.914725    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fc70a67366249bc9ce2a3bf1f11773da133478d74b662af96aeec19920e28a9\": container with ID starting with 5fc70a67366249bc9ce2a3bf1f11773da133478d74b662af96aeec19920e28a9 not found: ID does not exist" containerID="5fc70a67366249bc9ce2a3bf1f11773da133478d74b662af96aeec19920e28a9"
Jul 08 23:01:30.914784 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:30.914748    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fc70a67366249bc9ce2a3bf1f11773da133478d74b662af96aeec19920e28a9"} err="failed to get container status \"5fc70a67366249bc9ce2a3bf1f11773da133478d74b662af96aeec19920e28a9\": rpc error: code = NotFound desc = could not find container \"5fc70a67366249bc9ce2a3bf1f11773da133478d74b662af96aeec19920e28a9\": container with ID starting with 5fc70a67366249bc9ce2a3bf1f11773da133478d74b662af96aeec19920e28a9 not found: ID does not exist"
Jul 08 23:01:30.922016 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:30.921978    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc" podStartSLOduration=2.087065053 podStartE2EDuration="2.921966008s" totalImagesPullingTime="834.900955ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:01:30.920292511 +0000 UTC m=+1894.697027901" watchObservedRunningTime="2026-07-08 23:01:30.921966008 +0000 UTC m=+1894.698701395"
Jul 08 23:01:30.933069 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:30.933026    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725860-sxnrj"]
Jul 08 23:01:30.934925 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:30.934908    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725860-sxnrj"]
Jul 08 23:01:32.773380 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:32.773348    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23fe5c8a-8854-45f3-b4d8-fff8444c227b" path="/var/lib/kubelet/pods/23fe5c8a-8854-45f3-b4d8-fff8444c227b/volumes"
Jul 08 23:01:34.239554 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:34.239522    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:01:36.918105 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:36.918075    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc"
Jul 08 23:01:48.327817 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.327762    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"]
Jul 08 23:01:48.328434 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.328416    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23fe5c8a-8854-45f3-b4d8-fff8444c227b" containerName="cleanup"
Jul 08 23:01:48.328479 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.328439    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="23fe5c8a-8854-45f3-b4d8-fff8444c227b" containerName="cleanup"
Jul 08 23:01:48.328574 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.328563    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="23fe5c8a-8854-45f3-b4d8-fff8444c227b" containerName="cleanup"
Jul 08 23:01:48.333321 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.333304    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:48.336013 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.335991    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-3444d81d\"/\"kube-root-ca.crt\""
Jul 08 23:01:48.336451 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.336418    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-3444d81d\"/\"openshift-service-ca.crt\""
Jul 08 23:01:48.336756 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.336657    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-3444d81d\"/\"default-dockercfg-n5rpq\""
Jul 08 23:01:48.336906 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.336686    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-3444d81d\"/\"e2e-lifecycle-model-3444d81d-kserve-self-signed-certs\""
Jul 08 23:01:48.337765 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.337745    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"]
Jul 08 23:01:48.432757 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.432714    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-model-cache\") pod \"e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") " pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:48.432757 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.432770    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d90dca66-cd20-4671-8d51-ed1684a51211-tls-certs\") pod \"e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") " pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:48.433028 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.432788    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvxhg\" (UniqueName: \"kubernetes.io/projected/d90dca66-cd20-4671-8d51-ed1684a51211-kube-api-access-tvxhg\") pod \"e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") " pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:48.433028 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.432948    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-tmp-dir\") pod \"e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") " pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:48.433028 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.432992    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-home\") pod \"e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") " pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:48.433140 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.433112    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-dshm\") pod \"e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") " pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:48.533973 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.533945    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-tmp-dir\") pod \"e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") " pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:48.534105 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.533977    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-home\") pod \"e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") " pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:48.534105 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.534038    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-dshm\") pod \"e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") " pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:48.534105 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.534069    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-model-cache\") pod \"e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") " pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:48.534105 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.534102    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d90dca66-cd20-4671-8d51-ed1684a51211-tls-certs\") pod \"e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") " pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:48.534282 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.534124    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvxhg\" (UniqueName: \"kubernetes.io/projected/d90dca66-cd20-4671-8d51-ed1684a51211-kube-api-access-tvxhg\") pod \"e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") " pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:48.534456 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.534426    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-tmp-dir\") pod \"e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") " pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:48.534576 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.534488    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-home\") pod \"e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") " pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:48.534576 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.534499    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-model-cache\") pod \"e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") " pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:48.536653 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.536626    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-dshm\") pod \"e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") " pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:48.536906 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.536884    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d90dca66-cd20-4671-8d51-ed1684a51211-tls-certs\") pod \"e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") " pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:48.542109 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.542089    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvxhg\" (UniqueName: \"kubernetes.io/projected/d90dca66-cd20-4671-8d51-ed1684a51211-kube-api-access-tvxhg\") pod \"e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") " pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:48.644508 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.644408    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:48.780297 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.780273    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"]
Jul 08 23:01:48.782042 ip-10-0-136-6 kubenswrapper[2558]: W0708 23:01:48.782013    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd90dca66_cd20_4671_8d51_ed1684a51211.slice/crio-51f2b7b328d00ee03cabbfcbaa85b5576fb7869f8b1a4a6ebcf1352082811977 WatchSource:0}: Error finding container 51f2b7b328d00ee03cabbfcbaa85b5576fb7869f8b1a4a6ebcf1352082811977: Status 404 returned error can't find the container with id 51f2b7b328d00ee03cabbfcbaa85b5576fb7869f8b1a4a6ebcf1352082811977
Jul 08 23:01:48.994418 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.994322    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w" event={"ID":"d90dca66-cd20-4671-8d51-ed1684a51211","Type":"ContainerStarted","Data":"196c920695f61efadde9c5177f5b7b88e561e758ceb1f21ad5737738a10d70e6"}
Jul 08 23:01:48.994418 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:48.994378    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w" event={"ID":"d90dca66-cd20-4671-8d51-ed1684a51211","Type":"ContainerStarted","Data":"51f2b7b328d00ee03cabbfcbaa85b5576fb7869f8b1a4a6ebcf1352082811977"}
Jul 08 23:01:49.010904 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:49.010852    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w" podStartSLOduration=1.010835664 podStartE2EDuration="1.010835664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:01:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:01:49.009213348 +0000 UTC m=+1912.785948738" watchObservedRunningTime="2026-07-08 23:01:49.010835664 +0000 UTC m=+1912.787571051"
Jul 08 23:01:51.843673 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:51.843638    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:01:58.645212 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:58.645173    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:58.645661 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:58.645234    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:58.658276 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:58.658242    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:01:59.058421 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:01:59.058390    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:02:04.241209 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:04.241175    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:02:11.399934 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:11.399891    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc"]
Jul 08 23:02:11.400453 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:11.400155    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc" podUID="ef12703f-137e-45ef-b70b-1423b8ceb260" containerName="maas-api" containerID="cri-o://951a61cddbbcdd52c63ded7838f655c50e2c20d758f13cbc3092e34d23f3d348" gracePeriod=30
Jul 08 23:02:11.648231 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:11.648205    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc"
Jul 08 23:02:11.720912 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:11.720829    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef12703f-137e-45ef-b70b-1423b8ceb260-maas-api-tls\") pod \"ef12703f-137e-45ef-b70b-1423b8ceb260\" (UID: \"ef12703f-137e-45ef-b70b-1423b8ceb260\") "
Jul 08 23:02:11.720912 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:11.720889    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef12703f-137e-45ef-b70b-1423b8ceb260-openshift-service-ca\") pod \"ef12703f-137e-45ef-b70b-1423b8ceb260\" (UID: \"ef12703f-137e-45ef-b70b-1423b8ceb260\") "
Jul 08 23:02:11.721088 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:11.720964    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5m284\" (UniqueName: \"kubernetes.io/projected/ef12703f-137e-45ef-b70b-1423b8ceb260-kube-api-access-5m284\") pod \"ef12703f-137e-45ef-b70b-1423b8ceb260\" (UID: \"ef12703f-137e-45ef-b70b-1423b8ceb260\") "
Jul 08 23:02:11.721236 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:11.721213    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef12703f-137e-45ef-b70b-1423b8ceb260-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ef12703f-137e-45ef-b70b-1423b8ceb260" (UID: "ef12703f-137e-45ef-b70b-1423b8ceb260"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:02:11.723015 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:11.722986    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef12703f-137e-45ef-b70b-1423b8ceb260-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ef12703f-137e-45ef-b70b-1423b8ceb260" (UID: "ef12703f-137e-45ef-b70b-1423b8ceb260"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:02:11.723134 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:11.723059    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef12703f-137e-45ef-b70b-1423b8ceb260-kube-api-access-5m284" (OuterVolumeSpecName: "kube-api-access-5m284") pod "ef12703f-137e-45ef-b70b-1423b8ceb260" (UID: "ef12703f-137e-45ef-b70b-1423b8ceb260"). InnerVolumeSpecName "kube-api-access-5m284". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:02:11.821998 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:11.821975    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m284\" (UniqueName: \"kubernetes.io/projected/ef12703f-137e-45ef-b70b-1423b8ceb260-kube-api-access-5m284\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:02:11.821998 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:11.821997    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef12703f-137e-45ef-b70b-1423b8ceb260-maas-api-tls\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:02:11.821998 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:11.822007    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef12703f-137e-45ef-b70b-1423b8ceb260-openshift-service-ca\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:02:12.108469 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:12.108431    2558 generic.go:356] "Generic (PLEG): container finished" podID="ef12703f-137e-45ef-b70b-1423b8ceb260" containerID="951a61cddbbcdd52c63ded7838f655c50e2c20d758f13cbc3092e34d23f3d348" exitCode=0
Jul 08 23:02:12.108639 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:12.108475    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc"
Jul 08 23:02:12.108639 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:12.108510    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc" event={"ID":"ef12703f-137e-45ef-b70b-1423b8ceb260","Type":"ContainerDied","Data":"951a61cddbbcdd52c63ded7838f655c50e2c20d758f13cbc3092e34d23f3d348"}
Jul 08 23:02:12.108639 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:12.108562    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc" event={"ID":"ef12703f-137e-45ef-b70b-1423b8ceb260","Type":"ContainerDied","Data":"c307f83a45d2dda8cd86651073c19cc42e8ae600ea669bc4f13f64256385e000"}
Jul 08 23:02:12.108639 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:12.108583    2558 scope.go:117] "RemoveContainer" containerID="951a61cddbbcdd52c63ded7838f655c50e2c20d758f13cbc3092e34d23f3d348"
Jul 08 23:02:12.117877 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:12.117856    2558 scope.go:117] "RemoveContainer" containerID="951a61cddbbcdd52c63ded7838f655c50e2c20d758f13cbc3092e34d23f3d348"
Jul 08 23:02:12.118147 ip-10-0-136-6 kubenswrapper[2558]: E0708 23:02:12.118129    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"951a61cddbbcdd52c63ded7838f655c50e2c20d758f13cbc3092e34d23f3d348\": container with ID starting with 951a61cddbbcdd52c63ded7838f655c50e2c20d758f13cbc3092e34d23f3d348 not found: ID does not exist" containerID="951a61cddbbcdd52c63ded7838f655c50e2c20d758f13cbc3092e34d23f3d348"
Jul 08 23:02:12.118194 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:12.118157    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"951a61cddbbcdd52c63ded7838f655c50e2c20d758f13cbc3092e34d23f3d348"} err="failed to get container status \"951a61cddbbcdd52c63ded7838f655c50e2c20d758f13cbc3092e34d23f3d348\": rpc error: code = NotFound desc = could not find container \"951a61cddbbcdd52c63ded7838f655c50e2c20d758f13cbc3092e34d23f3d348\": container with ID starting with 951a61cddbbcdd52c63ded7838f655c50e2c20d758f13cbc3092e34d23f3d348 not found: ID does not exist"
Jul 08 23:02:12.128917 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:12.128895    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc"]
Jul 08 23:02:12.132166 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:12.132145    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3444d81d-67f5d858f6-h65vc"]
Jul 08 23:02:12.772878 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:12.772840    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef12703f-137e-45ef-b70b-1423b8ceb260" path="/var/lib/kubelet/pods/ef12703f-137e-45ef-b70b-1423b8ceb260/volumes"
Jul 08 23:02:15.136555 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:15.136522    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:02:21.749543 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:21.749508    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"]
Jul 08 23:02:27.634256 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:27.634217    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:02:36.771446 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:36.771380    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w" podUID="d90dca66-cd20-4671-8d51-ed1684a51211" containerName="main" containerID="cri-o://196c920695f61efadde9c5177f5b7b88e561e758ceb1f21ad5737738a10d70e6" gracePeriod=45
Jul 08 23:02:37.039188 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.039119    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:02:37.155046 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.155020    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-home\") pod \"d90dca66-cd20-4671-8d51-ed1684a51211\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") "
Jul 08 23:02:37.155215 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.155056    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvxhg\" (UniqueName: \"kubernetes.io/projected/d90dca66-cd20-4671-8d51-ed1684a51211-kube-api-access-tvxhg\") pod \"d90dca66-cd20-4671-8d51-ed1684a51211\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") "
Jul 08 23:02:37.155215 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.155081    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-dshm\") pod \"d90dca66-cd20-4671-8d51-ed1684a51211\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") "
Jul 08 23:02:37.155215 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.155160    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-model-cache\") pod \"d90dca66-cd20-4671-8d51-ed1684a51211\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") "
Jul 08 23:02:37.155215 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.155195    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d90dca66-cd20-4671-8d51-ed1684a51211-tls-certs\") pod \"d90dca66-cd20-4671-8d51-ed1684a51211\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") "
Jul 08 23:02:37.155427 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.155242    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-tmp-dir\") pod \"d90dca66-cd20-4671-8d51-ed1684a51211\" (UID: \"d90dca66-cd20-4671-8d51-ed1684a51211\") "
Jul 08 23:02:37.155427 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.155323    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-home" (OuterVolumeSpecName: "home") pod "d90dca66-cd20-4671-8d51-ed1684a51211" (UID: "d90dca66-cd20-4671-8d51-ed1684a51211"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:02:37.155553 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.155532    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-home\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:02:37.155602 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.155528    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-model-cache" (OuterVolumeSpecName: "model-cache") pod "d90dca66-cd20-4671-8d51-ed1684a51211" (UID: "d90dca66-cd20-4671-8d51-ed1684a51211"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:02:37.155670 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.155649    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d90dca66-cd20-4671-8d51-ed1684a51211" (UID: "d90dca66-cd20-4671-8d51-ed1684a51211"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:02:37.157440 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.157418    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-dshm" (OuterVolumeSpecName: "dshm") pod "d90dca66-cd20-4671-8d51-ed1684a51211" (UID: "d90dca66-cd20-4671-8d51-ed1684a51211"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:02:37.157440 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.157423    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d90dca66-cd20-4671-8d51-ed1684a51211-kube-api-access-tvxhg" (OuterVolumeSpecName: "kube-api-access-tvxhg") pod "d90dca66-cd20-4671-8d51-ed1684a51211" (UID: "d90dca66-cd20-4671-8d51-ed1684a51211"). InnerVolumeSpecName "kube-api-access-tvxhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:02:37.157592 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.157493    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d90dca66-cd20-4671-8d51-ed1684a51211-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d90dca66-cd20-4671-8d51-ed1684a51211" (UID: "d90dca66-cd20-4671-8d51-ed1684a51211"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:02:37.226767 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.226742    2558 generic.go:356] "Generic (PLEG): container finished" podID="d90dca66-cd20-4671-8d51-ed1684a51211" containerID="196c920695f61efadde9c5177f5b7b88e561e758ceb1f21ad5737738a10d70e6" exitCode=0
Jul 08 23:02:37.226908 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.226783    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w" event={"ID":"d90dca66-cd20-4671-8d51-ed1684a51211","Type":"ContainerDied","Data":"196c920695f61efadde9c5177f5b7b88e561e758ceb1f21ad5737738a10d70e6"}
Jul 08 23:02:37.226908 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.226787    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"
Jul 08 23:02:37.226908 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.226835    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w" event={"ID":"d90dca66-cd20-4671-8d51-ed1684a51211","Type":"ContainerDied","Data":"51f2b7b328d00ee03cabbfcbaa85b5576fb7869f8b1a4a6ebcf1352082811977"}
Jul 08 23:02:37.226908 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.226852    2558 scope.go:117] "RemoveContainer" containerID="196c920695f61efadde9c5177f5b7b88e561e758ceb1f21ad5737738a10d70e6"
Jul 08 23:02:37.235964 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.235949    2558 scope.go:117] "RemoveContainer" containerID="196c920695f61efadde9c5177f5b7b88e561e758ceb1f21ad5737738a10d70e6"
Jul 08 23:02:37.236212 ip-10-0-136-6 kubenswrapper[2558]: E0708 23:02:37.236189    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"196c920695f61efadde9c5177f5b7b88e561e758ceb1f21ad5737738a10d70e6\": container with ID starting with 196c920695f61efadde9c5177f5b7b88e561e758ceb1f21ad5737738a10d70e6 not found: ID does not exist" containerID="196c920695f61efadde9c5177f5b7b88e561e758ceb1f21ad5737738a10d70e6"
Jul 08 23:02:37.236269 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.236218    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"196c920695f61efadde9c5177f5b7b88e561e758ceb1f21ad5737738a10d70e6"} err="failed to get container status \"196c920695f61efadde9c5177f5b7b88e561e758ceb1f21ad5737738a10d70e6\": rpc error: code = NotFound desc = could not find container \"196c920695f61efadde9c5177f5b7b88e561e758ceb1f21ad5737738a10d70e6\": container with ID starting with 196c920695f61efadde9c5177f5b7b88e561e758ceb1f21ad5737738a10d70e6 not found: ID does not exist"
Jul 08 23:02:37.247556 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.247532    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"]
Jul 08 23:02:37.251290 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.251272    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-3444d81d/e2e-lifecycle-model-3444d81d-kserve-dc57ff95-l9m9w"]
Jul 08 23:02:37.256790 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.256771    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-model-cache\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:02:37.256790 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.256792    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d90dca66-cd20-4671-8d51-ed1684a51211-tls-certs\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:02:37.256942 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.256821    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-tmp-dir\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:02:37.256942 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.256830    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvxhg\" (UniqueName: \"kubernetes.io/projected/d90dca66-cd20-4671-8d51-ed1684a51211-kube-api-access-tvxhg\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:02:37.256942 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:37.256839    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d90dca66-cd20-4671-8d51-ed1684a51211-dshm\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:02:38.773140 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:02:38.773108    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d90dca66-cd20-4671-8d51-ed1684a51211" path="/var/lib/kubelet/pods/d90dca66-cd20-4671-8d51-ed1684a51211/volumes"
Jul 08 23:03:01.434206 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:03:01.434167    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:03:14.735449 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:03:14.735414    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:03:24.333877 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:03:24.333836    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:04:01.953095 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:01.953057    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4"]
Jul 08 23:04:01.953576 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:01.953443    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d90dca66-cd20-4671-8d51-ed1684a51211" containerName="main"
Jul 08 23:04:01.953576 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:01.953460    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d90dca66-cd20-4671-8d51-ed1684a51211" containerName="main"
Jul 08 23:04:01.953576 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:01.953472    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef12703f-137e-45ef-b70b-1423b8ceb260" containerName="maas-api"
Jul 08 23:04:01.953576 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:01.953478    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef12703f-137e-45ef-b70b-1423b8ceb260" containerName="maas-api"
Jul 08 23:04:01.953576 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:01.953550    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef12703f-137e-45ef-b70b-1423b8ceb260" containerName="maas-api"
Jul 08 23:04:01.953576 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:01.953564    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d90dca66-cd20-4671-8d51-ed1684a51211" containerName="main"
Jul 08 23:04:01.956314 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:01.956293    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4"
Jul 08 23:04:01.959945 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:01.959925    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-7a2631-serving-cert\""
Jul 08 23:04:01.967389 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:01.967366    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4"]
Jul 08 23:04:02.107352 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:02.107315    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d629306-e1fb-4fbd-bde1-7f47fd0f640c-maas-api-tls\") pod \"maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4\" (UID: \"9d629306-e1fb-4fbd-bde1-7f47fd0f640c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4"
Jul 08 23:04:02.107551 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:02.107365    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4xzv\" (UniqueName: \"kubernetes.io/projected/9d629306-e1fb-4fbd-bde1-7f47fd0f640c-kube-api-access-c4xzv\") pod \"maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4\" (UID: \"9d629306-e1fb-4fbd-bde1-7f47fd0f640c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4"
Jul 08 23:04:02.107551 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:02.107435    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d629306-e1fb-4fbd-bde1-7f47fd0f640c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4\" (UID: \"9d629306-e1fb-4fbd-bde1-7f47fd0f640c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4"
Jul 08 23:04:02.208770 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:02.208682    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d629306-e1fb-4fbd-bde1-7f47fd0f640c-maas-api-tls\") pod \"maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4\" (UID: \"9d629306-e1fb-4fbd-bde1-7f47fd0f640c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4"
Jul 08 23:04:02.208770 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:02.208728    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4xzv\" (UniqueName: \"kubernetes.io/projected/9d629306-e1fb-4fbd-bde1-7f47fd0f640c-kube-api-access-c4xzv\") pod \"maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4\" (UID: \"9d629306-e1fb-4fbd-bde1-7f47fd0f640c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4"
Jul 08 23:04:02.208994 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:02.208776    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d629306-e1fb-4fbd-bde1-7f47fd0f640c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4\" (UID: \"9d629306-e1fb-4fbd-bde1-7f47fd0f640c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4"
Jul 08 23:04:02.209491 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:02.209469    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d629306-e1fb-4fbd-bde1-7f47fd0f640c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4\" (UID: \"9d629306-e1fb-4fbd-bde1-7f47fd0f640c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4"
Jul 08 23:04:02.211355 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:02.211333    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d629306-e1fb-4fbd-bde1-7f47fd0f640c-maas-api-tls\") pod \"maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4\" (UID: \"9d629306-e1fb-4fbd-bde1-7f47fd0f640c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4"
Jul 08 23:04:02.216872 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:02.216846    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4xzv\" (UniqueName: \"kubernetes.io/projected/9d629306-e1fb-4fbd-bde1-7f47fd0f640c-kube-api-access-c4xzv\") pod \"maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4\" (UID: \"9d629306-e1fb-4fbd-bde1-7f47fd0f640c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4"
Jul 08 23:04:02.267776 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:02.267743    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4"
Jul 08 23:04:02.414694 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:02.414670    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4"]
Jul 08 23:04:02.416976 ip-10-0-136-6 kubenswrapper[2558]: W0708 23:04:02.416945    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d629306_e1fb_4fbd_bde1_7f47fd0f640c.slice/crio-949af287ddf24b9741c09bcb8753ddcb17b9123c7780f188b659a878ecd9a2ed WatchSource:0}: Error finding container 949af287ddf24b9741c09bcb8753ddcb17b9123c7780f188b659a878ecd9a2ed: Status 404 returned error can't find the container with id 949af287ddf24b9741c09bcb8753ddcb17b9123c7780f188b659a878ecd9a2ed
Jul 08 23:04:02.418253 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:02.418237    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 23:04:02.647654 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:02.647617    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4" event={"ID":"9d629306-e1fb-4fbd-bde1-7f47fd0f640c","Type":"ContainerStarted","Data":"949af287ddf24b9741c09bcb8753ddcb17b9123c7780f188b659a878ecd9a2ed"}
Jul 08 23:04:03.653590 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:03.653552    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4" event={"ID":"9d629306-e1fb-4fbd-bde1-7f47fd0f640c","Type":"ContainerStarted","Data":"32bfbff9e40eb60fe86a5693762e25e73fafa381f47acae6a408c995fdcbd36a"}
Jul 08 23:04:03.654050 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:03.653666    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4"
Jul 08 23:04:03.670019 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:03.669966    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4" podStartSLOduration=2.198603826 podStartE2EDuration="2.669950276s" totalImagesPullingTime="471.34645ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:04:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:04:03.66846382 +0000 UTC m=+2047.445199207" watchObservedRunningTime="2026-07-08 23:04:03.669950276 +0000 UTC m=+2047.446685664"
Jul 08 23:04:09.336579 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:09.336538    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:04:09.664728 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:09.664646    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4"
Jul 08 23:04:09.947198 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:09.947121    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv"]
Jul 08 23:04:09.950722 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:09.950706    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv"
Jul 08 23:04:09.954186 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:09.954162    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-e37dc7-serving-cert\""
Jul 08 23:04:09.959550 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:09.959526    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv"]
Jul 08 23:04:10.088379 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:10.088340    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e7583ec-eee2-4770-9db1-491dd3eae34c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv\" (UID: \"6e7583ec-eee2-4770-9db1-491dd3eae34c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv"
Jul 08 23:04:10.088600 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:10.088391    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e7583ec-eee2-4770-9db1-491dd3eae34c-maas-api-tls\") pod \"maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv\" (UID: \"6e7583ec-eee2-4770-9db1-491dd3eae34c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv"
Jul 08 23:04:10.088600 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:10.088494    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbwc6\" (UniqueName: \"kubernetes.io/projected/6e7583ec-eee2-4770-9db1-491dd3eae34c-kube-api-access-gbwc6\") pod \"maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv\" (UID: \"6e7583ec-eee2-4770-9db1-491dd3eae34c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv"
Jul 08 23:04:10.189724 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:10.189685    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e7583ec-eee2-4770-9db1-491dd3eae34c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv\" (UID: \"6e7583ec-eee2-4770-9db1-491dd3eae34c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv"
Jul 08 23:04:10.189913 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:10.189747    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e7583ec-eee2-4770-9db1-491dd3eae34c-maas-api-tls\") pod \"maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv\" (UID: \"6e7583ec-eee2-4770-9db1-491dd3eae34c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv"
Jul 08 23:04:10.189913 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:10.189841    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbwc6\" (UniqueName: \"kubernetes.io/projected/6e7583ec-eee2-4770-9db1-491dd3eae34c-kube-api-access-gbwc6\") pod \"maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv\" (UID: \"6e7583ec-eee2-4770-9db1-491dd3eae34c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv"
Jul 08 23:04:10.190382 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:10.190359    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e7583ec-eee2-4770-9db1-491dd3eae34c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv\" (UID: \"6e7583ec-eee2-4770-9db1-491dd3eae34c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv"
Jul 08 23:04:10.192514 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:10.192485    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e7583ec-eee2-4770-9db1-491dd3eae34c-maas-api-tls\") pod \"maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv\" (UID: \"6e7583ec-eee2-4770-9db1-491dd3eae34c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv"
Jul 08 23:04:10.198256 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:10.198196    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbwc6\" (UniqueName: \"kubernetes.io/projected/6e7583ec-eee2-4770-9db1-491dd3eae34c-kube-api-access-gbwc6\") pod \"maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv\" (UID: \"6e7583ec-eee2-4770-9db1-491dd3eae34c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv"
Jul 08 23:04:10.263156 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:10.263122    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv"
Jul 08 23:04:10.401606 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:10.401580    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv"]
Jul 08 23:04:10.403143 ip-10-0-136-6 kubenswrapper[2558]: W0708 23:04:10.403119    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e7583ec_eee2_4770_9db1_491dd3eae34c.slice/crio-beb70992257931370c8410a10f48205e5b4d92377e99bd2b6926f17a30bfb1e8 WatchSource:0}: Error finding container beb70992257931370c8410a10f48205e5b4d92377e99bd2b6926f17a30bfb1e8: Status 404 returned error can't find the container with id beb70992257931370c8410a10f48205e5b4d92377e99bd2b6926f17a30bfb1e8
Jul 08 23:04:10.688717 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:10.688687    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv" event={"ID":"6e7583ec-eee2-4770-9db1-491dd3eae34c","Type":"ContainerStarted","Data":"beb70992257931370c8410a10f48205e5b4d92377e99bd2b6926f17a30bfb1e8"}
Jul 08 23:04:11.695277 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:11.695235    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv" event={"ID":"6e7583ec-eee2-4770-9db1-491dd3eae34c","Type":"ContainerStarted","Data":"41a5f91bbcb6f405665bdd9c1ec5fe3469c937ba79cfc118e142c19eaa592f5f"}
Jul 08 23:04:11.696190 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:11.695510    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv"
Jul 08 23:04:11.711554 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:11.711504    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv" podStartSLOduration=2.407647426 podStartE2EDuration="2.711487879s" totalImagesPullingTime="303.840453ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:04:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:04:11.710578141 +0000 UTC m=+2055.487313529" watchObservedRunningTime="2026-07-08 23:04:11.711487879 +0000 UTC m=+2055.488223266"
Jul 08 23:04:17.706572 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:17.706486    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv"
Jul 08 23:04:20.144958 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:20.144920    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:04:40.057509 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.057466    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"]
Jul 08 23:04:40.065764 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.065737    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:40.070314 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.070159    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-7a2631\"/\"default-dockercfg-shjt2\""
Jul 08 23:04:40.070314 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.070186    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-7a2631\"/\"test-model-7a2631-kserve-self-signed-certs\""
Jul 08 23:04:40.070314 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.070190    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-7a2631\"/\"openshift-service-ca.crt\""
Jul 08 23:04:40.070314 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.070208    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-7a2631\"/\"kube-root-ca.crt\""
Jul 08 23:04:40.070681 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.070660    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"]
Jul 08 23:04:40.138362 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.138334    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-home\") pod \"test-model-7a2631-kserve-796495b9d5-lvzgt\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") " pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:40.138533 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.138377    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0d9d195-39ec-4258-889a-e2bd958811ce-tls-certs\") pod \"test-model-7a2631-kserve-796495b9d5-lvzgt\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") " pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:40.138533 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.138450    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-model-cache\") pod \"test-model-7a2631-kserve-796495b9d5-lvzgt\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") " pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:40.138533 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.138489    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-dshm\") pod \"test-model-7a2631-kserve-796495b9d5-lvzgt\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") " pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:40.138533 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.138512    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-tmp-dir\") pod \"test-model-7a2631-kserve-796495b9d5-lvzgt\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") " pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:40.138694 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.138564    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrpqs\" (UniqueName: \"kubernetes.io/projected/c0d9d195-39ec-4258-889a-e2bd958811ce-kube-api-access-hrpqs\") pod \"test-model-7a2631-kserve-796495b9d5-lvzgt\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") " pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:40.239449 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.239414    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-model-cache\") pod \"test-model-7a2631-kserve-796495b9d5-lvzgt\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") " pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:40.239449 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.239455    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-dshm\") pod \"test-model-7a2631-kserve-796495b9d5-lvzgt\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") " pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:40.239705 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.239482    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-tmp-dir\") pod \"test-model-7a2631-kserve-796495b9d5-lvzgt\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") " pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:40.239705 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.239514    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrpqs\" (UniqueName: \"kubernetes.io/projected/c0d9d195-39ec-4258-889a-e2bd958811ce-kube-api-access-hrpqs\") pod \"test-model-7a2631-kserve-796495b9d5-lvzgt\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") " pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:40.239705 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.239549    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-home\") pod \"test-model-7a2631-kserve-796495b9d5-lvzgt\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") " pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:40.239705 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.239581    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0d9d195-39ec-4258-889a-e2bd958811ce-tls-certs\") pod \"test-model-7a2631-kserve-796495b9d5-lvzgt\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") " pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:40.240004 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.239970    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-tmp-dir\") pod \"test-model-7a2631-kserve-796495b9d5-lvzgt\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") " pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:40.240072 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.239981    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-model-cache\") pod \"test-model-7a2631-kserve-796495b9d5-lvzgt\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") " pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:40.240072 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.240040    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-home\") pod \"test-model-7a2631-kserve-796495b9d5-lvzgt\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") " pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:40.241829 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.241790    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-dshm\") pod \"test-model-7a2631-kserve-796495b9d5-lvzgt\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") " pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:40.242125 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.242105    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0d9d195-39ec-4258-889a-e2bd958811ce-tls-certs\") pod \"test-model-7a2631-kserve-796495b9d5-lvzgt\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") " pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:40.248215 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.248193    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrpqs\" (UniqueName: \"kubernetes.io/projected/c0d9d195-39ec-4258-889a-e2bd958811ce-kube-api-access-hrpqs\") pod \"test-model-7a2631-kserve-796495b9d5-lvzgt\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") " pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:40.377741 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.377652    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:40.518783 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.518731    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"]
Jul 08 23:04:40.521093 ip-10-0-136-6 kubenswrapper[2558]: W0708 23:04:40.521068    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0d9d195_39ec_4258_889a_e2bd958811ce.slice/crio-3f2a868828ef91dabe87b7099a673da643f3eb19b2fb5e94703917e5f93607c3 WatchSource:0}: Error finding container 3f2a868828ef91dabe87b7099a673da643f3eb19b2fb5e94703917e5f93607c3: Status 404 returned error can't find the container with id 3f2a868828ef91dabe87b7099a673da643f3eb19b2fb5e94703917e5f93607c3
Jul 08 23:04:40.832871 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.832831    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt" event={"ID":"c0d9d195-39ec-4258-889a-e2bd958811ce","Type":"ContainerStarted","Data":"db025fb02745fb35baa85433e6ee1c27fc455caec4824b5bdadfa365f5a1ae8d"}
Jul 08 23:04:40.833041 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.832881    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt" event={"ID":"c0d9d195-39ec-4258-889a-e2bd958811ce","Type":"ContainerStarted","Data":"3f2a868828ef91dabe87b7099a673da643f3eb19b2fb5e94703917e5f93607c3"}
Jul 08 23:04:40.848597 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:40.848549    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt" podStartSLOduration=0.848535838 podStartE2EDuration="848.535838ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:04:40.847367182 +0000 UTC m=+2084.624102571" watchObservedRunningTime="2026-07-08 23:04:40.848535838 +0000 UTC m=+2084.625271267"
Jul 08 23:04:43.942439 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:43.942402    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:04:50.378123 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:50.378081    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:50.378123 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:50.378129    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:50.394170 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:50.394142    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:50.890499 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:50.890469    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:04:58.641660 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.641614    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"]
Jul 08 23:04:58.646218 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.646192    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:04:58.649783 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.649762    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e37dc7\"/\"test-model-e37dc7-kserve-self-signed-certs\""
Jul 08 23:04:58.649929 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.649762    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e37dc7\"/\"openshift-service-ca.crt\""
Jul 08 23:04:58.650015 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.649764    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e37dc7\"/\"kube-root-ca.crt\""
Jul 08 23:04:58.650074 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.649841    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e37dc7\"/\"default-dockercfg-gkh8h\""
Jul 08 23:04:58.655403 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.655381    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"]
Jul 08 23:04:58.813822 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.813765    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-model-cache\") pod \"test-model-e37dc7-kserve-774954cfd7-sq24q\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") " pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:04:58.813993 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.813835    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-dshm\") pod \"test-model-e37dc7-kserve-774954cfd7-sq24q\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") " pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:04:58.813993 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.813856    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-tmp-dir\") pod \"test-model-e37dc7-kserve-774954cfd7-sq24q\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") " pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:04:58.813993 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.813876    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-tls-certs\") pod \"test-model-e37dc7-kserve-774954cfd7-sq24q\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") " pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:04:58.813993 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.813935    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-home\") pod \"test-model-e37dc7-kserve-774954cfd7-sq24q\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") " pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:04:58.813993 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.813971    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t6mv\" (UniqueName: \"kubernetes.io/projected/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-kube-api-access-8t6mv\") pod \"test-model-e37dc7-kserve-774954cfd7-sq24q\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") " pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:04:58.914631 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.914535    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-model-cache\") pod \"test-model-e37dc7-kserve-774954cfd7-sq24q\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") " pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:04:58.914631 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.914584    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-dshm\") pod \"test-model-e37dc7-kserve-774954cfd7-sq24q\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") " pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:04:58.914631 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.914613    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-tmp-dir\") pod \"test-model-e37dc7-kserve-774954cfd7-sq24q\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") " pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:04:58.914963 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.914636    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-tls-certs\") pod \"test-model-e37dc7-kserve-774954cfd7-sq24q\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") " pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:04:58.914963 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.914710    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-home\") pod \"test-model-e37dc7-kserve-774954cfd7-sq24q\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") " pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:04:58.914963 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.914745    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t6mv\" (UniqueName: \"kubernetes.io/projected/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-kube-api-access-8t6mv\") pod \"test-model-e37dc7-kserve-774954cfd7-sq24q\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") " pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:04:58.915127 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.915020    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-model-cache\") pod \"test-model-e37dc7-kserve-774954cfd7-sq24q\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") " pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:04:58.915127 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.915069    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-tmp-dir\") pod \"test-model-e37dc7-kserve-774954cfd7-sq24q\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") " pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:04:58.915317 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.915296    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-home\") pod \"test-model-e37dc7-kserve-774954cfd7-sq24q\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") " pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:04:58.917094 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.917072    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-dshm\") pod \"test-model-e37dc7-kserve-774954cfd7-sq24q\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") " pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:04:58.917311 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.917293    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-tls-certs\") pod \"test-model-e37dc7-kserve-774954cfd7-sq24q\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") " pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:04:58.922541 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.922523    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t6mv\" (UniqueName: \"kubernetes.io/projected/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-kube-api-access-8t6mv\") pod \"test-model-e37dc7-kserve-774954cfd7-sq24q\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") " pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:04:58.956706 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:58.956679    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:04:59.093345 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:59.093318    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"]
Jul 08 23:04:59.095025 ip-10-0-136-6 kubenswrapper[2558]: W0708 23:04:59.094998    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b728ab7_3f6e_426d_8ed5_d1d8b82e25fd.slice/crio-d35c6e49c0dc54abc84c0bd2a9bb8a4b8312fae26071ddfe256ce26526280d34 WatchSource:0}: Error finding container d35c6e49c0dc54abc84c0bd2a9bb8a4b8312fae26071ddfe256ce26526280d34: Status 404 returned error can't find the container with id d35c6e49c0dc54abc84c0bd2a9bb8a4b8312fae26071ddfe256ce26526280d34
Jul 08 23:04:59.922443 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:59.922404    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q" event={"ID":"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd","Type":"ContainerStarted","Data":"c455a34f409ebcfbc539119fcaaad99b4fa74e163d2d66e799fa6ce241237b62"}
Jul 08 23:04:59.922863 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:59.922456    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q" event={"ID":"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd","Type":"ContainerStarted","Data":"d35c6e49c0dc54abc84c0bd2a9bb8a4b8312fae26071ddfe256ce26526280d34"}
Jul 08 23:04:59.939593 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:04:59.939541    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q" podStartSLOduration=1.939528353 podStartE2EDuration="1.939528353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:04:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:04:59.938446677 +0000 UTC m=+2103.715182091" watchObservedRunningTime="2026-07-08 23:04:59.939528353 +0000 UTC m=+2103.716263740"
Jul 08 23:05:03.232555 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:03.232519    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:05:08.957489 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:08.957451    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:05:08.957928 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:08.957501    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:05:08.970214 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:08.970186    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:05:08.981768 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:08.981744    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:05:16.829296 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:16.829260    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:05:22.921535 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:22.921505    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"]
Jul 08 23:05:23.789609 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:23.789575    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"]
Jul 08 23:05:24.775473 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:24.775439    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4"]
Jul 08 23:05:24.776305 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:24.775634    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4" podUID="9d629306-e1fb-4fbd-bde1-7f47fd0f640c" containerName="maas-api" containerID="cri-o://32bfbff9e40eb60fe86a5693762e25e73fafa381f47acae6a408c995fdcbd36a" gracePeriod=30
Jul 08 23:05:25.026721 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:25.026664    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4"
Jul 08 23:05:25.045556 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:25.045525    2558 generic.go:356] "Generic (PLEG): container finished" podID="9d629306-e1fb-4fbd-bde1-7f47fd0f640c" containerID="32bfbff9e40eb60fe86a5693762e25e73fafa381f47acae6a408c995fdcbd36a" exitCode=0
Jul 08 23:05:25.045722 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:25.045578    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4"
Jul 08 23:05:25.045722 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:25.045597    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4" event={"ID":"9d629306-e1fb-4fbd-bde1-7f47fd0f640c","Type":"ContainerDied","Data":"32bfbff9e40eb60fe86a5693762e25e73fafa381f47acae6a408c995fdcbd36a"}
Jul 08 23:05:25.045722 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:25.045651    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4" event={"ID":"9d629306-e1fb-4fbd-bde1-7f47fd0f640c","Type":"ContainerDied","Data":"949af287ddf24b9741c09bcb8753ddcb17b9123c7780f188b659a878ecd9a2ed"}
Jul 08 23:05:25.045722 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:25.045679    2558 scope.go:117] "RemoveContainer" containerID="32bfbff9e40eb60fe86a5693762e25e73fafa381f47acae6a408c995fdcbd36a"
Jul 08 23:05:25.056725 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:25.056700    2558 scope.go:117] "RemoveContainer" containerID="32bfbff9e40eb60fe86a5693762e25e73fafa381f47acae6a408c995fdcbd36a"
Jul 08 23:05:25.057026 ip-10-0-136-6 kubenswrapper[2558]: E0708 23:05:25.056995    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32bfbff9e40eb60fe86a5693762e25e73fafa381f47acae6a408c995fdcbd36a\": container with ID starting with 32bfbff9e40eb60fe86a5693762e25e73fafa381f47acae6a408c995fdcbd36a not found: ID does not exist" containerID="32bfbff9e40eb60fe86a5693762e25e73fafa381f47acae6a408c995fdcbd36a"
Jul 08 23:05:25.057136 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:25.057022    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32bfbff9e40eb60fe86a5693762e25e73fafa381f47acae6a408c995fdcbd36a"} err="failed to get container status \"32bfbff9e40eb60fe86a5693762e25e73fafa381f47acae6a408c995fdcbd36a\": rpc error: code = NotFound desc = could not find container \"32bfbff9e40eb60fe86a5693762e25e73fafa381f47acae6a408c995fdcbd36a\": container with ID starting with 32bfbff9e40eb60fe86a5693762e25e73fafa381f47acae6a408c995fdcbd36a not found: ID does not exist"
Jul 08 23:05:25.153623 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:25.153595    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d629306-e1fb-4fbd-bde1-7f47fd0f640c-openshift-service-ca\") pod \"9d629306-e1fb-4fbd-bde1-7f47fd0f640c\" (UID: \"9d629306-e1fb-4fbd-bde1-7f47fd0f640c\") "
Jul 08 23:05:25.153828 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:25.153634    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4xzv\" (UniqueName: \"kubernetes.io/projected/9d629306-e1fb-4fbd-bde1-7f47fd0f640c-kube-api-access-c4xzv\") pod \"9d629306-e1fb-4fbd-bde1-7f47fd0f640c\" (UID: \"9d629306-e1fb-4fbd-bde1-7f47fd0f640c\") "
Jul 08 23:05:25.153828 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:25.153654    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d629306-e1fb-4fbd-bde1-7f47fd0f640c-maas-api-tls\") pod \"9d629306-e1fb-4fbd-bde1-7f47fd0f640c\" (UID: \"9d629306-e1fb-4fbd-bde1-7f47fd0f640c\") "
Jul 08 23:05:25.153973 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:25.153950    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d629306-e1fb-4fbd-bde1-7f47fd0f640c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9d629306-e1fb-4fbd-bde1-7f47fd0f640c" (UID: "9d629306-e1fb-4fbd-bde1-7f47fd0f640c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:05:25.155857 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:25.155829    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d629306-e1fb-4fbd-bde1-7f47fd0f640c-kube-api-access-c4xzv" (OuterVolumeSpecName: "kube-api-access-c4xzv") pod "9d629306-e1fb-4fbd-bde1-7f47fd0f640c" (UID: "9d629306-e1fb-4fbd-bde1-7f47fd0f640c"). InnerVolumeSpecName "kube-api-access-c4xzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:05:25.155968 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:25.155887    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d629306-e1fb-4fbd-bde1-7f47fd0f640c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9d629306-e1fb-4fbd-bde1-7f47fd0f640c" (UID: "9d629306-e1fb-4fbd-bde1-7f47fd0f640c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:05:25.254755 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:25.254726    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d629306-e1fb-4fbd-bde1-7f47fd0f640c-openshift-service-ca\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:05:25.254755 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:25.254749    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4xzv\" (UniqueName: \"kubernetes.io/projected/9d629306-e1fb-4fbd-bde1-7f47fd0f640c-kube-api-access-c4xzv\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:05:25.254755 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:25.254760    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d629306-e1fb-4fbd-bde1-7f47fd0f640c-maas-api-tls\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:05:25.366885 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:25.366848    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4"]
Jul 08 23:05:25.372149 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:25.372119    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7a2631-64c5d4577d-dxlh4"]
Jul 08 23:05:26.774006 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:26.773970    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d629306-e1fb-4fbd-bde1-7f47fd0f640c" path="/var/lib/kubelet/pods/9d629306-e1fb-4fbd-bde1-7f47fd0f640c/volumes"
Jul 08 23:05:29.841968 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:29.841932    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:05:37.942277 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:37.942235    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt" podUID="c0d9d195-39ec-4258-889a-e2bd958811ce" containerName="main" containerID="cri-o://db025fb02745fb35baa85433e6ee1c27fc455caec4824b5bdadfa365f5a1ae8d" gracePeriod=45
Jul 08 23:05:38.111211 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.111182    2558 generic.go:356] "Generic (PLEG): container finished" podID="c0d9d195-39ec-4258-889a-e2bd958811ce" containerID="db025fb02745fb35baa85433e6ee1c27fc455caec4824b5bdadfa365f5a1ae8d" exitCode=0
Jul 08 23:05:38.111323 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.111260    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt" event={"ID":"c0d9d195-39ec-4258-889a-e2bd958811ce","Type":"ContainerDied","Data":"db025fb02745fb35baa85433e6ee1c27fc455caec4824b5bdadfa365f5a1ae8d"}
Jul 08 23:05:38.193579 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.193521    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:05:38.380688 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.380652    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-model-cache\") pod \"c0d9d195-39ec-4258-889a-e2bd958811ce\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") "
Jul 08 23:05:38.380688 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.380687    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-dshm\") pod \"c0d9d195-39ec-4258-889a-e2bd958811ce\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") "
Jul 08 23:05:38.380931 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.380719    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-home\") pod \"c0d9d195-39ec-4258-889a-e2bd958811ce\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") "
Jul 08 23:05:38.380931 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.380761    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0d9d195-39ec-4258-889a-e2bd958811ce-tls-certs\") pod \"c0d9d195-39ec-4258-889a-e2bd958811ce\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") "
Jul 08 23:05:38.380931 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.380790    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-tmp-dir\") pod \"c0d9d195-39ec-4258-889a-e2bd958811ce\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") "
Jul 08 23:05:38.380931 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.380885    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrpqs\" (UniqueName: \"kubernetes.io/projected/c0d9d195-39ec-4258-889a-e2bd958811ce-kube-api-access-hrpqs\") pod \"c0d9d195-39ec-4258-889a-e2bd958811ce\" (UID: \"c0d9d195-39ec-4258-889a-e2bd958811ce\") "
Jul 08 23:05:38.381076 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.380955    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-model-cache" (OuterVolumeSpecName: "model-cache") pod "c0d9d195-39ec-4258-889a-e2bd958811ce" (UID: "c0d9d195-39ec-4258-889a-e2bd958811ce"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:05:38.381076 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.381064    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-home" (OuterVolumeSpecName: "home") pod "c0d9d195-39ec-4258-889a-e2bd958811ce" (UID: "c0d9d195-39ec-4258-889a-e2bd958811ce"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:05:38.381248 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.381219    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c0d9d195-39ec-4258-889a-e2bd958811ce" (UID: "c0d9d195-39ec-4258-889a-e2bd958811ce"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:05:38.381248 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.381225    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-home\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:05:38.381402 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.381270    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-model-cache\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:05:38.383123 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.383101    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0d9d195-39ec-4258-889a-e2bd958811ce-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c0d9d195-39ec-4258-889a-e2bd958811ce" (UID: "c0d9d195-39ec-4258-889a-e2bd958811ce"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:05:38.383218 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.383124    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-dshm" (OuterVolumeSpecName: "dshm") pod "c0d9d195-39ec-4258-889a-e2bd958811ce" (UID: "c0d9d195-39ec-4258-889a-e2bd958811ce"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:05:38.383266 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.383229    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0d9d195-39ec-4258-889a-e2bd958811ce-kube-api-access-hrpqs" (OuterVolumeSpecName: "kube-api-access-hrpqs") pod "c0d9d195-39ec-4258-889a-e2bd958811ce" (UID: "c0d9d195-39ec-4258-889a-e2bd958811ce"). InnerVolumeSpecName "kube-api-access-hrpqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:05:38.481985 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.481901    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0d9d195-39ec-4258-889a-e2bd958811ce-tls-certs\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:05:38.481985 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.481928    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-tmp-dir\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:05:38.481985 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.481938    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrpqs\" (UniqueName: \"kubernetes.io/projected/c0d9d195-39ec-4258-889a-e2bd958811ce-kube-api-access-hrpqs\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:05:38.481985 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.481956    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0d9d195-39ec-4258-889a-e2bd958811ce-dshm\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:05:38.811666 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.811624    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q" podUID="9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd" containerName="main" containerID="cri-o://c455a34f409ebcfbc539119fcaaad99b4fa74e163d2d66e799fa6ce241237b62" gracePeriod=45
Jul 08 23:05:38.970764 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:38.970724    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q" podUID="9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": dial tcp 10.133.0.55:8000: connect: connection refused"
Jul 08 23:05:39.055732 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.055704    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:05:39.117192 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.117160    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"
Jul 08 23:05:39.117370 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.117190    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt" event={"ID":"c0d9d195-39ec-4258-889a-e2bd958811ce","Type":"ContainerDied","Data":"3f2a868828ef91dabe87b7099a673da643f3eb19b2fb5e94703917e5f93607c3"}
Jul 08 23:05:39.117370 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.117253    2558 scope.go:117] "RemoveContainer" containerID="db025fb02745fb35baa85433e6ee1c27fc455caec4824b5bdadfa365f5a1ae8d"
Jul 08 23:05:39.118702 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.118663    2558 generic.go:356] "Generic (PLEG): container finished" podID="9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd" containerID="c455a34f409ebcfbc539119fcaaad99b4fa74e163d2d66e799fa6ce241237b62" exitCode=0
Jul 08 23:05:39.118836 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.118730    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q" event={"ID":"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd","Type":"ContainerDied","Data":"c455a34f409ebcfbc539119fcaaad99b4fa74e163d2d66e799fa6ce241237b62"}
Jul 08 23:05:39.118836 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.118775    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q" event={"ID":"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd","Type":"ContainerDied","Data":"d35c6e49c0dc54abc84c0bd2a9bb8a4b8312fae26071ddfe256ce26526280d34"}
Jul 08 23:05:39.118836 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.118744    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"
Jul 08 23:05:39.126232 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.126214    2558 scope.go:117] "RemoveContainer" containerID="c455a34f409ebcfbc539119fcaaad99b4fa74e163d2d66e799fa6ce241237b62"
Jul 08 23:05:39.134084 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.134069    2558 scope.go:117] "RemoveContainer" containerID="c455a34f409ebcfbc539119fcaaad99b4fa74e163d2d66e799fa6ce241237b62"
Jul 08 23:05:39.134337 ip-10-0-136-6 kubenswrapper[2558]: E0708 23:05:39.134320    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c455a34f409ebcfbc539119fcaaad99b4fa74e163d2d66e799fa6ce241237b62\": container with ID starting with c455a34f409ebcfbc539119fcaaad99b4fa74e163d2d66e799fa6ce241237b62 not found: ID does not exist" containerID="c455a34f409ebcfbc539119fcaaad99b4fa74e163d2d66e799fa6ce241237b62"
Jul 08 23:05:39.134399 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.134344    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c455a34f409ebcfbc539119fcaaad99b4fa74e163d2d66e799fa6ce241237b62"} err="failed to get container status \"c455a34f409ebcfbc539119fcaaad99b4fa74e163d2d66e799fa6ce241237b62\": rpc error: code = NotFound desc = could not find container \"c455a34f409ebcfbc539119fcaaad99b4fa74e163d2d66e799fa6ce241237b62\": container with ID starting with c455a34f409ebcfbc539119fcaaad99b4fa74e163d2d66e799fa6ce241237b62 not found: ID does not exist"
Jul 08 23:05:39.135038 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.135021    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"]
Jul 08 23:05:39.138183 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.138165    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-7a2631/test-model-7a2631-kserve-796495b9d5-lvzgt"]
Jul 08 23:05:39.189636 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.189600    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-home\") pod \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") "
Jul 08 23:05:39.189812 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.189664    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-tmp-dir\") pod \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") "
Jul 08 23:05:39.189812 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.189694    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-model-cache\") pod \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") "
Jul 08 23:05:39.189812 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.189716    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-tls-certs\") pod \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") "
Jul 08 23:05:39.189812 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.189742    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t6mv\" (UniqueName: \"kubernetes.io/projected/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-kube-api-access-8t6mv\") pod \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") "
Jul 08 23:05:39.190030 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.189856    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-dshm\") pod \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\" (UID: \"9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd\") "
Jul 08 23:05:39.190030 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.189923    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-home" (OuterVolumeSpecName: "home") pod "9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd" (UID: "9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:05:39.190030 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.189987    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd" (UID: "9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:05:39.190030 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.189998    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-model-cache" (OuterVolumeSpecName: "model-cache") pod "9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd" (UID: "9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:05:39.190242 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.190158    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-home\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:05:39.190242 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.190198    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-tmp-dir\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:05:39.190242 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.190212    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-model-cache\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:05:39.192197 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.192162    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-kube-api-access-8t6mv" (OuterVolumeSpecName: "kube-api-access-8t6mv") pod "9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd" (UID: "9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd"). InnerVolumeSpecName "kube-api-access-8t6mv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:05:39.192316 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.192260    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd" (UID: "9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:05:39.192316 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.192292    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-dshm" (OuterVolumeSpecName: "dshm") pod "9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd" (UID: "9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:05:39.291586 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.291485    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-tls-certs\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:05:39.291586 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.291515    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t6mv\" (UniqueName: \"kubernetes.io/projected/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-kube-api-access-8t6mv\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:05:39.291586 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.291526    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd-dshm\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:05:39.441477 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.441447    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"]
Jul 08 23:05:39.445238 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:39.445215    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-e37dc7/test-model-e37dc7-kserve-774954cfd7-sq24q"]
Jul 08 23:05:40.772979 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:40.772948    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd" path="/var/lib/kubelet/pods/9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd/volumes"
Jul 08 23:05:40.773345 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:05:40.773327    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0d9d195-39ec-4258-889a-e2bd958811ce" path="/var/lib/kubelet/pods/c0d9d195-39ec-4258-889a-e2bd958811ce/volumes"
Jul 08 23:06:07.708034 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:07.707994    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv"]
Jul 08 23:06:07.708521 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:07.708324    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv" podUID="6e7583ec-eee2-4770-9db1-491dd3eae34c" containerName="maas-api" containerID="cri-o://41a5f91bbcb6f405665bdd9c1ec5fe3469c937ba79cfc118e142c19eaa592f5f" gracePeriod=30
Jul 08 23:06:07.950340 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:07.950316    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv"
Jul 08 23:06:08.021273 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:08.021181    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e7583ec-eee2-4770-9db1-491dd3eae34c-openshift-service-ca\") pod \"6e7583ec-eee2-4770-9db1-491dd3eae34c\" (UID: \"6e7583ec-eee2-4770-9db1-491dd3eae34c\") "
Jul 08 23:06:08.021273 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:08.021225    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e7583ec-eee2-4770-9db1-491dd3eae34c-maas-api-tls\") pod \"6e7583ec-eee2-4770-9db1-491dd3eae34c\" (UID: \"6e7583ec-eee2-4770-9db1-491dd3eae34c\") "
Jul 08 23:06:08.021273 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:08.021270    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbwc6\" (UniqueName: \"kubernetes.io/projected/6e7583ec-eee2-4770-9db1-491dd3eae34c-kube-api-access-gbwc6\") pod \"6e7583ec-eee2-4770-9db1-491dd3eae34c\" (UID: \"6e7583ec-eee2-4770-9db1-491dd3eae34c\") "
Jul 08 23:06:08.021645 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:08.021619    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e7583ec-eee2-4770-9db1-491dd3eae34c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6e7583ec-eee2-4770-9db1-491dd3eae34c" (UID: "6e7583ec-eee2-4770-9db1-491dd3eae34c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:06:08.023629 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:08.023606    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e7583ec-eee2-4770-9db1-491dd3eae34c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6e7583ec-eee2-4770-9db1-491dd3eae34c" (UID: "6e7583ec-eee2-4770-9db1-491dd3eae34c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:06:08.023771 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:08.023715    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e7583ec-eee2-4770-9db1-491dd3eae34c-kube-api-access-gbwc6" (OuterVolumeSpecName: "kube-api-access-gbwc6") pod "6e7583ec-eee2-4770-9db1-491dd3eae34c" (UID: "6e7583ec-eee2-4770-9db1-491dd3eae34c"). InnerVolumeSpecName "kube-api-access-gbwc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:06:08.122812 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:08.122773    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e7583ec-eee2-4770-9db1-491dd3eae34c-openshift-service-ca\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:06:08.122812 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:08.122809    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6e7583ec-eee2-4770-9db1-491dd3eae34c-maas-api-tls\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:06:08.122995 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:08.122821    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbwc6\" (UniqueName: \"kubernetes.io/projected/6e7583ec-eee2-4770-9db1-491dd3eae34c-kube-api-access-gbwc6\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:06:08.254989 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:08.254954    2558 generic.go:356] "Generic (PLEG): container finished" podID="6e7583ec-eee2-4770-9db1-491dd3eae34c" containerID="41a5f91bbcb6f405665bdd9c1ec5fe3469c937ba79cfc118e142c19eaa592f5f" exitCode=0
Jul 08 23:06:08.255162 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:08.255003    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv"
Jul 08 23:06:08.255162 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:08.255042    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv" event={"ID":"6e7583ec-eee2-4770-9db1-491dd3eae34c","Type":"ContainerDied","Data":"41a5f91bbcb6f405665bdd9c1ec5fe3469c937ba79cfc118e142c19eaa592f5f"}
Jul 08 23:06:08.255162 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:08.255100    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv" event={"ID":"6e7583ec-eee2-4770-9db1-491dd3eae34c","Type":"ContainerDied","Data":"beb70992257931370c8410a10f48205e5b4d92377e99bd2b6926f17a30bfb1e8"}
Jul 08 23:06:08.255162 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:08.255123    2558 scope.go:117] "RemoveContainer" containerID="41a5f91bbcb6f405665bdd9c1ec5fe3469c937ba79cfc118e142c19eaa592f5f"
Jul 08 23:06:08.263947 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:08.263927    2558 scope.go:117] "RemoveContainer" containerID="41a5f91bbcb6f405665bdd9c1ec5fe3469c937ba79cfc118e142c19eaa592f5f"
Jul 08 23:06:08.264211 ip-10-0-136-6 kubenswrapper[2558]: E0708 23:06:08.264190    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41a5f91bbcb6f405665bdd9c1ec5fe3469c937ba79cfc118e142c19eaa592f5f\": container with ID starting with 41a5f91bbcb6f405665bdd9c1ec5fe3469c937ba79cfc118e142c19eaa592f5f not found: ID does not exist" containerID="41a5f91bbcb6f405665bdd9c1ec5fe3469c937ba79cfc118e142c19eaa592f5f"
Jul 08 23:06:08.264304 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:08.264216    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41a5f91bbcb6f405665bdd9c1ec5fe3469c937ba79cfc118e142c19eaa592f5f"} err="failed to get container status \"41a5f91bbcb6f405665bdd9c1ec5fe3469c937ba79cfc118e142c19eaa592f5f\": rpc error: code = NotFound desc = could not find container \"41a5f91bbcb6f405665bdd9c1ec5fe3469c937ba79cfc118e142c19eaa592f5f\": container with ID starting with 41a5f91bbcb6f405665bdd9c1ec5fe3469c937ba79cfc118e142c19eaa592f5f not found: ID does not exist"
Jul 08 23:06:08.275261 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:08.275209    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv"]
Jul 08 23:06:08.278922 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:08.278901    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e37dc7-79999c5d56-k4fcv"]
Jul 08 23:06:08.773163 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:08.773133    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e7583ec-eee2-4770-9db1-491dd3eae34c" path="/var/lib/kubelet/pods/6e7583ec-eee2-4770-9db1-491dd3eae34c/volumes"
Jul 08 23:06:11.032384 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:11.032352    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:06:17.603685 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.603648    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l"]
Jul 08 23:06:17.604208 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.604192    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e7583ec-eee2-4770-9db1-491dd3eae34c" containerName="maas-api"
Jul 08 23:06:17.604254 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.604212    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e7583ec-eee2-4770-9db1-491dd3eae34c" containerName="maas-api"
Jul 08 23:06:17.604254 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.604234    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0d9d195-39ec-4258-889a-e2bd958811ce" containerName="main"
Jul 08 23:06:17.604254 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.604243    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0d9d195-39ec-4258-889a-e2bd958811ce" containerName="main"
Jul 08 23:06:17.604349 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.604256    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd" containerName="main"
Jul 08 23:06:17.604349 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.604266    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd" containerName="main"
Jul 08 23:06:17.604349 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.604288    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d629306-e1fb-4fbd-bde1-7f47fd0f640c" containerName="maas-api"
Jul 08 23:06:17.604349 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.604297    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d629306-e1fb-4fbd-bde1-7f47fd0f640c" containerName="maas-api"
Jul 08 23:06:17.604474 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.604371    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e7583ec-eee2-4770-9db1-491dd3eae34c" containerName="maas-api"
Jul 08 23:06:17.604474 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.604381    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b728ab7-3f6e-426d-8ed5-d1d8b82e25fd" containerName="main"
Jul 08 23:06:17.604474 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.604390    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0d9d195-39ec-4258-889a-e2bd958811ce" containerName="main"
Jul 08 23:06:17.604474 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.604401    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d629306-e1fb-4fbd-bde1-7f47fd0f640c" containerName="maas-api"
Jul 08 23:06:17.608973 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.608956    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l"
Jul 08 23:06:17.611554 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.611529    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-8b0dbb-serving-cert\""
Jul 08 23:06:17.617510 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.617484    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l"]
Jul 08 23:06:17.701712 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.701683    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e14ad0b-6497-4b1a-b31b-16ee0d3ea037-maas-api-tls\") pod \"maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l\" (UID: \"7e14ad0b-6497-4b1a-b31b-16ee0d3ea037\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l"
Jul 08 23:06:17.701915 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.701720    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e14ad0b-6497-4b1a-b31b-16ee0d3ea037-openshift-service-ca\") pod \"maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l\" (UID: \"7e14ad0b-6497-4b1a-b31b-16ee0d3ea037\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l"
Jul 08 23:06:17.701915 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.701743    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmxhc\" (UniqueName: \"kubernetes.io/projected/7e14ad0b-6497-4b1a-b31b-16ee0d3ea037-kube-api-access-gmxhc\") pod \"maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l\" (UID: \"7e14ad0b-6497-4b1a-b31b-16ee0d3ea037\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l"
Jul 08 23:06:17.802274 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.802245    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e14ad0b-6497-4b1a-b31b-16ee0d3ea037-maas-api-tls\") pod \"maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l\" (UID: \"7e14ad0b-6497-4b1a-b31b-16ee0d3ea037\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l"
Jul 08 23:06:17.802274 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.802275    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e14ad0b-6497-4b1a-b31b-16ee0d3ea037-openshift-service-ca\") pod \"maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l\" (UID: \"7e14ad0b-6497-4b1a-b31b-16ee0d3ea037\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l"
Jul 08 23:06:17.802518 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.802294    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmxhc\" (UniqueName: \"kubernetes.io/projected/7e14ad0b-6497-4b1a-b31b-16ee0d3ea037-kube-api-access-gmxhc\") pod \"maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l\" (UID: \"7e14ad0b-6497-4b1a-b31b-16ee0d3ea037\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l"
Jul 08 23:06:17.802973 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.802948    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e14ad0b-6497-4b1a-b31b-16ee0d3ea037-openshift-service-ca\") pod \"maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l\" (UID: \"7e14ad0b-6497-4b1a-b31b-16ee0d3ea037\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l"
Jul 08 23:06:17.804912 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.804890    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e14ad0b-6497-4b1a-b31b-16ee0d3ea037-maas-api-tls\") pod \"maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l\" (UID: \"7e14ad0b-6497-4b1a-b31b-16ee0d3ea037\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l"
Jul 08 23:06:17.810166 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.810140    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmxhc\" (UniqueName: \"kubernetes.io/projected/7e14ad0b-6497-4b1a-b31b-16ee0d3ea037-kube-api-access-gmxhc\") pod \"maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l\" (UID: \"7e14ad0b-6497-4b1a-b31b-16ee0d3ea037\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l"
Jul 08 23:06:17.921002 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:17.920912    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l"
Jul 08 23:06:18.059970 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:18.059939    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l"]
Jul 08 23:06:18.061638 ip-10-0-136-6 kubenswrapper[2558]: W0708 23:06:18.061608    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e14ad0b_6497_4b1a_b31b_16ee0d3ea037.slice/crio-c3415e40da4ae0003b845ca14cf93111866a93d8bb4d9ea6188ddcc1b2c4887f WatchSource:0}: Error finding container c3415e40da4ae0003b845ca14cf93111866a93d8bb4d9ea6188ddcc1b2c4887f: Status 404 returned error can't find the container with id c3415e40da4ae0003b845ca14cf93111866a93d8bb4d9ea6188ddcc1b2c4887f
Jul 08 23:06:18.306501 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:18.306465    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l" event={"ID":"7e14ad0b-6497-4b1a-b31b-16ee0d3ea037","Type":"ContainerStarted","Data":"c3415e40da4ae0003b845ca14cf93111866a93d8bb4d9ea6188ddcc1b2c4887f"}
Jul 08 23:06:19.312762 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:19.312724    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l" event={"ID":"7e14ad0b-6497-4b1a-b31b-16ee0d3ea037","Type":"ContainerStarted","Data":"d76aa7c7dd7b5e8969cc0a364adc4f982075643852a47a3c38d420121400b142"}
Jul 08 23:06:19.313159 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:19.312931    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l"
Jul 08 23:06:19.330138 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:19.330091    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l" podStartSLOduration=1.6730937510000001 podStartE2EDuration="2.330075201s" totalImagesPullingTime="656.98145ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:06:19.328292719 +0000 UTC m=+2183.105028099" watchObservedRunningTime="2026-07-08 23:06:19.330075201 +0000 UTC m=+2183.106810589"
Jul 08 23:06:25.323167 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:25.323139    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l"
Jul 08 23:06:25.464777 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:25.464743    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc"]
Jul 08 23:06:25.468599 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:25.468571    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc"
Jul 08 23:06:25.471186 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:25.471160    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-cead44-serving-cert\""
Jul 08 23:06:25.477517 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:25.477490    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc"]
Jul 08 23:06:25.579304 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:25.579216    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx9bs\" (UniqueName: \"kubernetes.io/projected/2a96cc40-1f13-4473-ad72-8e11dcc07422-kube-api-access-vx9bs\") pod \"maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc\" (UID: \"2a96cc40-1f13-4473-ad72-8e11dcc07422\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc"
Jul 08 23:06:25.579304 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:25.579261    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a96cc40-1f13-4473-ad72-8e11dcc07422-maas-api-tls\") pod \"maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc\" (UID: \"2a96cc40-1f13-4473-ad72-8e11dcc07422\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc"
Jul 08 23:06:25.579517 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:25.579311    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a96cc40-1f13-4473-ad72-8e11dcc07422-openshift-service-ca\") pod \"maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc\" (UID: \"2a96cc40-1f13-4473-ad72-8e11dcc07422\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc"
Jul 08 23:06:25.680188 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:25.680155    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx9bs\" (UniqueName: \"kubernetes.io/projected/2a96cc40-1f13-4473-ad72-8e11dcc07422-kube-api-access-vx9bs\") pod \"maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc\" (UID: \"2a96cc40-1f13-4473-ad72-8e11dcc07422\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc"
Jul 08 23:06:25.680365 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:25.680194    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a96cc40-1f13-4473-ad72-8e11dcc07422-maas-api-tls\") pod \"maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc\" (UID: \"2a96cc40-1f13-4473-ad72-8e11dcc07422\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc"
Jul 08 23:06:25.680365 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:25.680217    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a96cc40-1f13-4473-ad72-8e11dcc07422-openshift-service-ca\") pod \"maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc\" (UID: \"2a96cc40-1f13-4473-ad72-8e11dcc07422\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc"
Jul 08 23:06:25.680927 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:25.680904    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a96cc40-1f13-4473-ad72-8e11dcc07422-openshift-service-ca\") pod \"maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc\" (UID: \"2a96cc40-1f13-4473-ad72-8e11dcc07422\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc"
Jul 08 23:06:25.682897 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:25.682869    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a96cc40-1f13-4473-ad72-8e11dcc07422-maas-api-tls\") pod \"maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc\" (UID: \"2a96cc40-1f13-4473-ad72-8e11dcc07422\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc"
Jul 08 23:06:25.688127 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:25.688104    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx9bs\" (UniqueName: \"kubernetes.io/projected/2a96cc40-1f13-4473-ad72-8e11dcc07422-kube-api-access-vx9bs\") pod \"maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc\" (UID: \"2a96cc40-1f13-4473-ad72-8e11dcc07422\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc"
Jul 08 23:06:25.782358 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:25.782324    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc"
Jul 08 23:06:25.929264 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:25.929234    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc"]
Jul 08 23:06:25.931413 ip-10-0-136-6 kubenswrapper[2558]: W0708 23:06:25.931378    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a96cc40_1f13_4473_ad72_8e11dcc07422.slice/crio-d1607c7d3b44868f4436340319c8b55ddb5bc2e81d06079238e629bca152afab WatchSource:0}: Error finding container d1607c7d3b44868f4436340319c8b55ddb5bc2e81d06079238e629bca152afab: Status 404 returned error can't find the container with id d1607c7d3b44868f4436340319c8b55ddb5bc2e81d06079238e629bca152afab
Jul 08 23:06:25.941968 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:25.941944    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:06:26.351148 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:26.351117    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc" event={"ID":"2a96cc40-1f13-4473-ad72-8e11dcc07422","Type":"ContainerStarted","Data":"d1607c7d3b44868f4436340319c8b55ddb5bc2e81d06079238e629bca152afab"}
Jul 08 23:06:27.357320 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:27.357289    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc" event={"ID":"2a96cc40-1f13-4473-ad72-8e11dcc07422","Type":"ContainerStarted","Data":"ab656e6a905dac6d475c432e7b0c157e3bd795406d10a074d7d82c844fcc90b1"}
Jul 08 23:06:27.358098 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:27.357408    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc"
Jul 08 23:06:27.374195 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:27.374150    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc" podStartSLOduration=1.97555444 podStartE2EDuration="2.374134672s" totalImagesPullingTime="398.580232ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:06:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:06:27.372264814 +0000 UTC m=+2191.149000201" watchObservedRunningTime="2026-07-08 23:06:27.374134672 +0000 UTC m=+2191.150870060"
Jul 08 23:06:33.368466 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:33.368430    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc"
Jul 08 23:06:38.456311 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:38.456274    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l"]
Jul 08 23:06:38.456784 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:38.456521    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l" podUID="7e14ad0b-6497-4b1a-b31b-16ee0d3ea037" containerName="maas-api" containerID="cri-o://d76aa7c7dd7b5e8969cc0a364adc4f982075643852a47a3c38d420121400b142" gracePeriod=30
Jul 08 23:06:38.708293 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:38.708266    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l"
Jul 08 23:06:38.800159 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:38.800131    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e14ad0b-6497-4b1a-b31b-16ee0d3ea037-openshift-service-ca\") pod \"7e14ad0b-6497-4b1a-b31b-16ee0d3ea037\" (UID: \"7e14ad0b-6497-4b1a-b31b-16ee0d3ea037\") "
Jul 08 23:06:38.800322 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:38.800173    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e14ad0b-6497-4b1a-b31b-16ee0d3ea037-maas-api-tls\") pod \"7e14ad0b-6497-4b1a-b31b-16ee0d3ea037\" (UID: \"7e14ad0b-6497-4b1a-b31b-16ee0d3ea037\") "
Jul 08 23:06:38.800322 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:38.800198    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmxhc\" (UniqueName: \"kubernetes.io/projected/7e14ad0b-6497-4b1a-b31b-16ee0d3ea037-kube-api-access-gmxhc\") pod \"7e14ad0b-6497-4b1a-b31b-16ee0d3ea037\" (UID: \"7e14ad0b-6497-4b1a-b31b-16ee0d3ea037\") "
Jul 08 23:06:38.800492 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:38.800469    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e14ad0b-6497-4b1a-b31b-16ee0d3ea037-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7e14ad0b-6497-4b1a-b31b-16ee0d3ea037" (UID: "7e14ad0b-6497-4b1a-b31b-16ee0d3ea037"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:06:38.802446 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:38.802415    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e14ad0b-6497-4b1a-b31b-16ee0d3ea037-kube-api-access-gmxhc" (OuterVolumeSpecName: "kube-api-access-gmxhc") pod "7e14ad0b-6497-4b1a-b31b-16ee0d3ea037" (UID: "7e14ad0b-6497-4b1a-b31b-16ee0d3ea037"). InnerVolumeSpecName "kube-api-access-gmxhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:06:38.802446 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:38.802439    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e14ad0b-6497-4b1a-b31b-16ee0d3ea037-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7e14ad0b-6497-4b1a-b31b-16ee0d3ea037" (UID: "7e14ad0b-6497-4b1a-b31b-16ee0d3ea037"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:06:38.901181 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:38.901085    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e14ad0b-6497-4b1a-b31b-16ee0d3ea037-openshift-service-ca\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:06:38.901181 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:38.901114    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e14ad0b-6497-4b1a-b31b-16ee0d3ea037-maas-api-tls\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:06:38.901181 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:38.901125    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmxhc\" (UniqueName: \"kubernetes.io/projected/7e14ad0b-6497-4b1a-b31b-16ee0d3ea037-kube-api-access-gmxhc\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:06:38.938712 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:38.938670    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:06:39.415597 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:39.415561    2558 generic.go:356] "Generic (PLEG): container finished" podID="7e14ad0b-6497-4b1a-b31b-16ee0d3ea037" containerID="d76aa7c7dd7b5e8969cc0a364adc4f982075643852a47a3c38d420121400b142" exitCode=0
Jul 08 23:06:39.415597 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:39.415600    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l"
Jul 08 23:06:39.415876 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:39.415647    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l" event={"ID":"7e14ad0b-6497-4b1a-b31b-16ee0d3ea037","Type":"ContainerDied","Data":"d76aa7c7dd7b5e8969cc0a364adc4f982075643852a47a3c38d420121400b142"}
Jul 08 23:06:39.415876 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:39.415697    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l" event={"ID":"7e14ad0b-6497-4b1a-b31b-16ee0d3ea037","Type":"ContainerDied","Data":"c3415e40da4ae0003b845ca14cf93111866a93d8bb4d9ea6188ddcc1b2c4887f"}
Jul 08 23:06:39.415876 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:39.415725    2558 scope.go:117] "RemoveContainer" containerID="d76aa7c7dd7b5e8969cc0a364adc4f982075643852a47a3c38d420121400b142"
Jul 08 23:06:39.425437 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:39.425413    2558 scope.go:117] "RemoveContainer" containerID="d76aa7c7dd7b5e8969cc0a364adc4f982075643852a47a3c38d420121400b142"
Jul 08 23:06:39.425703 ip-10-0-136-6 kubenswrapper[2558]: E0708 23:06:39.425683    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d76aa7c7dd7b5e8969cc0a364adc4f982075643852a47a3c38d420121400b142\": container with ID starting with d76aa7c7dd7b5e8969cc0a364adc4f982075643852a47a3c38d420121400b142 not found: ID does not exist" containerID="d76aa7c7dd7b5e8969cc0a364adc4f982075643852a47a3c38d420121400b142"
Jul 08 23:06:39.425747 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:39.425711    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d76aa7c7dd7b5e8969cc0a364adc4f982075643852a47a3c38d420121400b142"} err="failed to get container status \"d76aa7c7dd7b5e8969cc0a364adc4f982075643852a47a3c38d420121400b142\": rpc error: code = NotFound desc = could not find container \"d76aa7c7dd7b5e8969cc0a364adc4f982075643852a47a3c38d420121400b142\": container with ID starting with d76aa7c7dd7b5e8969cc0a364adc4f982075643852a47a3c38d420121400b142 not found: ID does not exist"
Jul 08 23:06:39.436553 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:39.436528    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l"]
Jul 08 23:06:39.439611 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:39.439589    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-8b0dbb-5c969b7dc9-blt4l"]
Jul 08 23:06:40.773433 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:40.773399    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e14ad0b-6497-4b1a-b31b-16ee0d3ea037" path="/var/lib/kubelet/pods/7e14ad0b-6497-4b1a-b31b-16ee0d3ea037/volumes"
Jul 08 23:06:45.156430 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:45.156397    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc"]
Jul 08 23:06:45.156891 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:45.156626    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc" podUID="2a96cc40-1f13-4473-ad72-8e11dcc07422" containerName="maas-api" containerID="cri-o://ab656e6a905dac6d475c432e7b0c157e3bd795406d10a074d7d82c844fcc90b1" gracePeriod=30
Jul 08 23:06:45.427764 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:45.427739    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc"
Jul 08 23:06:45.446562 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:45.446522    2558 generic.go:356] "Generic (PLEG): container finished" podID="2a96cc40-1f13-4473-ad72-8e11dcc07422" containerID="ab656e6a905dac6d475c432e7b0c157e3bd795406d10a074d7d82c844fcc90b1" exitCode=0
Jul 08 23:06:45.446741 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:45.446573    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc"
Jul 08 23:06:45.446741 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:45.446634    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc" event={"ID":"2a96cc40-1f13-4473-ad72-8e11dcc07422","Type":"ContainerDied","Data":"ab656e6a905dac6d475c432e7b0c157e3bd795406d10a074d7d82c844fcc90b1"}
Jul 08 23:06:45.446741 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:45.446695    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc" event={"ID":"2a96cc40-1f13-4473-ad72-8e11dcc07422","Type":"ContainerDied","Data":"d1607c7d3b44868f4436340319c8b55ddb5bc2e81d06079238e629bca152afab"}
Jul 08 23:06:45.446741 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:45.446728    2558 scope.go:117] "RemoveContainer" containerID="ab656e6a905dac6d475c432e7b0c157e3bd795406d10a074d7d82c844fcc90b1"
Jul 08 23:06:45.456614 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:45.456594    2558 scope.go:117] "RemoveContainer" containerID="ab656e6a905dac6d475c432e7b0c157e3bd795406d10a074d7d82c844fcc90b1"
Jul 08 23:06:45.456913 ip-10-0-136-6 kubenswrapper[2558]: E0708 23:06:45.456890    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab656e6a905dac6d475c432e7b0c157e3bd795406d10a074d7d82c844fcc90b1\": container with ID starting with ab656e6a905dac6d475c432e7b0c157e3bd795406d10a074d7d82c844fcc90b1 not found: ID does not exist" containerID="ab656e6a905dac6d475c432e7b0c157e3bd795406d10a074d7d82c844fcc90b1"
Jul 08 23:06:45.456992 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:45.456922    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab656e6a905dac6d475c432e7b0c157e3bd795406d10a074d7d82c844fcc90b1"} err="failed to get container status \"ab656e6a905dac6d475c432e7b0c157e3bd795406d10a074d7d82c844fcc90b1\": rpc error: code = NotFound desc = could not find container \"ab656e6a905dac6d475c432e7b0c157e3bd795406d10a074d7d82c844fcc90b1\": container with ID starting with ab656e6a905dac6d475c432e7b0c157e3bd795406d10a074d7d82c844fcc90b1 not found: ID does not exist"
Jul 08 23:06:45.463248 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:45.463229    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a96cc40-1f13-4473-ad72-8e11dcc07422-openshift-service-ca\") pod \"2a96cc40-1f13-4473-ad72-8e11dcc07422\" (UID: \"2a96cc40-1f13-4473-ad72-8e11dcc07422\") "
Jul 08 23:06:45.463330 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:45.463265    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vx9bs\" (UniqueName: \"kubernetes.io/projected/2a96cc40-1f13-4473-ad72-8e11dcc07422-kube-api-access-vx9bs\") pod \"2a96cc40-1f13-4473-ad72-8e11dcc07422\" (UID: \"2a96cc40-1f13-4473-ad72-8e11dcc07422\") "
Jul 08 23:06:45.463390 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:45.463330    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a96cc40-1f13-4473-ad72-8e11dcc07422-maas-api-tls\") pod \"2a96cc40-1f13-4473-ad72-8e11dcc07422\" (UID: \"2a96cc40-1f13-4473-ad72-8e11dcc07422\") "
Jul 08 23:06:45.463600 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:45.463574    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a96cc40-1f13-4473-ad72-8e11dcc07422-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2a96cc40-1f13-4473-ad72-8e11dcc07422" (UID: "2a96cc40-1f13-4473-ad72-8e11dcc07422"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:06:45.465423 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:45.465403    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a96cc40-1f13-4473-ad72-8e11dcc07422-kube-api-access-vx9bs" (OuterVolumeSpecName: "kube-api-access-vx9bs") pod "2a96cc40-1f13-4473-ad72-8e11dcc07422" (UID: "2a96cc40-1f13-4473-ad72-8e11dcc07422"). InnerVolumeSpecName "kube-api-access-vx9bs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:06:45.465538 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:45.465518    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a96cc40-1f13-4473-ad72-8e11dcc07422-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2a96cc40-1f13-4473-ad72-8e11dcc07422" (UID: "2a96cc40-1f13-4473-ad72-8e11dcc07422"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:06:45.564636 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:45.564606    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a96cc40-1f13-4473-ad72-8e11dcc07422-maas-api-tls\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:06:45.564636 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:45.564633    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a96cc40-1f13-4473-ad72-8e11dcc07422-openshift-service-ca\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:06:45.564636 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:45.564643    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vx9bs\" (UniqueName: \"kubernetes.io/projected/2a96cc40-1f13-4473-ad72-8e11dcc07422-kube-api-access-vx9bs\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:06:45.767217 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:45.767189    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc"]
Jul 08 23:06:45.773242 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:45.773220    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cead44-6ccd6f4979-q6tcc"]
Jul 08 23:06:46.773470 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:46.773433    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a96cc40-1f13-4473-ad72-8e11dcc07422" path="/var/lib/kubelet/pods/2a96cc40-1f13-4473-ad72-8e11dcc07422/volumes"
Jul 08 23:06:49.047502 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:49.047469    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:06:54.766695 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:54.766662    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v"]
Jul 08 23:06:54.767205 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:54.767062    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e14ad0b-6497-4b1a-b31b-16ee0d3ea037" containerName="maas-api"
Jul 08 23:06:54.767205 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:54.767074    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e14ad0b-6497-4b1a-b31b-16ee0d3ea037" containerName="maas-api"
Jul 08 23:06:54.767205 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:54.767103    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a96cc40-1f13-4473-ad72-8e11dcc07422" containerName="maas-api"
Jul 08 23:06:54.767205 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:54.767109    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a96cc40-1f13-4473-ad72-8e11dcc07422" containerName="maas-api"
Jul 08 23:06:54.767205 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:54.767166    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a96cc40-1f13-4473-ad72-8e11dcc07422" containerName="maas-api"
Jul 08 23:06:54.767205 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:54.767178    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e14ad0b-6497-4b1a-b31b-16ee0d3ea037" containerName="maas-api"
Jul 08 23:06:54.771600 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:54.771580    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v"
Jul 08 23:06:54.774088 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:54.774070    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-d4367d-serving-cert\""
Jul 08 23:06:54.785675 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:54.785648    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v"]
Jul 08 23:06:54.847840 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:54.847782    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff46f2c0-16cd-40af-a6b5-d6f90081514d-maas-api-tls\") pod \"maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v\" (UID: \"ff46f2c0-16cd-40af-a6b5-d6f90081514d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v"
Jul 08 23:06:54.847994 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:54.847932    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfg6z\" (UniqueName: \"kubernetes.io/projected/ff46f2c0-16cd-40af-a6b5-d6f90081514d-kube-api-access-tfg6z\") pod \"maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v\" (UID: \"ff46f2c0-16cd-40af-a6b5-d6f90081514d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v"
Jul 08 23:06:54.847994 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:54.847966    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff46f2c0-16cd-40af-a6b5-d6f90081514d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v\" (UID: \"ff46f2c0-16cd-40af-a6b5-d6f90081514d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v"
Jul 08 23:06:54.949240 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:54.949203    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff46f2c0-16cd-40af-a6b5-d6f90081514d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v\" (UID: \"ff46f2c0-16cd-40af-a6b5-d6f90081514d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v"
Jul 08 23:06:54.949399 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:54.949256    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff46f2c0-16cd-40af-a6b5-d6f90081514d-maas-api-tls\") pod \"maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v\" (UID: \"ff46f2c0-16cd-40af-a6b5-d6f90081514d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v"
Jul 08 23:06:54.949399 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:54.949343    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfg6z\" (UniqueName: \"kubernetes.io/projected/ff46f2c0-16cd-40af-a6b5-d6f90081514d-kube-api-access-tfg6z\") pod \"maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v\" (UID: \"ff46f2c0-16cd-40af-a6b5-d6f90081514d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v"
Jul 08 23:06:54.949515 ip-10-0-136-6 kubenswrapper[2558]: E0708 23:06:54.949420    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-serving-cert: secret "maas-api-e2e-shared-a-d4367d-serving-cert" not found
Jul 08 23:06:54.949515 ip-10-0-136-6 kubenswrapper[2558]: E0708 23:06:54.949489    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff46f2c0-16cd-40af-a6b5-d6f90081514d-maas-api-tls podName:ff46f2c0-16cd-40af-a6b5-d6f90081514d nodeName:}" failed. No retries permitted until 2026-07-08 23:06:55.449469711 +0000 UTC m=+2219.226205076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ff46f2c0-16cd-40af-a6b5-d6f90081514d-maas-api-tls") pod "maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v" (UID: "ff46f2c0-16cd-40af-a6b5-d6f90081514d") : secret "maas-api-e2e-shared-a-d4367d-serving-cert" not found
Jul 08 23:06:54.949931 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:54.949903    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff46f2c0-16cd-40af-a6b5-d6f90081514d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v\" (UID: \"ff46f2c0-16cd-40af-a6b5-d6f90081514d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v"
Jul 08 23:06:54.959727 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:54.959705    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfg6z\" (UniqueName: \"kubernetes.io/projected/ff46f2c0-16cd-40af-a6b5-d6f90081514d-kube-api-access-tfg6z\") pod \"maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v\" (UID: \"ff46f2c0-16cd-40af-a6b5-d6f90081514d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v"
Jul 08 23:06:55.454346 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:55.454312    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff46f2c0-16cd-40af-a6b5-d6f90081514d-maas-api-tls\") pod \"maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v\" (UID: \"ff46f2c0-16cd-40af-a6b5-d6f90081514d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v"
Jul 08 23:06:55.456958 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:55.456925    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff46f2c0-16cd-40af-a6b5-d6f90081514d-maas-api-tls\") pod \"maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v\" (UID: \"ff46f2c0-16cd-40af-a6b5-d6f90081514d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v"
Jul 08 23:06:55.681977 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:55.681935    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v"
Jul 08 23:06:55.825784 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:55.825758    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v"]
Jul 08 23:06:55.828071 ip-10-0-136-6 kubenswrapper[2558]: W0708 23:06:55.828045    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff46f2c0_16cd_40af_a6b5_d6f90081514d.slice/crio-93476152a10399a164e76292db1c414007b5246c90b55d08aa3de7a30c601298 WatchSource:0}: Error finding container 93476152a10399a164e76292db1c414007b5246c90b55d08aa3de7a30c601298: Status 404 returned error can't find the container with id 93476152a10399a164e76292db1c414007b5246c90b55d08aa3de7a30c601298
Jul 08 23:06:56.500280 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:56.500240    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v" event={"ID":"ff46f2c0-16cd-40af-a6b5-d6f90081514d","Type":"ContainerStarted","Data":"2ccdc6c1d62ca73083ce93344931312c84a4899dd866ef5db8f9c4f3e634fcba"}
Jul 08 23:06:56.500453 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:56.500299    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v" event={"ID":"ff46f2c0-16cd-40af-a6b5-d6f90081514d","Type":"ContainerStarted","Data":"93476152a10399a164e76292db1c414007b5246c90b55d08aa3de7a30c601298"}
Jul 08 23:06:56.500453 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:56.500419    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v"
Jul 08 23:06:56.516678 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:56.516632    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v" podStartSLOduration=2.057236275 podStartE2EDuration="2.516616324s" totalImagesPullingTime="459.380049ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:06:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:06:56.514474188 +0000 UTC m=+2220.291209577" watchObservedRunningTime="2026-07-08 23:06:56.516616324 +0000 UTC m=+2220.293351712"
Jul 08 23:06:56.924847 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:06:56.924819    2558 scope.go:117] "RemoveContainer" containerID="8958e19360f895b48b1d506250985204e9383b578fe378abb65e9b1708a73509"
Jul 08 23:07:00.736479 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:00.736447    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:07:02.511311 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:02.511278    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v"
Jul 08 23:07:02.722927 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:02.722896    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26"]
Jul 08 23:07:02.726430 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:02.726408    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26"
Jul 08 23:07:02.728736 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:02.728716    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-96e822-serving-cert\""
Jul 08 23:07:02.736038 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:02.736015    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26"]
Jul 08 23:07:02.824370 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:02.824339    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95895250-37df-43d5-8792-2df1b139e1da-openshift-service-ca\") pod \"maas-api-e2e-shared-b-96e822-5b5479c955-4tr26\" (UID: \"95895250-37df-43d5-8792-2df1b139e1da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26"
Jul 08 23:07:02.824526 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:02.824383    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95895250-37df-43d5-8792-2df1b139e1da-maas-api-tls\") pod \"maas-api-e2e-shared-b-96e822-5b5479c955-4tr26\" (UID: \"95895250-37df-43d5-8792-2df1b139e1da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26"
Jul 08 23:07:02.824526 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:02.824432    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlxgv\" (UniqueName: \"kubernetes.io/projected/95895250-37df-43d5-8792-2df1b139e1da-kube-api-access-vlxgv\") pod \"maas-api-e2e-shared-b-96e822-5b5479c955-4tr26\" (UID: \"95895250-37df-43d5-8792-2df1b139e1da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26"
Jul 08 23:07:02.924933 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:02.924898    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlxgv\" (UniqueName: \"kubernetes.io/projected/95895250-37df-43d5-8792-2df1b139e1da-kube-api-access-vlxgv\") pod \"maas-api-e2e-shared-b-96e822-5b5479c955-4tr26\" (UID: \"95895250-37df-43d5-8792-2df1b139e1da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26"
Jul 08 23:07:02.925100 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:02.924998    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95895250-37df-43d5-8792-2df1b139e1da-openshift-service-ca\") pod \"maas-api-e2e-shared-b-96e822-5b5479c955-4tr26\" (UID: \"95895250-37df-43d5-8792-2df1b139e1da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26"
Jul 08 23:07:02.925100 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:02.925026    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95895250-37df-43d5-8792-2df1b139e1da-maas-api-tls\") pod \"maas-api-e2e-shared-b-96e822-5b5479c955-4tr26\" (UID: \"95895250-37df-43d5-8792-2df1b139e1da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26"
Jul 08 23:07:02.925218 ip-10-0-136-6 kubenswrapper[2558]: E0708 23:07:02.925121    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-serving-cert: secret "maas-api-e2e-shared-b-96e822-serving-cert" not found
Jul 08 23:07:02.925218 ip-10-0-136-6 kubenswrapper[2558]: E0708 23:07:02.925187    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95895250-37df-43d5-8792-2df1b139e1da-maas-api-tls podName:95895250-37df-43d5-8792-2df1b139e1da nodeName:}" failed. No retries permitted until 2026-07-08 23:07:03.425170158 +0000 UTC m=+2227.201905525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/95895250-37df-43d5-8792-2df1b139e1da-maas-api-tls") pod "maas-api-e2e-shared-b-96e822-5b5479c955-4tr26" (UID: "95895250-37df-43d5-8792-2df1b139e1da") : secret "maas-api-e2e-shared-b-96e822-serving-cert" not found
Jul 08 23:07:02.925744 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:02.925719    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95895250-37df-43d5-8792-2df1b139e1da-openshift-service-ca\") pod \"maas-api-e2e-shared-b-96e822-5b5479c955-4tr26\" (UID: \"95895250-37df-43d5-8792-2df1b139e1da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26"
Jul 08 23:07:02.935262 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:02.935237    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlxgv\" (UniqueName: \"kubernetes.io/projected/95895250-37df-43d5-8792-2df1b139e1da-kube-api-access-vlxgv\") pod \"maas-api-e2e-shared-b-96e822-5b5479c955-4tr26\" (UID: \"95895250-37df-43d5-8792-2df1b139e1da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26"
Jul 08 23:07:03.428810 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:03.428761    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95895250-37df-43d5-8792-2df1b139e1da-maas-api-tls\") pod \"maas-api-e2e-shared-b-96e822-5b5479c955-4tr26\" (UID: \"95895250-37df-43d5-8792-2df1b139e1da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26"
Jul 08 23:07:03.431256 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:03.431234    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95895250-37df-43d5-8792-2df1b139e1da-maas-api-tls\") pod \"maas-api-e2e-shared-b-96e822-5b5479c955-4tr26\" (UID: \"95895250-37df-43d5-8792-2df1b139e1da\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26"
Jul 08 23:07:03.638072 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:03.638035    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26"
Jul 08 23:07:03.776551 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:03.776481    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26"]
Jul 08 23:07:03.779659 ip-10-0-136-6 kubenswrapper[2558]: W0708 23:07:03.779618    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95895250_37df_43d5_8792_2df1b139e1da.slice/crio-922016bf6ba5f54e009213964e02f08de0b2004498b366aa9c42e39c683d14ba WatchSource:0}: Error finding container 922016bf6ba5f54e009213964e02f08de0b2004498b366aa9c42e39c683d14ba: Status 404 returned error can't find the container with id 922016bf6ba5f54e009213964e02f08de0b2004498b366aa9c42e39c683d14ba
Jul 08 23:07:04.546046 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:04.545954    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26" event={"ID":"95895250-37df-43d5-8792-2df1b139e1da","Type":"ContainerStarted","Data":"4da63a99db2877b36bf1d0c667de4f200d1dd6bbe9275bb12217d0ad862c6e79"}
Jul 08 23:07:04.546046 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:04.546036    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26" event={"ID":"95895250-37df-43d5-8792-2df1b139e1da","Type":"ContainerStarted","Data":"922016bf6ba5f54e009213964e02f08de0b2004498b366aa9c42e39c683d14ba"}
Jul 08 23:07:04.546289 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:04.546095    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26"
Jul 08 23:07:04.562028 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:04.561984    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26" podStartSLOduration=2.229712454 podStartE2EDuration="2.561970739s" totalImagesPullingTime="332.258285ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:07:04.561724267 +0000 UTC m=+2228.338459655" watchObservedRunningTime="2026-07-08 23:07:04.561970739 +0000 UTC m=+2228.338706126"
Jul 08 23:07:10.556334 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:10.556306    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26"
Jul 08 23:07:13.143426 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:07:13.143392    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:10:12.618096 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:12.618060    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v"]
Jul 08 23:10:12.618689 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:12.618308    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v" podUID="ff46f2c0-16cd-40af-a6b5-d6f90081514d" containerName="maas-api" containerID="cri-o://2ccdc6c1d62ca73083ce93344931312c84a4899dd866ef5db8f9c4f3e634fcba" gracePeriod=30
Jul 08 23:10:12.867568 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:12.867541    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v"
Jul 08 23:10:12.907142 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:12.907068    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfg6z\" (UniqueName: \"kubernetes.io/projected/ff46f2c0-16cd-40af-a6b5-d6f90081514d-kube-api-access-tfg6z\") pod \"ff46f2c0-16cd-40af-a6b5-d6f90081514d\" (UID: \"ff46f2c0-16cd-40af-a6b5-d6f90081514d\") "
Jul 08 23:10:12.907282 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:12.907155    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff46f2c0-16cd-40af-a6b5-d6f90081514d-openshift-service-ca\") pod \"ff46f2c0-16cd-40af-a6b5-d6f90081514d\" (UID: \"ff46f2c0-16cd-40af-a6b5-d6f90081514d\") "
Jul 08 23:10:12.907345 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:12.907320    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff46f2c0-16cd-40af-a6b5-d6f90081514d-maas-api-tls\") pod \"ff46f2c0-16cd-40af-a6b5-d6f90081514d\" (UID: \"ff46f2c0-16cd-40af-a6b5-d6f90081514d\") "
Jul 08 23:10:12.907466 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:12.907446    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff46f2c0-16cd-40af-a6b5-d6f90081514d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ff46f2c0-16cd-40af-a6b5-d6f90081514d" (UID: "ff46f2c0-16cd-40af-a6b5-d6f90081514d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:10:12.907615 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:12.907602    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff46f2c0-16cd-40af-a6b5-d6f90081514d-openshift-service-ca\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:10:12.909283 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:12.909253    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff46f2c0-16cd-40af-a6b5-d6f90081514d-kube-api-access-tfg6z" (OuterVolumeSpecName: "kube-api-access-tfg6z") pod "ff46f2c0-16cd-40af-a6b5-d6f90081514d" (UID: "ff46f2c0-16cd-40af-a6b5-d6f90081514d"). InnerVolumeSpecName "kube-api-access-tfg6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:10:12.909419 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:12.909347    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff46f2c0-16cd-40af-a6b5-d6f90081514d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ff46f2c0-16cd-40af-a6b5-d6f90081514d" (UID: "ff46f2c0-16cd-40af-a6b5-d6f90081514d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:10:13.008373 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:13.008345    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff46f2c0-16cd-40af-a6b5-d6f90081514d-maas-api-tls\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:10:13.008373 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:13.008367    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfg6z\" (UniqueName: \"kubernetes.io/projected/ff46f2c0-16cd-40af-a6b5-d6f90081514d-kube-api-access-tfg6z\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:10:13.416795 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:13.416761    2558 generic.go:356] "Generic (PLEG): container finished" podID="ff46f2c0-16cd-40af-a6b5-d6f90081514d" containerID="2ccdc6c1d62ca73083ce93344931312c84a4899dd866ef5db8f9c4f3e634fcba" exitCode=0
Jul 08 23:10:13.416983 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:13.416824    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v"
Jul 08 23:10:13.416983 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:13.416855    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v" event={"ID":"ff46f2c0-16cd-40af-a6b5-d6f90081514d","Type":"ContainerDied","Data":"2ccdc6c1d62ca73083ce93344931312c84a4899dd866ef5db8f9c4f3e634fcba"}
Jul 08 23:10:13.416983 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:13.416944    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v" event={"ID":"ff46f2c0-16cd-40af-a6b5-d6f90081514d","Type":"ContainerDied","Data":"93476152a10399a164e76292db1c414007b5246c90b55d08aa3de7a30c601298"}
Jul 08 23:10:13.416983 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:13.416971    2558 scope.go:117] "RemoveContainer" containerID="2ccdc6c1d62ca73083ce93344931312c84a4899dd866ef5db8f9c4f3e634fcba"
Jul 08 23:10:13.426340 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:13.426323    2558 scope.go:117] "RemoveContainer" containerID="2ccdc6c1d62ca73083ce93344931312c84a4899dd866ef5db8f9c4f3e634fcba"
Jul 08 23:10:13.426582 ip-10-0-136-6 kubenswrapper[2558]: E0708 23:10:13.426564    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ccdc6c1d62ca73083ce93344931312c84a4899dd866ef5db8f9c4f3e634fcba\": container with ID starting with 2ccdc6c1d62ca73083ce93344931312c84a4899dd866ef5db8f9c4f3e634fcba not found: ID does not exist" containerID="2ccdc6c1d62ca73083ce93344931312c84a4899dd866ef5db8f9c4f3e634fcba"
Jul 08 23:10:13.426648 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:13.426589    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ccdc6c1d62ca73083ce93344931312c84a4899dd866ef5db8f9c4f3e634fcba"} err="failed to get container status \"2ccdc6c1d62ca73083ce93344931312c84a4899dd866ef5db8f9c4f3e634fcba\": rpc error: code = NotFound desc = could not find container \"2ccdc6c1d62ca73083ce93344931312c84a4899dd866ef5db8f9c4f3e634fcba\": container with ID starting with 2ccdc6c1d62ca73083ce93344931312c84a4899dd866ef5db8f9c4f3e634fcba not found: ID does not exist"
Jul 08 23:10:13.436807 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:13.436775    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v"]
Jul 08 23:10:13.439223 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:13.439201    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d4367d-679c5d9794-sww8v"]
Jul 08 23:10:14.772578 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:14.772542    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff46f2c0-16cd-40af-a6b5-d6f90081514d" path="/var/lib/kubelet/pods/ff46f2c0-16cd-40af-a6b5-d6f90081514d/volumes"
Jul 08 23:10:15.637836 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:15.637782    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:10:19.277098 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:19.277014    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26"]
Jul 08 23:10:19.277544 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:19.277259    2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26" podUID="95895250-37df-43d5-8792-2df1b139e1da" containerName="maas-api" containerID="cri-o://4da63a99db2877b36bf1d0c667de4f200d1dd6bbe9275bb12217d0ad862c6e79" gracePeriod=30
Jul 08 23:10:19.451500 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:19.451452    2558 generic.go:356] "Generic (PLEG): container finished" podID="95895250-37df-43d5-8792-2df1b139e1da" containerID="4da63a99db2877b36bf1d0c667de4f200d1dd6bbe9275bb12217d0ad862c6e79" exitCode=0
Jul 08 23:10:19.451661 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:19.451506    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26" event={"ID":"95895250-37df-43d5-8792-2df1b139e1da","Type":"ContainerDied","Data":"4da63a99db2877b36bf1d0c667de4f200d1dd6bbe9275bb12217d0ad862c6e79"}
Jul 08 23:10:19.517093 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:19.517069    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26"
Jul 08 23:10:19.567343 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:19.567315    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95895250-37df-43d5-8792-2df1b139e1da-openshift-service-ca\") pod \"95895250-37df-43d5-8792-2df1b139e1da\" (UID: \"95895250-37df-43d5-8792-2df1b139e1da\") "
Jul 08 23:10:19.567343 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:19.567344    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95895250-37df-43d5-8792-2df1b139e1da-maas-api-tls\") pod \"95895250-37df-43d5-8792-2df1b139e1da\" (UID: \"95895250-37df-43d5-8792-2df1b139e1da\") "
Jul 08 23:10:19.567530 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:19.567378    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlxgv\" (UniqueName: \"kubernetes.io/projected/95895250-37df-43d5-8792-2df1b139e1da-kube-api-access-vlxgv\") pod \"95895250-37df-43d5-8792-2df1b139e1da\" (UID: \"95895250-37df-43d5-8792-2df1b139e1da\") "
Jul 08 23:10:19.567756 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:19.567725    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95895250-37df-43d5-8792-2df1b139e1da-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "95895250-37df-43d5-8792-2df1b139e1da" (UID: "95895250-37df-43d5-8792-2df1b139e1da"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:10:19.569572 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:19.569553    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95895250-37df-43d5-8792-2df1b139e1da-kube-api-access-vlxgv" (OuterVolumeSpecName: "kube-api-access-vlxgv") pod "95895250-37df-43d5-8792-2df1b139e1da" (UID: "95895250-37df-43d5-8792-2df1b139e1da"). InnerVolumeSpecName "kube-api-access-vlxgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:10:19.569666 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:19.569583    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95895250-37df-43d5-8792-2df1b139e1da-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "95895250-37df-43d5-8792-2df1b139e1da" (UID: "95895250-37df-43d5-8792-2df1b139e1da"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:10:19.668679 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:19.668648    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95895250-37df-43d5-8792-2df1b139e1da-openshift-service-ca\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:10:19.668679 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:19.668672    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95895250-37df-43d5-8792-2df1b139e1da-maas-api-tls\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:10:19.668679 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:19.668681    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlxgv\" (UniqueName: \"kubernetes.io/projected/95895250-37df-43d5-8792-2df1b139e1da-kube-api-access-vlxgv\") on node \"ip-10-0-136-6.ec2.internal\" DevicePath \"\""
Jul 08 23:10:20.457153 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:20.457126    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26"
Jul 08 23:10:20.457614 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:20.457162    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26" event={"ID":"95895250-37df-43d5-8792-2df1b139e1da","Type":"ContainerDied","Data":"922016bf6ba5f54e009213964e02f08de0b2004498b366aa9c42e39c683d14ba"}
Jul 08 23:10:20.457614 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:20.457215    2558 scope.go:117] "RemoveContainer" containerID="4da63a99db2877b36bf1d0c667de4f200d1dd6bbe9275bb12217d0ad862c6e79"
Jul 08 23:10:20.478101 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:20.478077    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26"]
Jul 08 23:10:20.481633 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:20.481612    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-96e822-5b5479c955-4tr26"]
Jul 08 23:10:20.773263 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:20.773186    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95895250-37df-43d5-8792-2df1b139e1da" path="/var/lib/kubelet/pods/95895250-37df-43d5-8792-2df1b139e1da/volumes"
Jul 08 23:10:27.732656 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:27.732618    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-brlwv"]
Jul 08 23:10:30.072067 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:30.072038    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8ntpk_9a355972-0ee6-45d3-b141-17be2aba5527/manager/0.log"
Jul 08 23:10:30.302146 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:30.302114    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-678658b869-lswll_99958f87-4620-4350-9eb1-b271041b065f/manager/0.log"
Jul 08 23:10:30.412849 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:30.412755    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-bcj2q_1e614f8e-d451-4cee-b0c4-9cc14ace0b3e/server/0.log"
Jul 08 23:10:30.525481 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:30.525453    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-w449w_98bdbae2-2338-400f-823f-779dcd660cfc/manager/0.log"
Jul 08 23:10:30.749830 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:30.749742    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67f464889d-dfddc_73ddd36b-55ea-474b-b653-9d29fa69e1c5/manager/0.log"
Jul 08 23:10:30.755403 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:30.755385    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67f464889d-dfddc_73ddd36b-55ea-474b-b653-9d29fa69e1c5/copy-manifests/0.log"
Jul 08 23:10:32.231087 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:32.231059    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kzk4q_b387d5d9-9a5c-4202-a843-be797192bb69/manager/0.log"
Jul 08 23:10:32.343047 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:32.343015    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6xlvg_4d5a10ab-355c-4a59-8c39-59cd08eb23b2/manager/0.log"
Jul 08 23:10:32.446898 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:32.446871    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-4rx8g_4f477de4-3333-4314-abbc-0a263e72d1cd/kuadrant-console-plugin/0.log"
Jul 08 23:10:32.559462 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:32.559439    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-m8mcw_0ca97ee4-84ba-4027-ac4f-91f1b4d4ecd1/registry-server/0.log"
Jul 08 23:10:32.669944 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:32.669913    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jvfxp_ce4bce49-2975-4a0c-b87b-de83ee429bef/manager/0.log"
Jul 08 23:10:32.775676 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:32.775644    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-brlwv_6e9974af-8c2c-44af-a8d8-902c474c80e9/limitador/0.log"
Jul 08 23:10:33.439691 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:33.439649    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d9656f865-vdgx4_99a75cf9-46df-4253-8bac-84d6f5fc0d01/kube-auth-proxy/0.log"
Jul 08 23:10:33.782866 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:33.782740    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qd29p_5545e99e-04d8-4894-990c-207bf98af8c8/payload-pre-processing/0.log"
Jul 08 23:10:34.449355 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:34.449325    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-bg5ct_bad63d88-ada3-4032-bcfa-c53739cfaf8b/main/0.log"
Jul 08 23:10:34.558053 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:34.558027    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-mbwkz_6db9e90c-cf86-4512-acd5-7702c7c36d96/main/0.log"
Jul 08 23:10:34.666927 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:34.666901    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbml8c4_4394a6c0-1c2f-4179-8e49-28c2b0cfd237/main/0.log"
Jul 08 23:10:34.882816 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:34.882769    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-9gfn7_baf56c61-1793-4450-a649-5531bef11456/main/0.log"
Jul 08 23:10:38.902201 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:38.902166    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-86dvd/must-gather-sh5dz"]
Jul 08 23:10:38.902576 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:38.902513    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff46f2c0-16cd-40af-a6b5-d6f90081514d" containerName="maas-api"
Jul 08 23:10:38.902576 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:38.902523    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff46f2c0-16cd-40af-a6b5-d6f90081514d" containerName="maas-api"
Jul 08 23:10:38.902576 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:38.902542    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95895250-37df-43d5-8792-2df1b139e1da" containerName="maas-api"
Jul 08 23:10:38.902576 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:38.902548    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="95895250-37df-43d5-8792-2df1b139e1da" containerName="maas-api"
Jul 08 23:10:38.902705 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:38.902606    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="95895250-37df-43d5-8792-2df1b139e1da" containerName="maas-api"
Jul 08 23:10:38.902705 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:38.902618    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff46f2c0-16cd-40af-a6b5-d6f90081514d" containerName="maas-api"
Jul 08 23:10:38.905879 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:38.905858    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-86dvd/must-gather-sh5dz"
Jul 08 23:10:38.908343 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:38.908322    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-86dvd\"/\"openshift-service-ca.crt\""
Jul 08 23:10:38.909338 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:38.909317    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-86dvd\"/\"default-dockercfg-cpnsg\""
Jul 08 23:10:38.909408 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:38.909321    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-86dvd\"/\"kube-root-ca.crt\""
Jul 08 23:10:38.914020 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:38.913998    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-86dvd/must-gather-sh5dz"]
Jul 08 23:10:39.049065 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:39.049026    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/56633c27-e33f-45b7-b7a7-fc0a99f3860e-must-gather-output\") pod \"must-gather-sh5dz\" (UID: \"56633c27-e33f-45b7-b7a7-fc0a99f3860e\") " pod="openshift-must-gather-86dvd/must-gather-sh5dz"
Jul 08 23:10:39.049065 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:39.049061    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdd8b\" (UniqueName: \"kubernetes.io/projected/56633c27-e33f-45b7-b7a7-fc0a99f3860e-kube-api-access-pdd8b\") pod \"must-gather-sh5dz\" (UID: \"56633c27-e33f-45b7-b7a7-fc0a99f3860e\") " pod="openshift-must-gather-86dvd/must-gather-sh5dz"
Jul 08 23:10:39.149783 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:39.149745    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/56633c27-e33f-45b7-b7a7-fc0a99f3860e-must-gather-output\") pod \"must-gather-sh5dz\" (UID: \"56633c27-e33f-45b7-b7a7-fc0a99f3860e\") " pod="openshift-must-gather-86dvd/must-gather-sh5dz"
Jul 08 23:10:39.149783 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:39.149781    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdd8b\" (UniqueName: \"kubernetes.io/projected/56633c27-e33f-45b7-b7a7-fc0a99f3860e-kube-api-access-pdd8b\") pod \"must-gather-sh5dz\" (UID: \"56633c27-e33f-45b7-b7a7-fc0a99f3860e\") " pod="openshift-must-gather-86dvd/must-gather-sh5dz"
Jul 08 23:10:39.150114 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:39.150091    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/56633c27-e33f-45b7-b7a7-fc0a99f3860e-must-gather-output\") pod \"must-gather-sh5dz\" (UID: \"56633c27-e33f-45b7-b7a7-fc0a99f3860e\") " pod="openshift-must-gather-86dvd/must-gather-sh5dz"
Jul 08 23:10:39.157517 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:39.157462    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdd8b\" (UniqueName: \"kubernetes.io/projected/56633c27-e33f-45b7-b7a7-fc0a99f3860e-kube-api-access-pdd8b\") pod \"must-gather-sh5dz\" (UID: \"56633c27-e33f-45b7-b7a7-fc0a99f3860e\") " pod="openshift-must-gather-86dvd/must-gather-sh5dz"
Jul 08 23:10:39.215748 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:39.215704    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-86dvd/must-gather-sh5dz"
Jul 08 23:10:39.349005 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:39.348977    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-86dvd/must-gather-sh5dz"]
Jul 08 23:10:39.350888 ip-10-0-136-6 kubenswrapper[2558]: W0708 23:10:39.350858    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56633c27_e33f_45b7_b7a7_fc0a99f3860e.slice/crio-aa3bafe70c310ebe75f072f40d4b82c4a1823b826296f8b1e99154a8defef77c WatchSource:0}: Error finding container aa3bafe70c310ebe75f072f40d4b82c4a1823b826296f8b1e99154a8defef77c: Status 404 returned error can't find the container with id aa3bafe70c310ebe75f072f40d4b82c4a1823b826296f8b1e99154a8defef77c
Jul 08 23:10:39.353131 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:39.353103    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 23:10:39.545908 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:39.545815    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-86dvd/must-gather-sh5dz" event={"ID":"56633c27-e33f-45b7-b7a7-fc0a99f3860e","Type":"ContainerStarted","Data":"aa3bafe70c310ebe75f072f40d4b82c4a1823b826296f8b1e99154a8defef77c"}
Jul 08 23:10:41.559359 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:41.559318    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-86dvd/must-gather-sh5dz" event={"ID":"56633c27-e33f-45b7-b7a7-fc0a99f3860e","Type":"ContainerStarted","Data":"1d0a36ac34bfbe65248569de9f2320551309d2d10f407c9df44767d3d0cceaf0"}
Jul 08 23:10:41.559359 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:41.559366    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-86dvd/must-gather-sh5dz" event={"ID":"56633c27-e33f-45b7-b7a7-fc0a99f3860e","Type":"ContainerStarted","Data":"88f7f152fd5abf180561da58bb53c073e05ebd13a48a87c7cc571596628c472e"}
Jul 08 23:10:41.574609 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:41.574557    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-86dvd/must-gather-sh5dz" podStartSLOduration=2.467764627 podStartE2EDuration="3.574541004s" totalImagesPullingTime="1.106776377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:10:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:10:41.572840563 +0000 UTC m=+2445.349575952" watchObservedRunningTime="2026-07-08 23:10:41.574541004 +0000 UTC m=+2445.351276391"
Jul 08 23:10:42.033118 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:42.033040    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ztbq2_8e133bfb-27da-4990-aac3-8ea961563fd8/global-pull-secret-syncer/0.log"
Jul 08 23:10:42.130850 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:42.130816    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rx5xn_6aa3ac3b-8e3c-4b9b-b33e-03aaf9676e60/konnectivity-agent/0.log"
Jul 08 23:10:42.191767 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:42.191737    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-6.ec2.internal_1ee323fd0beeb4f4f4622b1412db9e81/haproxy/0.log"
Jul 08 23:10:47.081596 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:47.081566    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kzk4q_b387d5d9-9a5c-4202-a843-be797192bb69/manager/0.log"
Jul 08 23:10:47.104293 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:47.104255    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6xlvg_4d5a10ab-355c-4a59-8c39-59cd08eb23b2/manager/0.log"
Jul 08 23:10:47.127101 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:47.126995    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-4rx8g_4f477de4-3333-4314-abbc-0a263e72d1cd/kuadrant-console-plugin/0.log"
Jul 08 23:10:47.166436 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:47.166400    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-m8mcw_0ca97ee4-84ba-4027-ac4f-91f1b4d4ecd1/registry-server/0.log"
Jul 08 23:10:47.327069 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:47.327039    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jvfxp_ce4bce49-2975-4a0c-b87b-de83ee429bef/manager/0.log"
Jul 08 23:10:47.352960 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:47.352880    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-brlwv_6e9974af-8c2c-44af-a8d8-902c474c80e9/limitador/0.log"
Jul 08 23:10:49.097115 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:49.097088    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7f67c8c8b6-6flj9_8d3aaf9c-592d-4225-bf3e-e39d19d11a26/metrics-server/0.log"
Jul 08 23:10:49.154212 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:49.154185    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hj72l_5cb9d783-9d93-4aca-a7de-f4053a1a370b/node-exporter/0.log"
Jul 08 23:10:49.173683 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:49.173641    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hj72l_5cb9d783-9d93-4aca-a7de-f4053a1a370b/kube-rbac-proxy/0.log"
Jul 08 23:10:49.193266 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:49.193243    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hj72l_5cb9d783-9d93-4aca-a7de-f4053a1a370b/init-textfile/0.log"
Jul 08 23:10:49.774247 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:49.774120    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fb68d668c-98w7k_128fb5ef-7ae2-469a-986f-ea27e220fd34/telemeter-client/0.log"
Jul 08 23:10:49.799352 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:49.799326    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fb68d668c-98w7k_128fb5ef-7ae2-469a-986f-ea27e220fd34/reload/0.log"
Jul 08 23:10:49.822496 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:49.822467    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fb68d668c-98w7k_128fb5ef-7ae2-469a-986f-ea27e220fd34/kube-rbac-proxy/0.log"
Jul 08 23:10:52.353597 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:52.353554    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl"]
Jul 08 23:10:52.356610 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:52.356576    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl"
Jul 08 23:10:52.368762 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:52.368727    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl"]
Jul 08 23:10:52.390466 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:52.390433    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a1c02a9f-fcb4-468d-90c3-72f0e82e6b19-podres\") pod \"perf-node-gather-daemonset-2m6jl\" (UID: \"a1c02a9f-fcb4-468d-90c3-72f0e82e6b19\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl"
Jul 08 23:10:52.390466 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:52.390476    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1c02a9f-fcb4-468d-90c3-72f0e82e6b19-sys\") pod \"perf-node-gather-daemonset-2m6jl\" (UID: \"a1c02a9f-fcb4-468d-90c3-72f0e82e6b19\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl"
Jul 08 23:10:52.390785 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:52.390525    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sw8s\" (UniqueName: \"kubernetes.io/projected/a1c02a9f-fcb4-468d-90c3-72f0e82e6b19-kube-api-access-8sw8s\") pod \"perf-node-gather-daemonset-2m6jl\" (UID: \"a1c02a9f-fcb4-468d-90c3-72f0e82e6b19\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl"
Jul 08 23:10:52.390785 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:52.390585    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a1c02a9f-fcb4-468d-90c3-72f0e82e6b19-lib-modules\") pod \"perf-node-gather-daemonset-2m6jl\" (UID: \"a1c02a9f-fcb4-468d-90c3-72f0e82e6b19\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl"
Jul 08 23:10:52.390785 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:52.390620    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a1c02a9f-fcb4-468d-90c3-72f0e82e6b19-proc\") pod \"perf-node-gather-daemonset-2m6jl\" (UID: \"a1c02a9f-fcb4-468d-90c3-72f0e82e6b19\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl"
Jul 08 23:10:52.491764 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:52.491732    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a1c02a9f-fcb4-468d-90c3-72f0e82e6b19-podres\") pod \"perf-node-gather-daemonset-2m6jl\" (UID: \"a1c02a9f-fcb4-468d-90c3-72f0e82e6b19\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl"
Jul 08 23:10:52.491764 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:52.491775    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1c02a9f-fcb4-468d-90c3-72f0e82e6b19-sys\") pod \"perf-node-gather-daemonset-2m6jl\" (UID: \"a1c02a9f-fcb4-468d-90c3-72f0e82e6b19\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl"
Jul 08 23:10:52.492038 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:52.491838    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sw8s\" (UniqueName: \"kubernetes.io/projected/a1c02a9f-fcb4-468d-90c3-72f0e82e6b19-kube-api-access-8sw8s\") pod \"perf-node-gather-daemonset-2m6jl\" (UID: \"a1c02a9f-fcb4-468d-90c3-72f0e82e6b19\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl"
Jul 08 23:10:52.492038 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:52.491896    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a1c02a9f-fcb4-468d-90c3-72f0e82e6b19-lib-modules\") pod \"perf-node-gather-daemonset-2m6jl\" (UID: \"a1c02a9f-fcb4-468d-90c3-72f0e82e6b19\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl"
Jul 08 23:10:52.492038 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:52.491929    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a1c02a9f-fcb4-468d-90c3-72f0e82e6b19-proc\") pod \"perf-node-gather-daemonset-2m6jl\" (UID: \"a1c02a9f-fcb4-468d-90c3-72f0e82e6b19\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl"
Jul 08 23:10:52.492190 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:52.492062    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a1c02a9f-fcb4-468d-90c3-72f0e82e6b19-proc\") pod \"perf-node-gather-daemonset-2m6jl\" (UID: \"a1c02a9f-fcb4-468d-90c3-72f0e82e6b19\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl"
Jul 08 23:10:52.492268 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:52.492187    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a1c02a9f-fcb4-468d-90c3-72f0e82e6b19-podres\") pod \"perf-node-gather-daemonset-2m6jl\" (UID: \"a1c02a9f-fcb4-468d-90c3-72f0e82e6b19\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl"
Jul 08 23:10:52.492268 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:52.492236    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1c02a9f-fcb4-468d-90c3-72f0e82e6b19-sys\") pod \"perf-node-gather-daemonset-2m6jl\" (UID: \"a1c02a9f-fcb4-468d-90c3-72f0e82e6b19\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl"
Jul 08 23:10:52.492504 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:52.492478    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a1c02a9f-fcb4-468d-90c3-72f0e82e6b19-lib-modules\") pod \"perf-node-gather-daemonset-2m6jl\" (UID: \"a1c02a9f-fcb4-468d-90c3-72f0e82e6b19\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl"
Jul 08 23:10:52.500639 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:52.500613    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sw8s\" (UniqueName: \"kubernetes.io/projected/a1c02a9f-fcb4-468d-90c3-72f0e82e6b19-kube-api-access-8sw8s\") pod \"perf-node-gather-daemonset-2m6jl\" (UID: \"a1c02a9f-fcb4-468d-90c3-72f0e82e6b19\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl"
Jul 08 23:10:52.670599 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:52.670508    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl"
Jul 08 23:10:52.854281 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:52.854235    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl"]
Jul 08 23:10:53.646481 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:53.646438    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl" event={"ID":"a1c02a9f-fcb4-468d-90c3-72f0e82e6b19","Type":"ContainerStarted","Data":"7cdc54223cfba4e1956466e51bdb80975f6352a6c40a6e00e4a56fd061a37665"}
Jul 08 23:10:53.646907 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:53.646499    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl" event={"ID":"a1c02a9f-fcb4-468d-90c3-72f0e82e6b19","Type":"ContainerStarted","Data":"d06701d286257f4666a57bde5b912cad913e70c33e49d09afef98d148c6c1d46"}
Jul 08 23:10:53.646907 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:53.646573    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl"
Jul 08 23:10:53.661674 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:53.661612    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl" podStartSLOduration=1.6615907490000001 podStartE2EDuration="1.661590749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:10:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:10:53.660701629 +0000 UTC m=+2457.437437016" watchObservedRunningTime="2026-07-08 23:10:53.661590749 +0000 UTC m=+2457.438326137"
Jul 08 23:10:54.159015 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:54.158979    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pj4jv_01a27f4f-0263-4eca-b756-54b31715f955/dns/0.log"
Jul 08 23:10:54.177312 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:54.177284    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pj4jv_01a27f4f-0263-4eca-b756-54b31715f955/kube-rbac-proxy/0.log"
Jul 08 23:10:54.220171 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:54.220137    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bkxht_d08b2cb9-aff6-407b-9a7f-5b72d056ac1f/dns-node-resolver/0.log"
Jul 08 23:10:54.765022 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:54.764991    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-74c8bd875c-6qdzt_86babb4e-d7ea-42f7-a9d3-5c894857ee54/registry/0.log"
Jul 08 23:10:54.807863 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:54.807835    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ncmmp_13d80c7f-b517-4acf-8354-a317c8e556c8/node-ca/0.log"
Jul 08 23:10:55.834037 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:55.834013    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d9656f865-vdgx4_99a75cf9-46df-4253-8bac-84d6f5fc0d01/kube-auth-proxy/0.log"
Jul 08 23:10:55.955953 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:55.955921    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qd29p_5545e99e-04d8-4894-990c-207bf98af8c8/payload-pre-processing/0.log"
Jul 08 23:10:56.742575 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:56.742546    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jgstm_95cba72c-b37c-4ead-bf9d-c66d377b90f7/serve-healthcheck-canary/0.log"
Jul 08 23:10:57.229282 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:57.229255    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2qlw7_47824c1a-b4a0-4799-89af-6bb306075d89/kube-rbac-proxy/0.log"
Jul 08 23:10:57.247245 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:57.247159    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2qlw7_47824c1a-b4a0-4799-89af-6bb306075d89/exporter/0.log"
Jul 08 23:10:57.268498 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:57.268470    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2qlw7_47824c1a-b4a0-4799-89af-6bb306075d89/extractor/0.log"
Jul 08 23:10:59.391039 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:59.390990    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8ntpk_9a355972-0ee6-45d3-b141-17be2aba5527/manager/0.log"
Jul 08 23:10:59.597145 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:59.597108    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-678658b869-lswll_99958f87-4620-4350-9eb1-b271041b065f/manager/0.log"
Jul 08 23:10:59.615681 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:59.615652    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-bcj2q_1e614f8e-d451-4cee-b0c4-9cc14ace0b3e/server/0.log"
Jul 08 23:10:59.669116 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:59.669030    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-2m6jl"
Jul 08 23:10:59.688049 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:59.688014    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-w449w_98bdbae2-2338-400f-823f-779dcd660cfc/manager/0.log"
Jul 08 23:10:59.806366 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:59.806335    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67f464889d-dfddc_73ddd36b-55ea-474b-b653-9d29fa69e1c5/manager/0.log"
Jul 08 23:10:59.821696 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:10:59.821661    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67f464889d-dfddc_73ddd36b-55ea-474b-b653-9d29fa69e1c5/copy-manifests/0.log"
Jul 08 23:11:02.674379 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:11:02.674355    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d9656f865-vdgx4_99a75cf9-46df-4253-8bac-84d6f5fc0d01/kube-auth-proxy/0.log"
Jul 08 23:11:02.766725 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:11:02.766636    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qd29p_5545e99e-04d8-4894-990c-207bf98af8c8/payload-pre-processing/0.log"
Jul 08 23:11:04.265285 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:11:04.265256    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d9656f865-vdgx4_99a75cf9-46df-4253-8bac-84d6f5fc0d01/kube-auth-proxy/0.log"
Jul 08 23:11:04.367693 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:11:04.367663    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qd29p_5545e99e-04d8-4894-990c-207bf98af8c8/payload-pre-processing/0.log"
Jul 08 23:11:07.741827 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:11:07.741772    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2ctjg_8b2130bb-674a-4490-9da0-9576901ea3b5/kube-multus-additional-cni-plugins/0.log"
Jul 08 23:11:07.762475 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:11:07.762453    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2ctjg_8b2130bb-674a-4490-9da0-9576901ea3b5/egress-router-binary-copy/0.log"
Jul 08 23:11:07.780887 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:11:07.780856    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2ctjg_8b2130bb-674a-4490-9da0-9576901ea3b5/cni-plugins/0.log"
Jul 08 23:11:07.801307 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:11:07.801283    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2ctjg_8b2130bb-674a-4490-9da0-9576901ea3b5/bond-cni-plugin/0.log"
Jul 08 23:11:07.819384 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:11:07.819366    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2ctjg_8b2130bb-674a-4490-9da0-9576901ea3b5/routeoverride-cni/0.log"
Jul 08 23:11:07.837767 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:11:07.837748    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2ctjg_8b2130bb-674a-4490-9da0-9576901ea3b5/whereabouts-cni-bincopy/0.log"
Jul 08 23:11:07.855010 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:11:07.854988    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2ctjg_8b2130bb-674a-4490-9da0-9576901ea3b5/whereabouts-cni/0.log"
Jul 08 23:11:08.182162 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:11:08.182132    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zkxcb_2d7cf662-b5c8-4f57-a9be-fabe9b63b441/kube-multus/0.log"
Jul 08 23:11:08.356751 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:11:08.356721    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dnccf_5ec93cb5-8277-4f5c-a711-1fca9b9cc78a/network-metrics-daemon/0.log"
Jul 08 23:11:08.373393 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:11:08.373369    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dnccf_5ec93cb5-8277-4f5c-a711-1fca9b9cc78a/kube-rbac-proxy/0.log"
Jul 08 23:11:09.187005 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:11:09.186967    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2484w_69e328b9-bad4-4f6e-8a09-1822adbf2806/ovn-controller/0.log"
Jul 08 23:11:09.206874 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:11:09.206852    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2484w_69e328b9-bad4-4f6e-8a09-1822adbf2806/ovn-acl-logging/0.log"
Jul 08 23:11:09.232452 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:11:09.232431    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2484w_69e328b9-bad4-4f6e-8a09-1822adbf2806/kube-rbac-proxy-node/0.log"
Jul 08 23:11:09.252438 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:11:09.252416    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2484w_69e328b9-bad4-4f6e-8a09-1822adbf2806/kube-rbac-proxy-ovn-metrics/0.log"
Jul 08 23:11:09.267314 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:11:09.267292    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2484w_69e328b9-bad4-4f6e-8a09-1822adbf2806/northd/0.log"
Jul 08 23:11:09.285360 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:11:09.285340    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2484w_69e328b9-bad4-4f6e-8a09-1822adbf2806/nbdb/0.log"
Jul 08 23:11:09.304389 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:11:09.304370    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2484w_69e328b9-bad4-4f6e-8a09-1822adbf2806/sbdb/0.log"
Jul 08 23:11:09.354380 ip-10-0-136-6 kubenswrapper[2558]: I0708 23:11:09.354351    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2484w_69e328b9-bad4-4f6e-8a09-1822adbf2806/ovnkube-controller/0.log"