Jul 05 13:18:17.064960 ip-10-0-129-22 systemd[1]: Starting Kubernetes Kubelet...
Jul 05 13:18:17.562882 ip-10-0-129-22 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 05 13:18:17.562882 ip-10-0-129-22 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 05 13:18:17.562882 ip-10-0-129-22 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 05 13:18:17.562882 ip-10-0-129-22 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 05 13:18:17.562882 ip-10-0-129-22 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 05 13:18:17.562882 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.457450    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 05 13:18:17.562882 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464125    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 13:18:17.562882 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464148    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 13:18:17.562882 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464151    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 13:18:17.562882 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464154    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 13:18:17.562882 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464157    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 13:18:17.562882 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464160    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 13:18:17.562882 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464166    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 13:18:17.562882 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464170    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 13:18:17.531188 ip-10-0-129-22 systemd[1]: Started Kubernetes Kubelet.
Jul 05 13:18:17.564005 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464173    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 13:18:17.564005 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464176    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 13:18:17.564005 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464179    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 13:18:17.564005 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464186    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 13:18:17.564005 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464189    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 13:18:17.564005 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464192    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 13:18:17.564005 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464195    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 13:18:17.564005 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464198    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 13:18:17.564005 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464201    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 13:18:17.564005 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464211    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 13:18:17.564005 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464215    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 13:18:17.564005 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464217    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 13:18:17.564005 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464220    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 13:18:17.564005 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464223    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 13:18:17.564005 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464226    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 13:18:17.564005 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464229    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 13:18:17.564005 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464232    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 13:18:17.564005 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464234    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 13:18:17.564005 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464237    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 13:18:17.564005 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464240    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 13:18:17.564962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464244    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 13:18:17.564962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464247    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 13:18:17.564962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464249    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 13:18:17.564962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464252    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 13:18:17.564962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464255    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 13:18:17.564962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464259    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 13:18:17.564962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464263    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 13:18:17.564962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464266    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 13:18:17.564962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464270    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 13:18:17.564962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464274    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 13:18:17.564962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464276    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 13:18:17.564962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464279    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 13:18:17.564962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464281    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 13:18:17.564962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464284    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 13:18:17.564962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464287    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 13:18:17.564962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464289    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 13:18:17.564962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464292    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 13:18:17.564962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464294    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 13:18:17.564962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464297    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 13:18:17.565557 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464299    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 13:18:17.565557 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464302    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 13:18:17.565557 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464305    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 13:18:17.565557 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464307    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 13:18:17.565557 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464310    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 13:18:17.565557 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464313    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 13:18:17.565557 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464315    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 13:18:17.565557 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464318    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 13:18:17.565557 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464320    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 13:18:17.565557 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464323    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 13:18:17.565557 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464326    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 13:18:17.565557 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464330    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 13:18:17.565557 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464333    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 13:18:17.565557 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464335    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 13:18:17.565557 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464337    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 13:18:17.565557 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464340    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 13:18:17.565557 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464342    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 13:18:17.565557 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464346    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 13:18:17.565557 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464348    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 13:18:17.565557 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464350    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 13:18:17.566364 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464353    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 13:18:17.566364 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464356    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 13:18:17.566364 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464359    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 13:18:17.566364 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464363    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 13:18:17.566364 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464366    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 13:18:17.566364 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464369    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 13:18:17.566364 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464371    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 13:18:17.566364 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464375    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 13:18:17.566364 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464378    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 13:18:17.566364 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464380    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 13:18:17.566364 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464384    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 13:18:17.566364 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464387    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 13:18:17.566364 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464390    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 13:18:17.566364 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464393    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 13:18:17.566364 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464396    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 13:18:17.566364 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464398    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 13:18:17.566364 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464400    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 13:18:17.566364 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464403    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 13:18:17.566364 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464406    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 13:18:17.567205 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464408    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 13:18:17.567205 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464411    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 13:18:17.567205 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464413    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 13:18:17.567205 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464416    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 13:18:17.567205 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464419    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 13:18:17.567205 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464421    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 13:18:17.567205 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464423    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 13:18:17.567205 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464426    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 13:18:17.567205 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464429    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 13:18:17.567205 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464432    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 13:18:17.567205 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464434    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 13:18:17.567205 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464437    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 13:18:17.567205 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.464440    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 13:18:17.567205 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467328    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 13:18:17.567205 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467337    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 13:18:17.567205 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467341    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 13:18:17.567205 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467345    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 13:18:17.567205 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467350    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 13:18:17.567205 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467353    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 13:18:17.567205 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467356    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 13:18:17.568263 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467360    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 13:18:17.568263 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467362    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 13:18:17.568263 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467365    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 13:18:17.568263 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467368    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 13:18:17.568263 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467371    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 13:18:17.568263 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467374    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 13:18:17.568263 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467377    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 13:18:17.568263 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467380    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 13:18:17.568263 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467383    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 13:18:17.568263 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467385    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 13:18:17.568263 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467389    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 13:18:17.568263 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467393    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 13:18:17.568263 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467396    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 13:18:17.568263 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467399    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 13:18:17.568263 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467401    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 13:18:17.568263 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467404    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 13:18:17.568263 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467407    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 13:18:17.568263 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467409    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 13:18:17.568263 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467412    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 13:18:17.568263 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467414    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 13:18:17.569053 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467417    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 13:18:17.569053 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467420    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 13:18:17.569053 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467423    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 13:18:17.569053 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467425    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 13:18:17.569053 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467428    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 13:18:17.569053 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467431    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 13:18:17.569053 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467433    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 13:18:17.569053 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467436    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 13:18:17.569053 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467439    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 13:18:17.569053 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467441    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 13:18:17.569053 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467444    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 13:18:17.569053 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467446    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 13:18:17.569053 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467449    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 13:18:17.569053 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467451    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 13:18:17.569053 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467454    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 13:18:17.569053 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467456    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 13:18:17.569053 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467458    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 13:18:17.569053 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467461    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 13:18:17.569053 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467464    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 13:18:17.569053 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467466    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 13:18:17.569942 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467469    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 13:18:17.569942 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467471    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 13:18:17.569942 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467474    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 13:18:17.569942 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467477    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 13:18:17.569942 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467481    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 13:18:17.569942 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467484    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 13:18:17.569942 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467486    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 13:18:17.569942 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467490    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 13:18:17.569942 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467492    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 13:18:17.569942 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467495    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 13:18:17.569942 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467497    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 13:18:17.569942 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467500    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 13:18:17.569942 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467502    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 13:18:17.569942 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467505    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 13:18:17.569942 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467508    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 13:18:17.569942 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467511    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 13:18:17.569942 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467513    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 13:18:17.569942 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467516    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 13:18:17.569942 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467519    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 13:18:17.570580 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467522    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 13:18:17.570580 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467526    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 13:18:17.570580 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467529    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 13:18:17.570580 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467532    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 13:18:17.570580 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467535    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 13:18:17.570580 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467537    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 13:18:17.570580 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467541    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 13:18:17.570580 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467545    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 13:18:17.570580 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467548    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 13:18:17.570580 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467551    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 13:18:17.570580 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467553    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 13:18:17.570580 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467556    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 13:18:17.570580 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467559    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 13:18:17.570580 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467562    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 13:18:17.570580 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467566    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 13:18:17.570580 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467569    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 13:18:17.570580 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467571    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 13:18:17.570580 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467574    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 13:18:17.570580 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467577    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 13:18:17.570580 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467580    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 13:18:17.571298 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467583    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 13:18:17.571298 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467585    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 13:18:17.571298 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467588    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 13:18:17.571298 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467592    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 13:18:17.571298 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467594    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 13:18:17.571298 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467597    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 13:18:17.571298 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467600    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 13:18:17.571298 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467603    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 13:18:17.571298 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467606    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 13:18:17.571298 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467609    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 13:18:17.571298 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467611    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 13:18:17.571298 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467615    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 13:18:17.571298 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.467618    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 13:18:17.571298 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468037    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 13:18:17.571298 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468044    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 13:18:17.571298 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468047    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 13:18:17.571298 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468054    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 13:18:17.571298 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468057    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 13:18:17.571298 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468060    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 13:18:17.571824 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468062    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 13:18:17.571824 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468065    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 13:18:17.571824 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468068    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 13:18:17.571824 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468071    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 13:18:17.571824 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468074    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 13:18:17.571824 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468076    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 13:18:17.571824 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468079    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 13:18:17.571824 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468082    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 13:18:17.571824 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468084    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 13:18:17.571824 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468087    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 13:18:17.571824 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468090    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 13:18:17.571824 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468092    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 13:18:17.571824 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468095    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 13:18:17.571824 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468097    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 13:18:17.571824 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468100    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 13:18:17.571824 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468103    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 13:18:17.571824 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468106    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 13:18:17.571824 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468108    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 13:18:17.571824 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468111    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 13:18:17.571824 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468113    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 13:18:17.572408 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468116    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 13:18:17.572408 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468118    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 13:18:17.572408 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468120    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 13:18:17.572408 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468123    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 13:18:17.572408 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468125    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 13:18:17.572408 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468128    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 13:18:17.572408 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468130    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 13:18:17.572408 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468133    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 13:18:17.572408 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468136    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 13:18:17.572408 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468141    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 13:18:17.572408 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468143    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 13:18:17.572408 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468146    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 13:18:17.572408 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468149    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 13:18:17.572408 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468152    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 13:18:17.572408 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468155    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 13:18:17.572408 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468158    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 13:18:17.572408 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468160    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 13:18:17.572408 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468163    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 13:18:17.572408 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468166    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 13:18:17.572408 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468168    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 13:18:17.573283 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468171    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 13:18:17.573283 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468174    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 13:18:17.573283 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468176    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 13:18:17.573283 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468178    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 13:18:17.573283 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468181    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 13:18:17.573283 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468186    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 13:18:17.573283 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468191    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 13:18:17.573283 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468194    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 13:18:17.573283 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468196    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 13:18:17.573283 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468200    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 13:18:17.573283 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468204    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 13:18:17.573283 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468206    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 13:18:17.573283 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468210    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 13:18:17.573283 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468212    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 13:18:17.573283 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468215    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 13:18:17.573283 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468217    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 13:18:17.573283 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468220    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 13:18:17.573283 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468222    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 13:18:17.573283 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468225    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 13:18:17.573283 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468227    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 13:18:17.574344 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468230    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 13:18:17.574344 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468237    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 13:18:17.574344 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468239    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 13:18:17.574344 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468242    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 13:18:17.574344 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468245    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 13:18:17.574344 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468251    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 13:18:17.574344 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468254    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 13:18:17.574344 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468257    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 13:18:17.574344 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468260    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 13:18:17.574344 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468262    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 13:18:17.574344 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468265    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 13:18:17.574344 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468267    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 13:18:17.574344 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468269    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 13:18:17.574344 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468272    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 13:18:17.574344 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468275    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 13:18:17.574344 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468277    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 13:18:17.574344 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468280    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 13:18:17.574344 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468283    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 13:18:17.574344 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468286    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 13:18:17.574962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468289    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 13:18:17.574962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468291    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 13:18:17.574962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468294    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 13:18:17.574962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468296    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 13:18:17.574962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468298    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 13:18:17.574962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468301    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 13:18:17.574962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468303    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 13:18:17.574962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468306    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 13:18:17.574962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468308    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 13:18:17.574962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468311    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 13:18:17.574962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468314    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 13:18:17.574962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468316    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 13:18:17.574962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468319    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 13:18:17.574962 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.468321    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 13:18:17.574962 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468401    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 05 13:18:17.574962 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468409    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 05 13:18:17.574962 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468415    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 05 13:18:17.574962 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468420    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 05 13:18:17.574962 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468425    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 05 13:18:17.574962 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468429    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 05 13:18:17.574962 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468433    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468437    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468441    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468444    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468448    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468452    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468455    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468458    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468461    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468464    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468469    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468472    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468476    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468479    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468482    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468485    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468489    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468492    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468495    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468498    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468502    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468505    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468508    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468511    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 05 13:18:17.575568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468514    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468517    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468533    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468538    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468542    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468545    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468548    2565 flags.go:64] FLAG: --enable-server="true"
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468551    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468556    2565 flags.go:64] FLAG: --event-burst="100"
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468559    2565 flags.go:64] FLAG: --event-qps="50"
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468562    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468565    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468568    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468573    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468576    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468579    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468582    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468585    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468589    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468592    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468595    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468598    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468601    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468604    2565 flags.go:64] FLAG: --feature-gates=""
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468608    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 05 13:18:17.576401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468611    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468614    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468617    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468620    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468623    2565 flags.go:64] FLAG: --help="false"
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468626    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-129-22.ec2.internal"
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468642    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468646    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468649    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468654    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468657    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468660    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468663    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468667    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468670    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468673    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468676    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468679    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468682    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468685    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468688    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468690    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468694    2565 flags.go:64] FLAG: --lock-file=""
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468696    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 05 13:18:17.577248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468700    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468704    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468710    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468713    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468716    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468718    2565 flags.go:64] FLAG: --logging-format="text"
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468721    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468725    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468728    2565 flags.go:64] FLAG: --manifest-url=""
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468731    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468735    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468739    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468743    2565 flags.go:64] FLAG: --max-pods="110"
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468746    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468749    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468752    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468756    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468760    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468763    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468766    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468774    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468777    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468781    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 05 13:18:17.580855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468784    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468786    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468793    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468796    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468799    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468802    2565 flags.go:64] FLAG: --port="10250"
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468805    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468808    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ad16a11adacd8848"
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468811    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468814    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468817    2565 flags.go:64] FLAG: --register-node="true"
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468822    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468825    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468828    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468832    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468834    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468838    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468841    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468844    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468848    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468850    2565 flags.go:64] FLAG: --runonce="false"
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468853    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468856    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468859    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468863    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 05 13:18:17.581750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468866    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468870    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468873    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468876    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468879    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468882    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468885    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468888    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468891    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468894    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468897    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468902    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468905    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468908    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468911    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468914    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468917    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468920    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468925    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468928    2565 flags.go:64] FLAG: --v="2"
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468932    2565 flags.go:64] FLAG: --version="false"
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468936    2565 flags.go:64] FLAG: --vmodule=""
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468939    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.468943    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 05 13:18:17.677105 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469060    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 13:18:17.695422 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469064    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 13:18:17.695422 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469067    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 13:18:17.695422 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469070    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 13:18:17.695422 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469073    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 13:18:17.695422 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469076    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 13:18:17.695422 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469079    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 13:18:17.695422 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469081    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 13:18:17.695422 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469084    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 13:18:17.695422 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469088    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 13:18:17.695422 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469090    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 13:18:17.695422 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469093    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 13:18:17.695422 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469095    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 13:18:17.695422 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469099    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 13:18:17.695422 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469101    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 13:18:17.695422 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469104    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 13:18:17.695422 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469107    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 13:18:17.695422 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469109    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 13:18:17.695422 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469112    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 13:18:17.695422 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469115    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 13:18:17.695422 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469118    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 13:18:17.696579 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469120    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 13:18:17.696579 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469123    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 13:18:17.696579 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469125    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 13:18:17.696579 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469128    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 13:18:17.696579 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469130    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 13:18:17.696579 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469134    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 13:18:17.696579 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469137    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 13:18:17.696579 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469139    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 13:18:17.696579 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469142    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 13:18:17.696579 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469145    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 13:18:17.696579 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469147    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 13:18:17.696579 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469150    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 13:18:17.696579 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469152    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 13:18:17.696579 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469155    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 13:18:17.696579 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469157    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 13:18:17.696579 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469160    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 13:18:17.696579 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469162    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 13:18:17.696579 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469165    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 13:18:17.696579 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469167    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 13:18:17.696579 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469170    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 13:18:17.698224 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469174    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 13:18:17.698224 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469177    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 13:18:17.698224 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469179    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 13:18:17.698224 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469182    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 13:18:17.698224 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469185    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 13:18:17.698224 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469189    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 13:18:17.698224 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469192    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 13:18:17.698224 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469196    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 13:18:17.698224 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469198    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 13:18:17.698224 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469201    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 13:18:17.698224 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469203    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 13:18:17.698224 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469206    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 13:18:17.698224 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469208    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 13:18:17.698224 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469211    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 13:18:17.698224 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469213    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 13:18:17.698224 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469216    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 13:18:17.698224 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469218    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 13:18:17.698224 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469223    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 13:18:17.698224 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469226    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 13:18:17.699331 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469228    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 13:18:17.699331 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469231    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 13:18:17.699331 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469233    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 13:18:17.699331 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469236    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 13:18:17.699331 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469238    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 13:18:17.699331 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469240    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 13:18:17.699331 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469243    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 13:18:17.699331 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469246    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 13:18:17.699331 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469248    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 13:18:17.699331 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469251    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 13:18:17.699331 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469254    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 13:18:17.699331 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469256    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 13:18:17.699331 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469259    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 13:18:17.699331 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469262    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 13:18:17.699331 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469265    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 13:18:17.699331 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469267    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 13:18:17.699331 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469270    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 13:18:17.699331 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469273    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 13:18:17.699331 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469275    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 13:18:17.699331 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469278    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 13:18:17.700522 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469280    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 13:18:17.700522 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469283    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 13:18:17.700522 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469286    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 13:18:17.700522 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469288    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 13:18:17.700522 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469291    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 13:18:17.700522 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469294    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 13:18:17.700522 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469298    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 13:18:17.700522 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469301    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 13:18:17.700522 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469303    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 13:18:17.700522 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469306    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 13:18:17.700522 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469310    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 13:18:17.700522 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469312    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 13:18:17.700522 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469315    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 13:18:17.700522 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469318    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 13:18:17.700522 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469320    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 13:18:17.700522 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469324    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 13:18:17.700522 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469328    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 13:18:17.700522 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469331    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 13:18:17.700522 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.469333    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 13:18:17.701523 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.469909    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 05 13:18:17.701523 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.478163    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 05 13:18:17.701523 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.478184    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 05 13:18:17.701523 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.478976    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 05 13:18:17.701523 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.478985    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 05 13:18:17.701523 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479048    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 13:18:17.701523 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479054    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 13:18:17.701523 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479057    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 13:18:17.701523 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479061    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 13:18:17.701523 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479064    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 13:18:17.701523 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479068    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 13:18:17.701523 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479070    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 13:18:17.701523 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479073    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 13:18:17.701523 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479077    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 13:18:17.701523 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479080    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 13:18:17.702492 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479083    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 13:18:17.702492 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479085    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 13:18:17.702492 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479089    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 13:18:17.702492 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479092    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 13:18:17.702492 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479095    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 13:18:17.702492 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479098    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 13:18:17.702492 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479101    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 13:18:17.702492 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479104    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 13:18:17.702492 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479107    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 13:18:17.702492 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479110    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 13:18:17.702492 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479113    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 13:18:17.702492 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479116    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 13:18:17.702492 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479119    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 13:18:17.702492 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479122    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 13:18:17.702492 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479125    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 13:18:17.702492 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479128    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 13:18:17.702492 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479131    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 13:18:17.702492 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479134    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 13:18:17.702492 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479137    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 13:18:17.702492 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479140    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 13:18:17.703466 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479142    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 13:18:17.703466 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479145    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 13:18:17.703466 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479147    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 13:18:17.703466 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479150    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 13:18:17.703466 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479152    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 13:18:17.703466 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479155    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 13:18:17.703466 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479158    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 13:18:17.703466 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479160    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 13:18:17.703466 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479163    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 13:18:17.703466 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479165    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 13:18:17.703466 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479168    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 13:18:17.703466 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479171    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 13:18:17.703466 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479173    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 13:18:17.703466 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479176    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 13:18:17.703466 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479179    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 13:18:17.703466 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479182    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 13:18:17.703466 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479184    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 13:18:17.703466 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479187    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 13:18:17.703466 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479190    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 13:18:17.703466 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479192    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 13:18:17.704438 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479195    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 13:18:17.704438 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479198    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 13:18:17.704438 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479201    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 13:18:17.704438 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479203    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 13:18:17.704438 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479206    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 13:18:17.704438 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479209    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 13:18:17.704438 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479211    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 13:18:17.704438 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479214    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 13:18:17.704438 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479217    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 13:18:17.704438 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479219    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 13:18:17.704438 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479222    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 13:18:17.704438 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479224    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 13:18:17.704438 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479228    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 13:18:17.704438 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479233    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 13:18:17.704438 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479236    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 13:18:17.704438 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479239    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 13:18:17.704438 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479243    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 13:18:17.704438 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479246    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 13:18:17.704438 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479249    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 13:18:17.705434 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479252    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 13:18:17.705434 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479254    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 13:18:17.705434 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479257    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 13:18:17.705434 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479263    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 13:18:17.705434 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479266    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 13:18:17.705434 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479269    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 13:18:17.705434 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479271    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 13:18:17.705434 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479274    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 13:18:17.705434 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479276    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 13:18:17.705434 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479279    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 13:18:17.705434 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479283    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 13:18:17.705434 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479286    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 13:18:17.705434 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479288    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 13:18:17.705434 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479293    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 13:18:17.705434 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479297    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 13:18:17.705434 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479301    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 13:18:17.705434 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479303    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 13:18:17.705434 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479306    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 13:18:17.705434 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479309    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 13:18:17.706416 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479312    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 13:18:17.706416 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479315    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 13:18:17.706416 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479317    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 13:18:17.706416 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479320    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 13:18:17.706416 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479322    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 13:18:17.706416 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479324    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 13:18:17.706416 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479327    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 13:18:17.706416 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479330    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 13:18:17.706416 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479333    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 13:18:17.706416 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479335    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 13:18:17.706416 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479338    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 13:18:17.706416 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.479344    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 05 13:18:17.706416 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479485    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 05 13:18:17.706416 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479491    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 05 13:18:17.706416 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479494    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 05 13:18:17.707169 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479497    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 05 13:18:17.707169 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479502    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 05 13:18:17.707169 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479504    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 05 13:18:17.707169 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479507    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 05 13:18:17.707169 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479509    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 05 13:18:17.707169 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479513    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 05 13:18:17.707169 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479518    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 05 13:18:17.707169 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479521    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 05 13:18:17.707169 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479524    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 05 13:18:17.707169 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479527    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 05 13:18:17.707169 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479530    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 05 13:18:17.707169 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479533    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 05 13:18:17.707169 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479537    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 05 13:18:17.707169 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479540    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 05 13:18:17.707169 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479543    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 05 13:18:17.707169 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479546    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 05 13:18:17.707169 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479548    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 05 13:18:17.707169 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479551    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 05 13:18:17.707169 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479553    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 05 13:18:17.708138 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479556    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 05 13:18:17.708138 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479559    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 05 13:18:17.708138 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479561    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 05 13:18:17.708138 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479564    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 05 13:18:17.708138 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479567    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 05 13:18:17.708138 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479569    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 05 13:18:17.708138 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479572    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 05 13:18:17.708138 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479574    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 05 13:18:17.708138 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479577    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 05 13:18:17.708138 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479579    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 05 13:18:17.708138 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479582    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 05 13:18:17.708138 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479585    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 05 13:18:17.708138 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479587    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 05 13:18:17.708138 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479590    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 05 13:18:17.708138 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479593    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 05 13:18:17.708138 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479597    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 05 13:18:17.708138 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479601    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 05 13:18:17.708138 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479603    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 05 13:18:17.708138 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479606    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 05 13:18:17.709095 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479609    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 05 13:18:17.709095 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479612    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 05 13:18:17.709095 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479615    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 05 13:18:17.709095 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479617    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 05 13:18:17.709095 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479621    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 05 13:18:17.709095 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479624    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 05 13:18:17.709095 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479645    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 05 13:18:17.709095 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479648    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 05 13:18:17.709095 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479650    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 05 13:18:17.709095 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479653    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 05 13:18:17.709095 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479656    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 05 13:18:17.709095 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479658    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 05 13:18:17.709095 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479661    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 05 13:18:17.709095 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479664    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 05 13:18:17.709095 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479666    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 05 13:18:17.709095 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479669    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 05 13:18:17.709095 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479671    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 05 13:18:17.709095 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479674    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 05 13:18:17.709095 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479676    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 05 13:18:17.709095 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479679    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 05 13:18:17.710067 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479682    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 05 13:18:17.710067 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479684    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 05 13:18:17.710067 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479687    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 05 13:18:17.710067 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479689    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 05 13:18:17.710067 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479692    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 05 13:18:17.710067 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479695    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 05 13:18:17.710067 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479697    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 05 13:18:17.710067 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479703    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 05 13:18:17.710067 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479705    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 05 13:18:17.710067 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479708    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 05 13:18:17.710067 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479710    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 05 13:18:17.710067 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479713    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 05 13:18:17.710067 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479716    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 05 13:18:17.710067 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479718    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 05 13:18:17.710067 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479721    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 05 13:18:17.710067 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479723    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 05 13:18:17.710067 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479725    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 05 13:18:17.710067 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479728    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 05 13:18:17.710067 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479732    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 05 13:18:17.711031 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479736    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 05 13:18:17.711031 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479740    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 05 13:18:17.711031 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479743    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 05 13:18:17.711031 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479745    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 05 13:18:17.711031 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479748    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 05 13:18:17.711031 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479751    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 05 13:18:17.711031 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479753    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 05 13:18:17.711031 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479756    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 05 13:18:17.711031 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479759    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 05 13:18:17.711031 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479761    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 05 13:18:17.711031 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479764    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 05 13:18:17.711031 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479766    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 05 13:18:17.711031 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479769    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 05 13:18:17.711031 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479771    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 05 13:18:17.711031 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479774    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 05 13:18:17.711031 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479776    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 05 13:18:17.711031 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479779    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 05 13:18:17.711031 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479781    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 05 13:18:17.711031 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:17.479784    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 05 13:18:17.712007 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.479789    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 05 13:18:17.712007 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.479924    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 05 13:18:17.712007 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.482023    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 05 13:18:17.712007 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.483448    2565 server.go:1019] "Starting client certificate rotation"
Jul 05 13:18:17.712007 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.483554    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 05 13:18:17.712007 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.483594    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 05 13:18:17.712007 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.485932    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 05 13:18:17.712007 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.487223    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 05 13:18:17.712007 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.499600    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 05 13:18:17.712007 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.501809    2565 log.go:25] "Validated CRI v1 image API"
Jul 05 13:18:17.712007 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.502709    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 05 13:18:17.712007 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.505205    2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7f2b9755-6f51-4aa1-a9b5-b809839c4780:/dev/nvme0n1p3 f84ea168-b0ed-4fd4-b3bb-51f03cf66522:/dev/nvme0n1p4]
Jul 05 13:18:17.712752 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.505228    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 05 13:18:17.712977 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.510233    2565 manager.go:216] Machine: {Timestamp:2026-07-05 13:18:17.508978535 +0000 UTC m=+0.326946502 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103669 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fc7ed37200803e4da3bd5965a04af SystemUUID:ec2fc7ed-3720-0803-e4da-3bd5965a04af BootID:793f4e9b-29f9-4ca5-ae53-b007d60fbdac Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:38:88:e3:df:01 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:38:88:e3:df:01 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:17:79:8c:0b:51 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 05 13:18:17.712977 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.510347    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 05 13:18:17.712977 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.510446    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 05 13:18:17.712977 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.514420    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 05 13:18:17.712977 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.514460    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-22.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 05 13:18:17.712977 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.514989    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 05 13:18:17.712977 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.515327    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.515346    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.515355    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.516004    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.517233    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.520318    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.520454    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.520486    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.520497    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.520511    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.520522    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.520539    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.521010    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.521027    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.523099    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.524885    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.524915    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.525966    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.525981    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.525987    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.525992    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.526004    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.526011    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.526022    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.526029    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.526036    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.526041    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.526051    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.526056    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.526751    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.526760    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.530175    2565 server.go:1268] "Started kubelet"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.530266    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.530267    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.530504    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.532153    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.532546    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.537976    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.538009    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:17.538112    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-22.ec2.internal\" not found"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.538546    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.538573    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.538584    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.539462    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.539473    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.543938    2565 factory.go:55] Registering systemd factory
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.543973    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 05 13:18:17.715960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.544312    2565 factory.go:153] Registering CRI-O factory
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.544330    2565 factory.go:223] Registration of the crio container factory successfully
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.544428    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.544481    2565 factory.go:103] Registering Raw factory
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:17.544499    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.544523    2565 manager.go:1196] Started watching for new ooms in manager
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.545202    2565 manager.go:349] Starting recovery of all containers
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.547565    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p6dd8"
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.548227    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-22.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:17.548755    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-22.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:17.548861    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-22.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:17.548867    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:17.548941    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:17.549023    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-22.ec2.internal.18bf673ef35604f5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-22.ec2.internal,UID:ip-10-0-129-22.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-22.ec2.internal,},FirstTimestamp:2026-07-05 13:18:17.530139893 +0000 UTC m=+0.348107841,LastTimestamp:2026-07-05 13:18:17.530139893 +0000 UTC m=+0.348107841,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-22.ec2.internal,}"
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.556695    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p6dd8"
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.570000    2565 manager.go:354] Recovery completed
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.576480    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.578582    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-22.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.578610    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-22.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.578621    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-22.ec2.internal" event="NodeHasSufficientPID"
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.579152    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.579167    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.579184    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.579537    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.580320    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-22.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.580344    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-22.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 13:18:17.718102 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.580348    2565 policy_none.go:49] "None policy: Start"
Jul 05 13:18:17.720206 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.580356    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-22.ec2.internal" event="NodeHasSufficientPID"
Jul 05 13:18:17.720206 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.580364    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 05 13:18:17.720206 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.580377    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 05 13:18:17.720206 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:17.580938    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-22.ec2.internal.18bf673ef6397687  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-22.ec2.internal,UID:ip-10-0-129-22.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-22.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-22.ec2.internal,},FirstTimestamp:2026-07-05 13:18:17.578600071 +0000 UTC m=+0.396568019,LastTimestamp:2026-07-05 13:18:17.578600071 +0000 UTC m=+0.396568019,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-22.ec2.internal,}"
Jul 05 13:18:17.720206 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.581550    2565 policy_none.go:47] "Start"
Jul 05 13:18:17.720206 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:17.638505    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-22.ec2.internal\" not found"
Jul 05 13:18:17.720206 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.650526    2565 manager.go:337] "Starting Device Plugin manager"
Jul 05 13:18:17.720206 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:17.650571    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 05 13:18:17.720206 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.650586    2565 server.go:87] "Starting device plugin registration server"
Jul 05 13:18:17.720206 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.650941    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 05 13:18:17.720206 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.650956    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 05 13:18:17.720206 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.651050    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 05 13:18:17.720206 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.651148    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 05 13:18:17.720206 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.651158    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 05 13:18:17.720206 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:17.651715    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 05 13:18:17.720206 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:17.651764    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-22.ec2.internal\" not found"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.733048    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.734390    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.734441    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.734478    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:17.734521    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.737901    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.751929    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.753569    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-22.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.753605    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-22.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.753676    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-22.ec2.internal" event="NodeHasSufficientPID"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.753709    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-22.ec2.internal"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:17.757644    2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-22.ec2.internal\" not found" node="ip-10-0-129-22.ec2.internal"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.760509    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-22.ec2.internal"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:17.760532    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-22.ec2.internal\": node \"ip-10-0-129-22.ec2.internal\" not found"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:17.783582    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-22.ec2.internal\" not found"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.835997    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-22.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-22.ec2.internal"]
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.836115    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.837870    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-22.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.837898    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-22.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.837909    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-22.ec2.internal" event="NodeHasSufficientPID"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.839307    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.839419    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-22.ec2.internal"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.839451    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.840141    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-22.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.840167    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-22.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.840178    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-22.ec2.internal" event="NodeHasSufficientPID"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.840148    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-22.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.840237    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-22.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.840250    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-22.ec2.internal" event="NodeHasSufficientPID"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.841077    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d60fe1be8856ccb927069ef5697d039f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-22.ec2.internal\" (UID: \"d60fe1be8856ccb927069ef5697d039f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-22.ec2.internal"
Jul 05 13:18:17.870349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.841102    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d60fe1be8856ccb927069ef5697d039f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-22.ec2.internal\" (UID: \"d60fe1be8856ccb927069ef5697d039f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-22.ec2.internal"
Jul 05 13:18:17.872337 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.841459    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-22.ec2.internal"
Jul 05 13:18:17.872337 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.841482    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 05 13:18:17.872337 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.842199    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-22.ec2.internal" event="NodeHasSufficientMemory"
Jul 05 13:18:17.872337 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.842225    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-22.ec2.internal" event="NodeHasNoDiskPressure"
Jul 05 13:18:17.872337 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.842236    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-22.ec2.internal" event="NodeHasSufficientPID"
Jul 05 13:18:17.885091 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:17.884374    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-22.ec2.internal\" not found"
Jul 05 13:18:18.027292 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:17.895839    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-22.ec2.internal\" not found" node="ip-10-0-129-22.ec2.internal"
Jul 05 13:18:18.027292 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:17.900808    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-22.ec2.internal\" not found" node="ip-10-0-129-22.ec2.internal"
Jul 05 13:18:18.027292 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.941370    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d60fe1be8856ccb927069ef5697d039f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-22.ec2.internal\" (UID: \"d60fe1be8856ccb927069ef5697d039f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-22.ec2.internal"
Jul 05 13:18:18.027292 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.941405    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d60fe1be8856ccb927069ef5697d039f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-22.ec2.internal\" (UID: \"d60fe1be8856ccb927069ef5697d039f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-22.ec2.internal"
Jul 05 13:18:18.027292 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.941438    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/700cc51e5868b85faed88c518f5936e2-config\") pod \"kube-apiserver-proxy-ip-10-0-129-22.ec2.internal\" (UID: \"700cc51e5868b85faed88c518f5936e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-22.ec2.internal"
Jul 05 13:18:18.027292 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.941497    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d60fe1be8856ccb927069ef5697d039f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-22.ec2.internal\" (UID: \"d60fe1be8856ccb927069ef5697d039f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-22.ec2.internal"
Jul 05 13:18:18.027292 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:17.941497    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d60fe1be8856ccb927069ef5697d039f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-22.ec2.internal\" (UID: \"d60fe1be8856ccb927069ef5697d039f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-22.ec2.internal"
Jul 05 13:18:18.027292 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:17.984610    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-22.ec2.internal\" not found"
Jul 05 13:18:18.170168 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.042129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/700cc51e5868b85faed88c518f5936e2-config\") pod \"kube-apiserver-proxy-ip-10-0-129-22.ec2.internal\" (UID: \"700cc51e5868b85faed88c518f5936e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-22.ec2.internal"
Jul 05 13:18:18.170168 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.042217    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/700cc51e5868b85faed88c518f5936e2-config\") pod \"kube-apiserver-proxy-ip-10-0-129-22.ec2.internal\" (UID: \"700cc51e5868b85faed88c518f5936e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-22.ec2.internal"
Jul 05 13:18:18.170168 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:18.087225    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-22.ec2.internal\" not found"
Jul 05 13:18:18.247105 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:18.190479    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-22.ec2.internal\" not found"
Jul 05 13:18:18.247105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.199263    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-22.ec2.internal"
Jul 05 13:18:18.247105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.203704    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-22.ec2.internal"
Jul 05 13:18:18.362426 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:18.291033    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-22.ec2.internal\" not found"
Jul 05 13:18:18.485330 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:18.394296    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-22.ec2.internal\" not found"
Jul 05 13:18:18.485330 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.441504    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 13:18:18.485330 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.484669    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 05 13:18:18.485330 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.484839    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 05 13:18:18.485330 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.484893    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.521463    2565 apiserver.go:52] "Watching apiserver"
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.538130    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.538599    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-22.ec2.internal"
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.539711    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.540057    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-t4s6n","kube-system/konnectivity-agent-zgshx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff","openshift-cluster-node-tuning-operator/tuned-k2hfx","openshift-multus/multus-additional-cni-plugins-b2lbp","openshift-multus/multus-kzhs6","openshift-multus/network-metrics-daemon-rlllr","openshift-network-operator/iptables-alerter-pd57v","openshift-dns/node-resolver-nltvs","openshift-image-registry/node-ca-rgn5q","openshift-network-diagnostics/network-check-target-nnb8k","openshift-ovn-kubernetes/ovnkube-node-xj7gc"]
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.541608    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zgshx"
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.542960    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.544018    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-d6dmn\""
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.544148    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.544190    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.544291    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.545290    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.545622    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.545797    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v9wqg\""
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.545803    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.551350    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.552234    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.552240    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.552260    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-22.ec2.internal"
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.552294    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2g7q2\""
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.552294    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.552367    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.552421    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r77d2\""
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.553452    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.553550    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.553620    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:18.553715    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlllr" podUID="65ca969d-9b3d-4379-a220-fff11397bef6"
Jul 05 13:18:18.620538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.555790    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pd57v"
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.557496    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nltvs"
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.558699    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rgn5q"
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.560550    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:18.560611    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnb8k" podUID="17185f72-eafe-4930-8fcb-1d10baa8f07e"
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.562780    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.564081    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.564122    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.564222    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.564408    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.564425    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.564443    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sw6cd\""
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.564508    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.564768    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d5828\""
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.564802    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.564899    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gv9ch\""
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.564917    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.565297    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:18.565377    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4s6n" podUID="dd27dfce-3c13-4d05-a19b-dcb32e9af21c"
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.566678    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-22.ec2.internal"]
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.566794    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.568754    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.568824    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hhpx6\""
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.568833    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.568833    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.569214    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.569239    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.569292    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-22.ec2.internal"]
Jul 05 13:18:18.623012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.569976    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 05 13:18:18.626282 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.570057    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 05 13:18:18.626282 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.570102    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-04 13:13:17 +0000 UTC" deadline="2028-04-06 20:22:00.444497196 +0000 UTC"
Jul 05 13:18:18.626282 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.570133    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15391h3m41.874366014s"
Jul 05 13:18:18.626282 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.570154    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 05 13:18:18.626282 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.570294    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 05 13:18:18.626282 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.570321    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 05 13:18:18.626282 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.570551    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 05 13:18:18.626282 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.570556    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nt6j6\""
Jul 05 13:18:18.641389 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.639674    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 05 13:18:18.730193 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644092    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-etc-kubernetes\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.730193 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644123    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-host-run-k8s-cni-cncf-io\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.730193 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-host-var-lib-cni-multus\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.730193 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644164    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-multus-conf-dir\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.730193 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644189    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-etc-kubernetes\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.730193 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644221    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-etc-systemd\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.730193 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644252    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c02645e-d3d4-4f5e-824f-c629da35133b-tmp-dir\") pod \"node-resolver-nltvs\" (UID: \"2c02645e-d3d4-4f5e-824f-c629da35133b\") " pod="openshift-dns/node-resolver-nltvs"
Jul 05 13:18:18.730193 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644279    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv5j2\" (UniqueName: \"kubernetes.io/projected/6c7ce124-8975-400e-9f0b-2527ee19af46-kube-api-access-nv5j2\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.730193 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644313    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/416aff4f-940f-44b6-8cf2-8d6e1a030c14-device-dir\") pod \"aws-ebs-csi-driver-node-vpsff\" (UID: \"416aff4f-940f-44b6-8cf2-8d6e1a030c14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.730193 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644342    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6cvt\" (UniqueName: \"kubernetes.io/projected/ed53678c-46fe-4967-b74f-c12eb3b0e626-kube-api-access-w6cvt\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.730193 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644365    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ffb49d9-ee88-454b-8b27-05a4274ef55f-konnectivity-ca\") pod \"konnectivity-agent-zgshx\" (UID: \"2ffb49d9-ee88-454b-8b27-05a4274ef55f\") " pod="kube-system/konnectivity-agent-zgshx"
Jul 05 13:18:18.730193 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644382    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aaf57f1c-cee2-4539-88fc-d004dbfb7366-iptables-alerter-script\") pod \"iptables-alerter-pd57v\" (UID: \"aaf57f1c-cee2-4539-88fc-d004dbfb7366\") " pod="openshift-network-operator/iptables-alerter-pd57v"
Jul 05 13:18:18.730193 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644397    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-host-slash\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.730193 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644413    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-var-lib-openvswitch\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.732502 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644438    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/416aff4f-940f-44b6-8cf2-8d6e1a030c14-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vpsff\" (UID: \"416aff4f-940f-44b6-8cf2-8d6e1a030c14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.732502 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret\") pod \"global-pull-secret-syncer-t4s6n\" (UID: \"dd27dfce-3c13-4d05-a19b-dcb32e9af21c\") " pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:18.732502 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644501    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-host-run-multus-certs\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.732502 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88g76\" (UniqueName: \"kubernetes.io/projected/a588119d-ae18-4e26-b843-fb4c25485fa2-kube-api-access-88g76\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.732502 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644559    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-multus-cni-dir\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.732502 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644585    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-host-cni-netd\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.732502 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644603    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-lib-modules\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.732502 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644618    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5ef484b2-c6d9-4acf-be33-df3384cff76d-etc-tuned\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.732502 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.644633    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ed53678c-46fe-4967-b74f-c12eb3b0e626-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.732502 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645098    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-cnibin\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.732502 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645114    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-dbus\") pod \"global-pull-secret-syncer-t4s6n\" (UID: \"dd27dfce-3c13-4d05-a19b-dcb32e9af21c\") " pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:18.732502 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645129    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed53678c-46fe-4967-b74f-c12eb3b0e626-system-cni-dir\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.732502 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645146    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs\") pod \"network-metrics-daemon-rlllr\" (UID: \"65ca969d-9b3d-4379-a220-fff11397bef6\") " pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:18.732502 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645163    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvdbw\" (UniqueName: \"kubernetes.io/projected/65ca969d-9b3d-4379-a220-fff11397bef6-kube-api-access-wvdbw\") pod \"network-metrics-daemon-rlllr\" (UID: \"65ca969d-9b3d-4379-a220-fff11397bef6\") " pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:18.733358 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645180    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkwjk\" (UniqueName: \"kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk\") pod \"network-check-target-nnb8k\" (UID: \"17185f72-eafe-4930-8fcb-1d10baa8f07e\") " pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:18.733358 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645216    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aaf57f1c-cee2-4539-88fc-d004dbfb7366-host-slash\") pod \"iptables-alerter-pd57v\" (UID: \"aaf57f1c-cee2-4539-88fc-d004dbfb7366\") " pod="openshift-network-operator/iptables-alerter-pd57v"
Jul 05 13:18:18.733358 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645234    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-host-run-netns\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.733358 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645251    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-run-ovn\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.733358 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645273    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6c7ce124-8975-400e-9f0b-2527ee19af46-env-overrides\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.733358 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645292    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/416aff4f-940f-44b6-8cf2-8d6e1a030c14-etc-selinux\") pod \"aws-ebs-csi-driver-node-vpsff\" (UID: \"416aff4f-940f-44b6-8cf2-8d6e1a030c14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.733358 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645307    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-etc-sysconfig\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.733358 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645356    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-etc-sysctl-d\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.733358 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645372    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-run\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.733358 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-host-var-lib-cni-bin\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.733358 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645418    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-hostroot\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.733358 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645449    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ef484b2-c6d9-4acf-be33-df3384cff76d-tmp\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.733358 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645465    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed53678c-46fe-4967-b74f-c12eb3b0e626-os-release\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.733358 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645487    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b968b72-7bc0-4186-aa14-7405cf541b16-host\") pod \"node-ca-rgn5q\" (UID: \"8b968b72-7bc0-4186-aa14-7405cf541b16\") " pod="openshift-image-registry/node-ca-rgn5q"
Jul 05 13:18:18.814682 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645518    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c7ce124-8975-400e-9f0b-2527ee19af46-ovn-node-metrics-cert\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.814682 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/416aff4f-940f-44b6-8cf2-8d6e1a030c14-registration-dir\") pod \"aws-ebs-csi-driver-node-vpsff\" (UID: \"416aff4f-940f-44b6-8cf2-8d6e1a030c14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.814682 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645557    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-host-run-netns\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.814682 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645593    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-host-var-lib-kubelet\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.814682 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645618    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-host-kubelet\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.814682 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645651    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-host-run-ovn-kubernetes\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.814682 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645676    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-etc-modprobe-d\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.814682 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645691    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-sys\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.814682 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645711    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-multus-socket-dir-parent\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.814682 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645749    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbpms\" (UniqueName: \"kubernetes.io/projected/2c02645e-d3d4-4f5e-824f-c629da35133b-kube-api-access-gbpms\") pod \"node-resolver-nltvs\" (UID: \"2c02645e-d3d4-4f5e-824f-c629da35133b\") " pod="openshift-dns/node-resolver-nltvs"
Jul 05 13:18:18.814682 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-systemd-units\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.814682 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645788    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6c7ce124-8975-400e-9f0b-2527ee19af46-ovnkube-config\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.814682 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645806    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-kubelet-config\") pod \"global-pull-secret-syncer-t4s6n\" (UID: \"dd27dfce-3c13-4d05-a19b-dcb32e9af21c\") " pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:18.814682 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645829    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktfzg\" (UniqueName: \"kubernetes.io/projected/416aff4f-940f-44b6-8cf2-8d6e1a030c14-kube-api-access-ktfzg\") pod \"aws-ebs-csi-driver-node-vpsff\" (UID: \"416aff4f-940f-44b6-8cf2-8d6e1a030c14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.816276 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645845    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8b968b72-7bc0-4186-aa14-7405cf541b16-serviceca\") pod \"node-ca-rgn5q\" (UID: \"8b968b72-7bc0-4186-aa14-7405cf541b16\") " pod="openshift-image-registry/node-ca-rgn5q"
Jul 05 13:18:18.816276 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645871    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ffb49d9-ee88-454b-8b27-05a4274ef55f-agent-certs\") pod \"konnectivity-agent-zgshx\" (UID: \"2ffb49d9-ee88-454b-8b27-05a4274ef55f\") " pod="kube-system/konnectivity-agent-zgshx"
Jul 05 13:18:18.816276 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645892    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-system-cni-dir\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.816276 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645907    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-run-systemd\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.816276 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/416aff4f-940f-44b6-8cf2-8d6e1a030c14-socket-dir\") pod \"aws-ebs-csi-driver-node-vpsff\" (UID: \"416aff4f-940f-44b6-8cf2-8d6e1a030c14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.816276 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/416aff4f-940f-44b6-8cf2-8d6e1a030c14-sys-fs\") pod \"aws-ebs-csi-driver-node-vpsff\" (UID: \"416aff4f-940f-44b6-8cf2-8d6e1a030c14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.816276 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645960    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a588119d-ae18-4e26-b843-fb4c25485fa2-cni-binary-copy\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.816276 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.645985    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4knlm\" (UniqueName: \"kubernetes.io/projected/aaf57f1c-cee2-4539-88fc-d004dbfb7366-kube-api-access-4knlm\") pod \"iptables-alerter-pd57v\" (UID: \"aaf57f1c-cee2-4539-88fc-d004dbfb7366\") " pod="openshift-network-operator/iptables-alerter-pd57v"
Jul 05 13:18:18.816276 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.646000    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-run-openvswitch\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.816276 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.646029    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-var-lib-kubelet\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.816276 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.646056    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8wxh\" (UniqueName: \"kubernetes.io/projected/5ef484b2-c6d9-4acf-be33-df3384cff76d-kube-api-access-z8wxh\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.816276 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.646098    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed53678c-46fe-4967-b74f-c12eb3b0e626-cnibin\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.816276 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.646133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ed53678c-46fe-4967-b74f-c12eb3b0e626-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.816276 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.646157    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a588119d-ae18-4e26-b843-fb4c25485fa2-multus-daemon-config\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.817310 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.646173    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c02645e-d3d4-4f5e-824f-c629da35133b-hosts-file\") pod \"node-resolver-nltvs\" (UID: \"2c02645e-d3d4-4f5e-824f-c629da35133b\") " pod="openshift-dns/node-resolver-nltvs"
Jul 05 13:18:18.817310 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.646195    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-etc-openvswitch\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.817310 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.646220    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed53678c-46fe-4967-b74f-c12eb3b0e626-cni-binary-copy\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.817310 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.646240    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfspb\" (UniqueName: \"kubernetes.io/projected/8b968b72-7bc0-4186-aa14-7405cf541b16-kube-api-access-dfspb\") pod \"node-ca-rgn5q\" (UID: \"8b968b72-7bc0-4186-aa14-7405cf541b16\") " pod="openshift-image-registry/node-ca-rgn5q"
Jul 05 13:18:18.817310 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.646263    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-os-release\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.817310 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.646278    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-log-socket\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.817310 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.646295    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6c7ce124-8975-400e-9f0b-2527ee19af46-ovnkube-script-lib\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.817310 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.646312    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed53678c-46fe-4967-b74f-c12eb3b0e626-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.817310 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.646338    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-node-log\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.817310 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.646360    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-etc-sysctl-conf\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.817310 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.646381    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-host\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.817310 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.646408    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-host-cni-bin\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.817310 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.646427    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.817310 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.681369    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2znm5"
Jul 05 13:18:18.817310 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.690531    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2znm5"
Jul 05 13:18:18.818722 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.746723    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-cnibin\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.818722 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.746753    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-dbus\") pod \"global-pull-secret-syncer-t4s6n\" (UID: \"dd27dfce-3c13-4d05-a19b-dcb32e9af21c\") " pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:18.818722 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.746781    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed53678c-46fe-4967-b74f-c12eb3b0e626-system-cni-dir\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.818722 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.746869    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-cnibin\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.818722 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.746901    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs\") pod \"network-metrics-daemon-rlllr\" (UID: \"65ca969d-9b3d-4379-a220-fff11397bef6\") " pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:18.818722 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.746939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvdbw\" (UniqueName: \"kubernetes.io/projected/65ca969d-9b3d-4379-a220-fff11397bef6-kube-api-access-wvdbw\") pod \"network-metrics-daemon-rlllr\" (UID: \"65ca969d-9b3d-4379-a220-fff11397bef6\") " pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:18.818722 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.746977    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkwjk\" (UniqueName: \"kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk\") pod \"network-check-target-nnb8k\" (UID: \"17185f72-eafe-4930-8fcb-1d10baa8f07e\") " pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:18.818722 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aaf57f1c-cee2-4539-88fc-d004dbfb7366-host-slash\") pod \"iptables-alerter-pd57v\" (UID: \"aaf57f1c-cee2-4539-88fc-d004dbfb7366\") " pod="openshift-network-operator/iptables-alerter-pd57v"
Jul 05 13:18:18.818722 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:18.747018    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:18:18.818722 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747032    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-host-run-netns\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.818722 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747057    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-run-ovn\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.818722 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747083    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6c7ce124-8975-400e-9f0b-2527ee19af46-env-overrides\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.818722 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747143    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aaf57f1c-cee2-4539-88fc-d004dbfb7366-host-slash\") pod \"iptables-alerter-pd57v\" (UID: \"aaf57f1c-cee2-4539-88fc-d004dbfb7366\") " pod="openshift-network-operator/iptables-alerter-pd57v"
Jul 05 13:18:18.818722 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:18.747160    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs podName:65ca969d-9b3d-4379-a220-fff11397bef6 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:19.247103767 +0000 UTC m=+2.065071725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs") pod "network-metrics-daemon-rlllr" (UID: "65ca969d-9b3d-4379-a220-fff11397bef6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:18:18.819650 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747225    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-run-ovn\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.819650 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/416aff4f-940f-44b6-8cf2-8d6e1a030c14-etc-selinux\") pod \"aws-ebs-csi-driver-node-vpsff\" (UID: \"416aff4f-940f-44b6-8cf2-8d6e1a030c14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.819650 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747289    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-etc-sysconfig\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.819650 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747315    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-etc-sysctl-d\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.819650 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747338    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-run\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.819650 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747360    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-host-var-lib-cni-bin\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.819650 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747380    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-host-run-netns\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.819650 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747391    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed53678c-46fe-4967-b74f-c12eb3b0e626-system-cni-dir\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.819650 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747383    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-hostroot\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.819650 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747420    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-hostroot\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.819650 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747427    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/416aff4f-940f-44b6-8cf2-8d6e1a030c14-etc-selinux\") pod \"aws-ebs-csi-driver-node-vpsff\" (UID: \"416aff4f-940f-44b6-8cf2-8d6e1a030c14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.819650 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747439    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ef484b2-c6d9-4acf-be33-df3384cff76d-tmp\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.819650 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747469    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-host-var-lib-cni-bin\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.819650 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747469    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed53678c-46fe-4967-b74f-c12eb3b0e626-os-release\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.819650 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b968b72-7bc0-4186-aa14-7405cf541b16-host\") pod \"node-ca-rgn5q\" (UID: \"8b968b72-7bc0-4186-aa14-7405cf541b16\") " pod="openshift-image-registry/node-ca-rgn5q"
Jul 05 13:18:18.821041 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747509    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-etc-sysctl-d\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.821041 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c7ce124-8975-400e-9f0b-2527ee19af46-ovn-node-metrics-cert\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.821041 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747537    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed53678c-46fe-4967-b74f-c12eb3b0e626-os-release\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.821041 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747547    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-dbus\") pod \"global-pull-secret-syncer-t4s6n\" (UID: \"dd27dfce-3c13-4d05-a19b-dcb32e9af21c\") " pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:18.821041 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747566    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-etc-sysconfig\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.821041 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747527    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-run\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.821041 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747554    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b968b72-7bc0-4186-aa14-7405cf541b16-host\") pod \"node-ca-rgn5q\" (UID: \"8b968b72-7bc0-4186-aa14-7405cf541b16\") " pod="openshift-image-registry/node-ca-rgn5q"
Jul 05 13:18:18.821041 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/416aff4f-940f-44b6-8cf2-8d6e1a030c14-registration-dir\") pod \"aws-ebs-csi-driver-node-vpsff\" (UID: \"416aff4f-940f-44b6-8cf2-8d6e1a030c14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.821041 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747602    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/416aff4f-940f-44b6-8cf2-8d6e1a030c14-registration-dir\") pod \"aws-ebs-csi-driver-node-vpsff\" (UID: \"416aff4f-940f-44b6-8cf2-8d6e1a030c14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.821041 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747718    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-host-run-netns\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.821041 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747753    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-host-run-netns\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.821041 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747762    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-host-var-lib-kubelet\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.821041 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747796    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-host-kubelet\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.821041 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747807    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-host-var-lib-kubelet\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.821041 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-host-run-ovn-kubernetes\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.822011 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-etc-modprobe-d\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.822011 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747854    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6c7ce124-8975-400e-9f0b-2527ee19af46-env-overrides\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.822011 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747854    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-host-kubelet\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.822011 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747868    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-sys\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.822011 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747891    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-multus-socket-dir-parent\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.822011 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747884    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-host-run-ovn-kubernetes\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.822011 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbpms\" (UniqueName: \"kubernetes.io/projected/2c02645e-d3d4-4f5e-824f-c629da35133b-kube-api-access-gbpms\") pod \"node-resolver-nltvs\" (UID: \"2c02645e-d3d4-4f5e-824f-c629da35133b\") " pod="openshift-dns/node-resolver-nltvs"
Jul 05 13:18:18.822011 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747949    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-sys\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.822011 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747956    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-etc-modprobe-d\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.822011 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747961    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-systemd-units\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.822011 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747974    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 05 13:18:18.822011 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6c7ce124-8975-400e-9f0b-2527ee19af46-ovnkube-config\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.822011 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.747948    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-multus-socket-dir-parent\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.822011 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748007    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-systemd-units\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.822011 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748022    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-kubelet-config\") pod \"global-pull-secret-syncer-t4s6n\" (UID: \"dd27dfce-3c13-4d05-a19b-dcb32e9af21c\") " pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:18.823202 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748046    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktfzg\" (UniqueName: \"kubernetes.io/projected/416aff4f-940f-44b6-8cf2-8d6e1a030c14-kube-api-access-ktfzg\") pod \"aws-ebs-csi-driver-node-vpsff\" (UID: \"416aff4f-940f-44b6-8cf2-8d6e1a030c14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.823202 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748069    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8b968b72-7bc0-4186-aa14-7405cf541b16-serviceca\") pod \"node-ca-rgn5q\" (UID: \"8b968b72-7bc0-4186-aa14-7405cf541b16\") " pod="openshift-image-registry/node-ca-rgn5q"
Jul 05 13:18:18.823202 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ffb49d9-ee88-454b-8b27-05a4274ef55f-agent-certs\") pod \"konnectivity-agent-zgshx\" (UID: \"2ffb49d9-ee88-454b-8b27-05a4274ef55f\") " pod="kube-system/konnectivity-agent-zgshx"
Jul 05 13:18:18.823202 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748112    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-kubelet-config\") pod \"global-pull-secret-syncer-t4s6n\" (UID: \"dd27dfce-3c13-4d05-a19b-dcb32e9af21c\") " pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:18.823202 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748121    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-system-cni-dir\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.823202 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-run-systemd\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.823202 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748172    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/416aff4f-940f-44b6-8cf2-8d6e1a030c14-socket-dir\") pod \"aws-ebs-csi-driver-node-vpsff\" (UID: \"416aff4f-940f-44b6-8cf2-8d6e1a030c14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.823202 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748200    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/416aff4f-940f-44b6-8cf2-8d6e1a030c14-sys-fs\") pod \"aws-ebs-csi-driver-node-vpsff\" (UID: \"416aff4f-940f-44b6-8cf2-8d6e1a030c14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.823202 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a588119d-ae18-4e26-b843-fb4c25485fa2-cni-binary-copy\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.823202 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4knlm\" (UniqueName: \"kubernetes.io/projected/aaf57f1c-cee2-4539-88fc-d004dbfb7366-kube-api-access-4knlm\") pod \"iptables-alerter-pd57v\" (UID: \"aaf57f1c-cee2-4539-88fc-d004dbfb7366\") " pod="openshift-network-operator/iptables-alerter-pd57v"
Jul 05 13:18:18.823202 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748277    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-run-openvswitch\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.823202 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748306    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-var-lib-kubelet\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.823202 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748330    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8wxh\" (UniqueName: \"kubernetes.io/projected/5ef484b2-c6d9-4acf-be33-df3384cff76d-kube-api-access-z8wxh\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.823202 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748357    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed53678c-46fe-4967-b74f-c12eb3b0e626-cnibin\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.825096 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748387    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ed53678c-46fe-4967-b74f-c12eb3b0e626-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.825096 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748530    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6c7ce124-8975-400e-9f0b-2527ee19af46-ovnkube-config\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.825096 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748588    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-var-lib-kubelet\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.825096 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748701    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8b968b72-7bc0-4186-aa14-7405cf541b16-serviceca\") pod \"node-ca-rgn5q\" (UID: \"8b968b72-7bc0-4186-aa14-7405cf541b16\") " pod="openshift-image-registry/node-ca-rgn5q"
Jul 05 13:18:18.825096 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748835    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-run-openvswitch\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.825096 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748884    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed53678c-46fe-4967-b74f-c12eb3b0e626-cnibin\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.825096 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748920    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-run-systemd\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.825096 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748947    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a588119d-ae18-4e26-b843-fb4c25485fa2-cni-binary-copy\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.825096 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748971    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-system-cni-dir\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.825096 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.748993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a588119d-ae18-4e26-b843-fb4c25485fa2-multus-daemon-config\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.825096 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749018    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/416aff4f-940f-44b6-8cf2-8d6e1a030c14-socket-dir\") pod \"aws-ebs-csi-driver-node-vpsff\" (UID: \"416aff4f-940f-44b6-8cf2-8d6e1a030c14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.825096 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749022    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c02645e-d3d4-4f5e-824f-c629da35133b-hosts-file\") pod \"node-resolver-nltvs\" (UID: \"2c02645e-d3d4-4f5e-824f-c629da35133b\") " pod="openshift-dns/node-resolver-nltvs"
Jul 05 13:18:18.825096 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749035    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/416aff4f-940f-44b6-8cf2-8d6e1a030c14-sys-fs\") pod \"aws-ebs-csi-driver-node-vpsff\" (UID: \"416aff4f-940f-44b6-8cf2-8d6e1a030c14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.825096 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749049    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-etc-openvswitch\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.825096 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749078    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed53678c-46fe-4967-b74f-c12eb3b0e626-cni-binary-copy\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.825840 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749085    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ed53678c-46fe-4967-b74f-c12eb3b0e626-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.825840 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749103    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfspb\" (UniqueName: \"kubernetes.io/projected/8b968b72-7bc0-4186-aa14-7405cf541b16-kube-api-access-dfspb\") pod \"node-ca-rgn5q\" (UID: \"8b968b72-7bc0-4186-aa14-7405cf541b16\") " pod="openshift-image-registry/node-ca-rgn5q"
Jul 05 13:18:18.825840 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749091    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c02645e-d3d4-4f5e-824f-c629da35133b-hosts-file\") pod \"node-resolver-nltvs\" (UID: \"2c02645e-d3d4-4f5e-824f-c629da35133b\") " pod="openshift-dns/node-resolver-nltvs"
Jul 05 13:18:18.825840 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749126    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-os-release\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.825840 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749122    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-etc-openvswitch\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.825840 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-log-socket\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.825840 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749202    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-log-socket\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.825840 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749265    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-os-release\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.825840 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749289    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6c7ce124-8975-400e-9f0b-2527ee19af46-ovnkube-script-lib\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.825840 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749324    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed53678c-46fe-4967-b74f-c12eb3b0e626-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.825840 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749349    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-node-log\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.825840 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-etc-sysctl-conf\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.825840 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749406    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a588119d-ae18-4e26-b843-fb4c25485fa2-multus-daemon-config\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.825840 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749460    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-host\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.825840 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749399    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-host\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.826527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749495    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-host-cni-bin\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.826527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749519    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.826527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749544    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-etc-kubernetes\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.826527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749563    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed53678c-46fe-4967-b74f-c12eb3b0e626-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.826527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749600    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.826527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749612    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-host-run-k8s-cni-cncf-io\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.826527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749614    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed53678c-46fe-4967-b74f-c12eb3b0e626-cni-binary-copy\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.826527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749632    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-etc-kubernetes\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.826527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-host-run-k8s-cni-cncf-io\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.826527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749652    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-host-cni-bin\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.826527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749676    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-host-var-lib-cni-multus\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.826527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-multus-conf-dir\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.826527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749759    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-etc-sysctl-conf\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.826527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749760    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-etc-kubernetes\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.827150 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749805    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-host-var-lib-cni-multus\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.827150 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749824    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-etc-kubernetes\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.827150 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749837    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-multus-conf-dir\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.827150 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749861    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-etc-systemd\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.827150 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749868    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-node-log\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.827150 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749873    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6c7ce124-8975-400e-9f0b-2527ee19af46-ovnkube-script-lib\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.827150 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749884    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c02645e-d3d4-4f5e-824f-c629da35133b-tmp-dir\") pod \"node-resolver-nltvs\" (UID: \"2c02645e-d3d4-4f5e-824f-c629da35133b\") " pod="openshift-dns/node-resolver-nltvs"
Jul 05 13:18:18.827150 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749920    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv5j2\" (UniqueName: \"kubernetes.io/projected/6c7ce124-8975-400e-9f0b-2527ee19af46-kube-api-access-nv5j2\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.827150 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/416aff4f-940f-44b6-8cf2-8d6e1a030c14-device-dir\") pod \"aws-ebs-csi-driver-node-vpsff\" (UID: \"416aff4f-940f-44b6-8cf2-8d6e1a030c14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.827150 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749924    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-etc-systemd\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.827150 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.749977    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6cvt\" (UniqueName: \"kubernetes.io/projected/ed53678c-46fe-4967-b74f-c12eb3b0e626-kube-api-access-w6cvt\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.827150 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.750059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ffb49d9-ee88-454b-8b27-05a4274ef55f-konnectivity-ca\") pod \"konnectivity-agent-zgshx\" (UID: \"2ffb49d9-ee88-454b-8b27-05a4274ef55f\") " pod="kube-system/konnectivity-agent-zgshx"
Jul 05 13:18:18.827150 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.750112    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aaf57f1c-cee2-4539-88fc-d004dbfb7366-iptables-alerter-script\") pod \"iptables-alerter-pd57v\" (UID: \"aaf57f1c-cee2-4539-88fc-d004dbfb7366\") " pod="openshift-network-operator/iptables-alerter-pd57v"
Jul 05 13:18:18.827150 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.750058    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/416aff4f-940f-44b6-8cf2-8d6e1a030c14-device-dir\") pod \"aws-ebs-csi-driver-node-vpsff\" (UID: \"416aff4f-940f-44b6-8cf2-8d6e1a030c14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.827800 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.750465    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-host-slash\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.827800 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.750636    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-host-slash\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.827800 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.750682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-var-lib-openvswitch\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.827800 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.750733    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/416aff4f-940f-44b6-8cf2-8d6e1a030c14-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vpsff\" (UID: \"416aff4f-940f-44b6-8cf2-8d6e1a030c14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.827800 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.750763    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret\") pod \"global-pull-secret-syncer-t4s6n\" (UID: \"dd27dfce-3c13-4d05-a19b-dcb32e9af21c\") " pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:18.827800 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.750767    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ffb49d9-ee88-454b-8b27-05a4274ef55f-konnectivity-ca\") pod \"konnectivity-agent-zgshx\" (UID: \"2ffb49d9-ee88-454b-8b27-05a4274ef55f\") " pod="kube-system/konnectivity-agent-zgshx"
Jul 05 13:18:18.827800 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.750789    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-host-run-multus-certs\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.827800 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.750833    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88g76\" (UniqueName: \"kubernetes.io/projected/a588119d-ae18-4e26-b843-fb4c25485fa2-kube-api-access-88g76\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.827800 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.750838    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/416aff4f-940f-44b6-8cf2-8d6e1a030c14-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vpsff\" (UID: \"416aff4f-940f-44b6-8cf2-8d6e1a030c14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.827800 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.750860    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aaf57f1c-cee2-4539-88fc-d004dbfb7366-iptables-alerter-script\") pod \"iptables-alerter-pd57v\" (UID: \"aaf57f1c-cee2-4539-88fc-d004dbfb7366\") " pod="openshift-network-operator/iptables-alerter-pd57v"
Jul 05 13:18:18.827800 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.750865    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-multus-cni-dir\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.827800 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.750882    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-var-lib-openvswitch\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.827800 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.750911    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-host-cni-netd\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.827800 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.750925    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-host-run-multus-certs\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.827800 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.750926    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a588119d-ae18-4e26-b843-fb4c25485fa2-multus-cni-dir\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.828471 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.750936    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-lib-modules\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.828471 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.750959    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5ef484b2-c6d9-4acf-be33-df3384cff76d-etc-tuned\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.828471 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.750969    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6c7ce124-8975-400e-9f0b-2527ee19af46-host-cni-netd\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.828471 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.751009    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ed53678c-46fe-4967-b74f-c12eb3b0e626-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.828471 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.751094    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ef484b2-c6d9-4acf-be33-df3384cff76d-lib-modules\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.828471 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:18.751209    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 13:18:18.828471 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:18.751266    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret podName:dd27dfce-3c13-4d05-a19b-dcb32e9af21c nodeName:}" failed. No retries permitted until 2026-07-05 13:18:19.251246996 +0000 UTC m=+2.069214935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret") pod "global-pull-secret-syncer-t4s6n" (UID: "dd27dfce-3c13-4d05-a19b-dcb32e9af21c") : object "kube-system"/"original-pull-secret" not registered
Jul 05 13:18:18.828471 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.751512    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ed53678c-46fe-4967-b74f-c12eb3b0e626-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.828471 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.752339    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ef484b2-c6d9-4acf-be33-df3384cff76d-tmp\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.828471 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.752555    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ffb49d9-ee88-454b-8b27-05a4274ef55f-agent-certs\") pod \"konnectivity-agent-zgshx\" (UID: \"2ffb49d9-ee88-454b-8b27-05a4274ef55f\") " pod="kube-system/konnectivity-agent-zgshx"
Jul 05 13:18:18.828471 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.752888    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c7ce124-8975-400e-9f0b-2527ee19af46-ovn-node-metrics-cert\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.828471 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.753189    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5ef484b2-c6d9-4acf-be33-df3384cff76d-etc-tuned\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.828471 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:18.754662    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 13:18:18.828471 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:18.754681    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 13:18:18.828471 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:18.754694    2565 projected.go:196] Error preparing data for projected volume kube-api-access-wkwjk for pod openshift-network-diagnostics/network-check-target-nnb8k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:18:18.829196 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:18.754788    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk podName:17185f72-eafe-4930-8fcb-1d10baa8f07e nodeName:}" failed. No retries permitted until 2026-07-05 13:18:19.254769776 +0000 UTC m=+2.072737725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wkwjk" (UniqueName: "kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk") pod "network-check-target-nnb8k" (UID: "17185f72-eafe-4930-8fcb-1d10baa8f07e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:18:18.829196 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.757132    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvdbw\" (UniqueName: \"kubernetes.io/projected/65ca969d-9b3d-4379-a220-fff11397bef6-kube-api-access-wvdbw\") pod \"network-metrics-daemon-rlllr\" (UID: \"65ca969d-9b3d-4379-a220-fff11397bef6\") " pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:18.829196 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.757298    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4knlm\" (UniqueName: \"kubernetes.io/projected/aaf57f1c-cee2-4539-88fc-d004dbfb7366-kube-api-access-4knlm\") pod \"iptables-alerter-pd57v\" (UID: \"aaf57f1c-cee2-4539-88fc-d004dbfb7366\") " pod="openshift-network-operator/iptables-alerter-pd57v"
Jul 05 13:18:18.829196 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.758209    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 13:18:18.829196 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.759067    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c02645e-d3d4-4f5e-824f-c629da35133b-tmp-dir\") pod \"node-resolver-nltvs\" (UID: \"2c02645e-d3d4-4f5e-824f-c629da35133b\") " pod="openshift-dns/node-resolver-nltvs"
Jul 05 13:18:18.829196 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.759442    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pd57v"
Jul 05 13:18:18.829196 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.762090    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbpms\" (UniqueName: \"kubernetes.io/projected/2c02645e-d3d4-4f5e-824f-c629da35133b-kube-api-access-gbpms\") pod \"node-resolver-nltvs\" (UID: \"2c02645e-d3d4-4f5e-824f-c629da35133b\") " pod="openshift-dns/node-resolver-nltvs"
Jul 05 13:18:18.829196 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.767458    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfspb\" (UniqueName: \"kubernetes.io/projected/8b968b72-7bc0-4186-aa14-7405cf541b16-kube-api-access-dfspb\") pod \"node-ca-rgn5q\" (UID: \"8b968b72-7bc0-4186-aa14-7405cf541b16\") " pod="openshift-image-registry/node-ca-rgn5q"
Jul 05 13:18:18.829196 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.768921    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktfzg\" (UniqueName: \"kubernetes.io/projected/416aff4f-940f-44b6-8cf2-8d6e1a030c14-kube-api-access-ktfzg\") pod \"aws-ebs-csi-driver-node-vpsff\" (UID: \"416aff4f-940f-44b6-8cf2-8d6e1a030c14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.829196 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.775476    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88g76\" (UniqueName: \"kubernetes.io/projected/a588119d-ae18-4e26-b843-fb4c25485fa2-kube-api-access-88g76\") pod \"multus-kzhs6\" (UID: \"a588119d-ae18-4e26-b843-fb4c25485fa2\") " pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:18.829196 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.775678    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6cvt\" (UniqueName: \"kubernetes.io/projected/ed53678c-46fe-4967-b74f-c12eb3b0e626-kube-api-access-w6cvt\") pod \"multus-additional-cni-plugins-b2lbp\" (UID: \"ed53678c-46fe-4967-b74f-c12eb3b0e626\") " pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.829196 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.777808    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv5j2\" (UniqueName: \"kubernetes.io/projected/6c7ce124-8975-400e-9f0b-2527ee19af46-kube-api-access-nv5j2\") pod \"ovnkube-node-xj7gc\" (UID: \"6c7ce124-8975-400e-9f0b-2527ee19af46\") " pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.829196 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.781137    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8wxh\" (UniqueName: \"kubernetes.io/projected/5ef484b2-c6d9-4acf-be33-df3384cff76d-kube-api-access-z8wxh\") pod \"tuned-k2hfx\" (UID: \"5ef484b2-c6d9-4acf-be33-df3384cff76d\") " pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.829196 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.793373    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nltvs"
Jul 05 13:18:18.843807 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.843778    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rgn5q"
Jul 05 13:18:18.870030 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.869997    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:18.876362 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.876341    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff"
Jul 05 13:18:18.888499 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.888464    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zgshx"
Jul 05 13:18:18.920035 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.920000    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k2hfx"
Jul 05 13:18:18.940330 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:18.940281    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod700cc51e5868b85faed88c518f5936e2.slice/crio-36b1de37f56ab6c42906cf97fe8083289c8f330b577ef8a47e9fa82d4349d05c WatchSource:0}: Error finding container 36b1de37f56ab6c42906cf97fe8083289c8f330b577ef8a47e9fa82d4349d05c: Status 404 returned error can't find the container with id 36b1de37f56ab6c42906cf97fe8083289c8f330b577ef8a47e9fa82d4349d05c
Jul 05 13:18:18.942360 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:18.942327    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd60fe1be8856ccb927069ef5697d039f.slice/crio-fc87097892ea97baa056fb43636b8f546d978e7279139c1f41aaa92dbeb812de WatchSource:0}: Error finding container fc87097892ea97baa056fb43636b8f546d978e7279139c1f41aaa92dbeb812de: Status 404 returned error can't find the container with id fc87097892ea97baa056fb43636b8f546d978e7279139c1f41aaa92dbeb812de
Jul 05 13:18:18.943134 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:18.943109    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ef484b2_c6d9_4acf_be33_df3384cff76d.slice/crio-e4650ab6b6e8e4a03d5bf5782fcbf191d48d953aab4687e6b1912c5606013859 WatchSource:0}: Error finding container e4650ab6b6e8e4a03d5bf5782fcbf191d48d953aab4687e6b1912c5606013859: Status 404 returned error can't find the container with id e4650ab6b6e8e4a03d5bf5782fcbf191d48d953aab4687e6b1912c5606013859
Jul 05 13:18:18.946823 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.946727    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 13:18:18.970769 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:18.970733    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b2lbp"
Jul 05 13:18:18.980760 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:18.980732    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded53678c_46fe_4967_b74f_c12eb3b0e626.slice/crio-a8968e2dc67fa1d45eb7ee98399e93b17e478f212e0b32a4f05cdeaf9bbebff6 WatchSource:0}: Error finding container a8968e2dc67fa1d45eb7ee98399e93b17e478f212e0b32a4f05cdeaf9bbebff6: Status 404 returned error can't find the container with id a8968e2dc67fa1d45eb7ee98399e93b17e478f212e0b32a4f05cdeaf9bbebff6
Jul 05 13:18:19.002543 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:19.002514    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kzhs6"
Jul 05 13:18:19.011090 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:19.011064    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda588119d_ae18_4e26_b843_fb4c25485fa2.slice/crio-314cbe3ec0e5c35ed5c4bec8cf3b92b634bd02fc3c5b6dfa7a3107b5143893a7 WatchSource:0}: Error finding container 314cbe3ec0e5c35ed5c4bec8cf3b92b634bd02fc3c5b6dfa7a3107b5143893a7: Status 404 returned error can't find the container with id 314cbe3ec0e5c35ed5c4bec8cf3b92b634bd02fc3c5b6dfa7a3107b5143893a7
Jul 05 13:18:19.069019 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:19.068985    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 13:18:19.137736 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:19.137700    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c02645e_d3d4_4f5e_824f_c629da35133b.slice/crio-4511164dfc33a7c9e40f77bca778b6790bc13cadfdc1a89d663128e7959b3d76 WatchSource:0}: Error finding container 4511164dfc33a7c9e40f77bca778b6790bc13cadfdc1a89d663128e7959b3d76: Status 404 returned error can't find the container with id 4511164dfc33a7c9e40f77bca778b6790bc13cadfdc1a89d663128e7959b3d76
Jul 05 13:18:19.172519 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:19.172488    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ffb49d9_ee88_454b_8b27_05a4274ef55f.slice/crio-9f866fbcffcdcd65fc94153258db0b2981d24e295603955ad537751f2c9da19c WatchSource:0}: Error finding container 9f866fbcffcdcd65fc94153258db0b2981d24e295603955ad537751f2c9da19c: Status 404 returned error can't find the container with id 9f866fbcffcdcd65fc94153258db0b2981d24e295603955ad537751f2c9da19c
Jul 05 13:18:19.192246 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:19.192214    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b968b72_7bc0_4186_aa14_7405cf541b16.slice/crio-024f0e3a04a677ab868a1084e1695fc162f056abde37573c39ec3635ab28a0eb WatchSource:0}: Error finding container 024f0e3a04a677ab868a1084e1695fc162f056abde37573c39ec3635ab28a0eb: Status 404 returned error can't find the container with id 024f0e3a04a677ab868a1084e1695fc162f056abde37573c39ec3635ab28a0eb
Jul 05 13:18:19.235622 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:19.235594    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c7ce124_8975_400e_9f0b_2527ee19af46.slice/crio-bdc6118adf786bee404993846b80eda7276f7286639a9715e19844ae62a301ca WatchSource:0}: Error finding container bdc6118adf786bee404993846b80eda7276f7286639a9715e19844ae62a301ca: Status 404 returned error can't find the container with id bdc6118adf786bee404993846b80eda7276f7286639a9715e19844ae62a301ca
Jul 05 13:18:19.259607 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:19.259572    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret\") pod \"global-pull-secret-syncer-t4s6n\" (UID: \"dd27dfce-3c13-4d05-a19b-dcb32e9af21c\") " pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:19.259607 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:19.259612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs\") pod \"network-metrics-daemon-rlllr\" (UID: \"65ca969d-9b3d-4379-a220-fff11397bef6\") " pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:19.259870 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:19.259643    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkwjk\" (UniqueName: \"kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk\") pod \"network-check-target-nnb8k\" (UID: \"17185f72-eafe-4930-8fcb-1d10baa8f07e\") " pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:19.259870 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:19.259752    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 13:18:19.259870 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:19.259765    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 13:18:19.259870 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:19.259787    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 13:18:19.259870 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:19.259796    2565 projected.go:196] Error preparing data for projected volume kube-api-access-wkwjk for pod openshift-network-diagnostics/network-check-target-nnb8k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:18:19.259870 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:19.259752    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:18:19.259870 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:19.259823    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret podName:dd27dfce-3c13-4d05-a19b-dcb32e9af21c nodeName:}" failed. No retries permitted until 2026-07-05 13:18:20.259802732 +0000 UTC m=+3.077770685 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret") pod "global-pull-secret-syncer-t4s6n" (UID: "dd27dfce-3c13-4d05-a19b-dcb32e9af21c") : object "kube-system"/"original-pull-secret" not registered
Jul 05 13:18:19.259870 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:19.259843    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk podName:17185f72-eafe-4930-8fcb-1d10baa8f07e nodeName:}" failed. No retries permitted until 2026-07-05 13:18:20.259833166 +0000 UTC m=+3.077801102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkwjk" (UniqueName: "kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk") pod "network-check-target-nnb8k" (UID: "17185f72-eafe-4930-8fcb-1d10baa8f07e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:18:19.259870 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:19.259861    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs podName:65ca969d-9b3d-4379-a220-fff11397bef6 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:20.259850474 +0000 UTC m=+3.077818414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs") pod "network-metrics-daemon-rlllr" (UID: "65ca969d-9b3d-4379-a220-fff11397bef6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:18:19.285571 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:19.284117    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaf57f1c_cee2_4539_88fc_d004dbfb7366.slice/crio-373eb4b2cb89500d480167486ef883c17086d3fd7e5ea0684139f8a826e2d7d6 WatchSource:0}: Error finding container 373eb4b2cb89500d480167486ef883c17086d3fd7e5ea0684139f8a826e2d7d6: Status 404 returned error can't find the container with id 373eb4b2cb89500d480167486ef883c17086d3fd7e5ea0684139f8a826e2d7d6
Jul 05 13:18:19.523857 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:19.523773    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 13:18:19.692874 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:19.692793    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 13:13:18 +0000 UTC" deadline="2028-01-02 17:21:04.760541532 +0000 UTC"
Jul 05 13:18:19.692874 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:19.692863    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13108h2m45.067682816s"
Jul 05 13:18:19.737996 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:19.735467    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:19.737996 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:19.735615    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4s6n" podUID="dd27dfce-3c13-4d05-a19b-dcb32e9af21c"
Jul 05 13:18:19.758974 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:19.758734    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nltvs" event={"ID":"2c02645e-d3d4-4f5e-824f-c629da35133b","Type":"ContainerStarted","Data":"4511164dfc33a7c9e40f77bca778b6790bc13cadfdc1a89d663128e7959b3d76"}
Jul 05 13:18:19.776371 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:19.776195    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2lbp" event={"ID":"ed53678c-46fe-4967-b74f-c12eb3b0e626","Type":"ContainerStarted","Data":"a8968e2dc67fa1d45eb7ee98399e93b17e478f212e0b32a4f05cdeaf9bbebff6"}
Jul 05 13:18:19.787379 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:19.787268    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-22.ec2.internal" event={"ID":"d60fe1be8856ccb927069ef5697d039f","Type":"ContainerStarted","Data":"fc87097892ea97baa056fb43636b8f546d978e7279139c1f41aaa92dbeb812de"}
Jul 05 13:18:19.794544 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:19.794462    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-22.ec2.internal" event={"ID":"700cc51e5868b85faed88c518f5936e2","Type":"ContainerStarted","Data":"36b1de37f56ab6c42906cf97fe8083289c8f330b577ef8a47e9fa82d4349d05c"}
Jul 05 13:18:19.806216 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:19.806021    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc" event={"ID":"6c7ce124-8975-400e-9f0b-2527ee19af46","Type":"ContainerStarted","Data":"bdc6118adf786bee404993846b80eda7276f7286639a9715e19844ae62a301ca"}
Jul 05 13:18:19.820329 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:19.819965    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zgshx" event={"ID":"2ffb49d9-ee88-454b-8b27-05a4274ef55f","Type":"ContainerStarted","Data":"9f866fbcffcdcd65fc94153258db0b2981d24e295603955ad537751f2c9da19c"}
Jul 05 13:18:19.846650 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:19.846600    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kzhs6" event={"ID":"a588119d-ae18-4e26-b843-fb4c25485fa2","Type":"ContainerStarted","Data":"314cbe3ec0e5c35ed5c4bec8cf3b92b634bd02fc3c5b6dfa7a3107b5143893a7"}
Jul 05 13:18:19.865505 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:19.865394    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k2hfx" event={"ID":"5ef484b2-c6d9-4acf-be33-df3384cff76d","Type":"ContainerStarted","Data":"e4650ab6b6e8e4a03d5bf5782fcbf191d48d953aab4687e6b1912c5606013859"}
Jul 05 13:18:19.877792 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:19.877752    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff" event={"ID":"416aff4f-940f-44b6-8cf2-8d6e1a030c14","Type":"ContainerStarted","Data":"3e6fdd717253838111661028dcf4bf928134bd5ecde411e2d5043fe38a6530ce"}
Jul 05 13:18:19.895180 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:19.895132    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pd57v" event={"ID":"aaf57f1c-cee2-4539-88fc-d004dbfb7366","Type":"ContainerStarted","Data":"373eb4b2cb89500d480167486ef883c17086d3fd7e5ea0684139f8a826e2d7d6"}
Jul 05 13:18:19.902276 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:19.902238    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rgn5q" event={"ID":"8b968b72-7bc0-4186-aa14-7405cf541b16","Type":"ContainerStarted","Data":"024f0e3a04a677ab868a1084e1695fc162f056abde37573c39ec3635ab28a0eb"}
Jul 05 13:18:20.268518 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:20.268418    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret\") pod \"global-pull-secret-syncer-t4s6n\" (UID: \"dd27dfce-3c13-4d05-a19b-dcb32e9af21c\") " pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:20.268518 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:20.268484    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs\") pod \"network-metrics-daemon-rlllr\" (UID: \"65ca969d-9b3d-4379-a220-fff11397bef6\") " pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:20.268518 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:20.268513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkwjk\" (UniqueName: \"kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk\") pod \"network-check-target-nnb8k\" (UID: \"17185f72-eafe-4930-8fcb-1d10baa8f07e\") " pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:20.268855 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:20.268706    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 13:18:20.268855 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:20.268728    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 13:18:20.268855 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:20.268741    2565 projected.go:196] Error preparing data for projected volume kube-api-access-wkwjk for pod openshift-network-diagnostics/network-check-target-nnb8k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:18:20.268855 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:20.268803    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk podName:17185f72-eafe-4930-8fcb-1d10baa8f07e nodeName:}" failed. No retries permitted until 2026-07-05 13:18:22.268782829 +0000 UTC m=+5.086750783 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkwjk" (UniqueName: "kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk") pod "network-check-target-nnb8k" (UID: "17185f72-eafe-4930-8fcb-1d10baa8f07e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:18:20.269306 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:20.269195    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 13:18:20.269306 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:20.269244    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret podName:dd27dfce-3c13-4d05-a19b-dcb32e9af21c nodeName:}" failed. No retries permitted until 2026-07-05 13:18:22.269230433 +0000 UTC m=+5.087198374 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret") pod "global-pull-secret-syncer-t4s6n" (UID: "dd27dfce-3c13-4d05-a19b-dcb32e9af21c") : object "kube-system"/"original-pull-secret" not registered
Jul 05 13:18:20.269306 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:20.269298    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:18:20.269515 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:20.269328    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs podName:65ca969d-9b3d-4379-a220-fff11397bef6 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:22.269318056 +0000 UTC m=+5.087285996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs") pod "network-metrics-daemon-rlllr" (UID: "65ca969d-9b3d-4379-a220-fff11397bef6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:18:20.495945 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:20.495911    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 05 13:18:20.693732 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:20.693614    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 13:13:18 +0000 UTC" deadline="2028-02-14 02:51:20.473099354 +0000 UTC"
Jul 05 13:18:20.693732 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:20.693675    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14125h32m59.779429549s"
Jul 05 13:18:20.735796 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:20.735364    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:20.735796 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:20.735495    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnb8k" podUID="17185f72-eafe-4930-8fcb-1d10baa8f07e"
Jul 05 13:18:20.736043 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:20.735906    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:20.736043 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:20.736010    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlllr" podUID="65ca969d-9b3d-4379-a220-fff11397bef6"
Jul 05 13:18:21.743381 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:21.742839    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:21.743381 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:21.742985    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4s6n" podUID="dd27dfce-3c13-4d05-a19b-dcb32e9af21c"
Jul 05 13:18:22.292660 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:22.291652    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs\") pod \"network-metrics-daemon-rlllr\" (UID: \"65ca969d-9b3d-4379-a220-fff11397bef6\") " pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:22.292660 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:22.291704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkwjk\" (UniqueName: \"kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk\") pod \"network-check-target-nnb8k\" (UID: \"17185f72-eafe-4930-8fcb-1d10baa8f07e\") " pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:22.292660 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:22.291786    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret\") pod \"global-pull-secret-syncer-t4s6n\" (UID: \"dd27dfce-3c13-4d05-a19b-dcb32e9af21c\") " pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:22.292660 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:22.291906    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 13:18:22.292660 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:22.291971    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret podName:dd27dfce-3c13-4d05-a19b-dcb32e9af21c nodeName:}" failed. No retries permitted until 2026-07-05 13:18:26.291952552 +0000 UTC m=+9.109920493 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret") pod "global-pull-secret-syncer-t4s6n" (UID: "dd27dfce-3c13-4d05-a19b-dcb32e9af21c") : object "kube-system"/"original-pull-secret" not registered
Jul 05 13:18:22.292660 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:22.292411    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:18:22.292660 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:22.292462    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs podName:65ca969d-9b3d-4379-a220-fff11397bef6 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:26.292446584 +0000 UTC m=+9.110414525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs") pod "network-metrics-daemon-rlllr" (UID: "65ca969d-9b3d-4379-a220-fff11397bef6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:18:22.292660 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:22.292538    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 13:18:22.292660 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:22.292552    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 13:18:22.292660 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:22.292565    2565 projected.go:196] Error preparing data for projected volume kube-api-access-wkwjk for pod openshift-network-diagnostics/network-check-target-nnb8k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:18:22.292660 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:22.292600    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk podName:17185f72-eafe-4930-8fcb-1d10baa8f07e nodeName:}" failed. No retries permitted until 2026-07-05 13:18:26.292588828 +0000 UTC m=+9.110556769 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkwjk" (UniqueName: "kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk") pod "network-check-target-nnb8k" (UID: "17185f72-eafe-4930-8fcb-1d10baa8f07e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:18:22.735484 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:22.735451    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:22.735670 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:22.735584    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnb8k" podUID="17185f72-eafe-4930-8fcb-1d10baa8f07e"
Jul 05 13:18:22.735743 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:22.735722    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:22.735841 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:22.735819    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlllr" podUID="65ca969d-9b3d-4379-a220-fff11397bef6"
Jul 05 13:18:23.735945 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:23.735072    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:23.735945 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:23.735216    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4s6n" podUID="dd27dfce-3c13-4d05-a19b-dcb32e9af21c"
Jul 05 13:18:24.735212 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:24.735161    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:24.735425 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:24.735170    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:24.735425 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:24.735317    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlllr" podUID="65ca969d-9b3d-4379-a220-fff11397bef6"
Jul 05 13:18:24.735425 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:24.735374    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnb8k" podUID="17185f72-eafe-4930-8fcb-1d10baa8f07e"
Jul 05 13:18:25.735033 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:25.734986    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:25.735477 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:25.735142    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4s6n" podUID="dd27dfce-3c13-4d05-a19b-dcb32e9af21c"
Jul 05 13:18:26.331329 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:26.331287    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret\") pod \"global-pull-secret-syncer-t4s6n\" (UID: \"dd27dfce-3c13-4d05-a19b-dcb32e9af21c\") " pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:26.331518 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:26.331349    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs\") pod \"network-metrics-daemon-rlllr\" (UID: \"65ca969d-9b3d-4379-a220-fff11397bef6\") " pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:26.331518 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:26.331378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkwjk\" (UniqueName: \"kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk\") pod \"network-check-target-nnb8k\" (UID: \"17185f72-eafe-4930-8fcb-1d10baa8f07e\") " pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:26.331655 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:26.331532    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 13:18:26.331655 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:26.331548    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 13:18:26.331655 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:26.331561    2565 projected.go:196] Error preparing data for projected volume kube-api-access-wkwjk for pod openshift-network-diagnostics/network-check-target-nnb8k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:18:26.331655 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:26.331618    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk podName:17185f72-eafe-4930-8fcb-1d10baa8f07e nodeName:}" failed. No retries permitted until 2026-07-05 13:18:34.331599825 +0000 UTC m=+17.149567765 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkwjk" (UniqueName: "kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk") pod "network-check-target-nnb8k" (UID: "17185f72-eafe-4930-8fcb-1d10baa8f07e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:18:26.332245 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:26.332053    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 13:18:26.332245 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:26.332110    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret podName:dd27dfce-3c13-4d05-a19b-dcb32e9af21c nodeName:}" failed. No retries permitted until 2026-07-05 13:18:34.332093468 +0000 UTC m=+17.150061410 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret") pod "global-pull-secret-syncer-t4s6n" (UID: "dd27dfce-3c13-4d05-a19b-dcb32e9af21c") : object "kube-system"/"original-pull-secret" not registered
Jul 05 13:18:26.332245 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:26.332165    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:18:26.332245 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:26.332197    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs podName:65ca969d-9b3d-4379-a220-fff11397bef6 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:34.332185635 +0000 UTC m=+17.150153571 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs") pod "network-metrics-daemon-rlllr" (UID: "65ca969d-9b3d-4379-a220-fff11397bef6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:18:26.734933 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:26.734901    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:26.735115 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:26.734901    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:26.735115 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:26.735013    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnb8k" podUID="17185f72-eafe-4930-8fcb-1d10baa8f07e"
Jul 05 13:18:26.735115 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:26.735072    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlllr" podUID="65ca969d-9b3d-4379-a220-fff11397bef6"
Jul 05 13:18:27.736484 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:27.736446    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:27.736949 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:27.736571    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4s6n" podUID="dd27dfce-3c13-4d05-a19b-dcb32e9af21c"
Jul 05 13:18:28.735171 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:28.735131    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:28.735171 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:28.735152    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:28.735402 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:28.735269    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnb8k" podUID="17185f72-eafe-4930-8fcb-1d10baa8f07e"
Jul 05 13:18:28.735463 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:28.735409    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlllr" podUID="65ca969d-9b3d-4379-a220-fff11397bef6"
Jul 05 13:18:29.735570 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:29.735533    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:29.736012 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:29.735685    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4s6n" podUID="dd27dfce-3c13-4d05-a19b-dcb32e9af21c"
Jul 05 13:18:30.735359 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:30.735319    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:30.735538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:30.735343    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:30.735538 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:30.735456    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlllr" podUID="65ca969d-9b3d-4379-a220-fff11397bef6"
Jul 05 13:18:30.735538 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:30.735493    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnb8k" podUID="17185f72-eafe-4930-8fcb-1d10baa8f07e"
Jul 05 13:18:31.735725 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:31.735692    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:31.736176 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:31.735810    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4s6n" podUID="dd27dfce-3c13-4d05-a19b-dcb32e9af21c"
Jul 05 13:18:32.734902 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:32.734869    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:32.735073 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:32.734868    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:32.735073 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:32.734987    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlllr" podUID="65ca969d-9b3d-4379-a220-fff11397bef6"
Jul 05 13:18:32.735186 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:32.735080    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnb8k" podUID="17185f72-eafe-4930-8fcb-1d10baa8f07e"
Jul 05 13:18:33.735299 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:33.735263    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:33.735791 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:33.735402    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4s6n" podUID="dd27dfce-3c13-4d05-a19b-dcb32e9af21c"
Jul 05 13:18:34.398753 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:34.398720    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret\") pod \"global-pull-secret-syncer-t4s6n\" (UID: \"dd27dfce-3c13-4d05-a19b-dcb32e9af21c\") " pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:34.398753 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:34.398760    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs\") pod \"network-metrics-daemon-rlllr\" (UID: \"65ca969d-9b3d-4379-a220-fff11397bef6\") " pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:34.399045 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:34.398779    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkwjk\" (UniqueName: \"kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk\") pod \"network-check-target-nnb8k\" (UID: \"17185f72-eafe-4930-8fcb-1d10baa8f07e\") " pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:34.399045 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:34.398934    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:18:34.399045 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:34.398965    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 13:18:34.399045 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:34.398984    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 13:18:34.399045 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:34.398994    2565 projected.go:196] Error preparing data for projected volume kube-api-access-wkwjk for pod openshift-network-diagnostics/network-check-target-nnb8k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:18:34.399045 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:34.399018    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs podName:65ca969d-9b3d-4379-a220-fff11397bef6 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:50.398995219 +0000 UTC m=+33.216963161 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs") pod "network-metrics-daemon-rlllr" (UID: "65ca969d-9b3d-4379-a220-fff11397bef6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:18:34.399045 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:34.399035    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk podName:17185f72-eafe-4930-8fcb-1d10baa8f07e nodeName:}" failed. No retries permitted until 2026-07-05 13:18:50.399024578 +0000 UTC m=+33.216992512 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkwjk" (UniqueName: "kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk") pod "network-check-target-nnb8k" (UID: "17185f72-eafe-4930-8fcb-1d10baa8f07e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:18:34.399045 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:34.398934    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 13:18:34.399330 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:34.399102    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret podName:dd27dfce-3c13-4d05-a19b-dcb32e9af21c nodeName:}" failed. No retries permitted until 2026-07-05 13:18:50.39908383 +0000 UTC m=+33.217051782 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret") pod "global-pull-secret-syncer-t4s6n" (UID: "dd27dfce-3c13-4d05-a19b-dcb32e9af21c") : object "kube-system"/"original-pull-secret" not registered
Jul 05 13:18:34.735243 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:34.735162    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:34.735383 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:34.735284    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnb8k" podUID="17185f72-eafe-4930-8fcb-1d10baa8f07e"
Jul 05 13:18:34.735383 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:34.735317    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:34.735383 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:34.735374    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlllr" podUID="65ca969d-9b3d-4379-a220-fff11397bef6"
Jul 05 13:18:35.735432 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:35.735395    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:35.735919 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:35.735543    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4s6n" podUID="dd27dfce-3c13-4d05-a19b-dcb32e9af21c"
Jul 05 13:18:36.734918 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:36.734877    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:36.734918 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:36.734913    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:36.735148 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:36.734998    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnb8k" podUID="17185f72-eafe-4930-8fcb-1d10baa8f07e"
Jul 05 13:18:36.735193 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:36.735153    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlllr" podUID="65ca969d-9b3d-4379-a220-fff11397bef6"
Jul 05 13:18:37.736208 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:37.736169    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:37.736619 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:37.736302    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4s6n" podUID="dd27dfce-3c13-4d05-a19b-dcb32e9af21c"
Jul 05 13:18:38.734977 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:38.734770    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:38.735147 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:38.734801    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:38.735147 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:38.735070    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnb8k" podUID="17185f72-eafe-4930-8fcb-1d10baa8f07e"
Jul 05 13:18:38.735278 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:38.735200    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlllr" podUID="65ca969d-9b3d-4379-a220-fff11397bef6"
Jul 05 13:18:39.734926 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:39.734888    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:39.735377 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:39.735012    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4s6n" podUID="dd27dfce-3c13-4d05-a19b-dcb32e9af21c"
Jul 05 13:18:39.951875 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:39.951436    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-22.ec2.internal" event={"ID":"700cc51e5868b85faed88c518f5936e2","Type":"ContainerStarted","Data":"1ddd75c36a53ec0b46d75476d871518a969d9d4b06a98d7654cf844d9c79fc93"}
Jul 05 13:18:39.955561 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:39.955463    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xj7gc_6c7ce124-8975-400e-9f0b-2527ee19af46/ovn-acl-logging/0.log"
Jul 05 13:18:39.959988 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:39.959381    2565 generic.go:356] "Generic (PLEG): container finished" podID="6c7ce124-8975-400e-9f0b-2527ee19af46" containerID="f4292de044359cd81c416341f7e16c925d89f141607485665b81661eb229da08" exitCode=1
Jul 05 13:18:39.959988 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:39.959498    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc" event={"ID":"6c7ce124-8975-400e-9f0b-2527ee19af46","Type":"ContainerDied","Data":"f4292de044359cd81c416341f7e16c925d89f141607485665b81661eb229da08"}
Jul 05 13:18:39.959988 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:39.959588    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc" event={"ID":"6c7ce124-8975-400e-9f0b-2527ee19af46","Type":"ContainerStarted","Data":"85a9f9291a27fd99ad838ee628316c8060653c8aedab1a1e5a6cc64268997ae5"}
Jul 05 13:18:39.964166 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:39.963264    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kzhs6" event={"ID":"a588119d-ae18-4e26-b843-fb4c25485fa2","Type":"ContainerStarted","Data":"54e830bb64dd7c7580a68eb9eafe123d28e4ff76b0a23ac05ba20c545c77f1b4"}
Jul 05 13:18:39.966320 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:39.966288    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k2hfx" event={"ID":"5ef484b2-c6d9-4acf-be33-df3384cff76d","Type":"ContainerStarted","Data":"2513f3298fd9fe6be7b5a9d89081d96171c7087c6f872057901a96b7108371a5"}
Jul 05 13:18:39.968861 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:39.968803    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-22.ec2.internal" podStartSLOduration=21.968783233 podStartE2EDuration="21.968783233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:39.967858935 +0000 UTC m=+22.785826896" watchObservedRunningTime="2026-07-05 13:18:39.968783233 +0000 UTC m=+22.786751192"
Jul 05 13:18:39.985871 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:39.985823    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k2hfx" podStartSLOduration=2.825446061 podStartE2EDuration="22.985808088s" totalImagesPullingTime="20.160362027s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:39.985476337 +0000 UTC m=+22.803444310" watchObservedRunningTime="2026-07-05 13:18:39.985808088 +0000 UTC m=+22.803776050"
Jul 05 13:18:40.005374 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:40.005317    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kzhs6" podStartSLOduration=2.881125183 podStartE2EDuration="23.005296499s" totalImagesPullingTime="20.124171316s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:40.004939194 +0000 UTC m=+22.822907150" watchObservedRunningTime="2026-07-05 13:18:40.005296499 +0000 UTC m=+22.823264457"
Jul 05 13:18:40.734887 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:40.734808    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:40.735057 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:40.734809    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:40.735057 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:40.734928    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnb8k" podUID="17185f72-eafe-4930-8fcb-1d10baa8f07e"
Jul 05 13:18:40.735057 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:40.735013    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlllr" podUID="65ca969d-9b3d-4379-a220-fff11397bef6"
Jul 05 13:18:40.970094 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:40.969847    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pd57v" event={"ID":"aaf57f1c-cee2-4539-88fc-d004dbfb7366","Type":"ContainerStarted","Data":"7d99740794e2e7762c6b54e1834ce50eb5cc7dedbb9c96f481a117412f2b0ef9"}
Jul 05 13:18:40.971315 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:40.971287    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rgn5q" event={"ID":"8b968b72-7bc0-4186-aa14-7405cf541b16","Type":"ContainerStarted","Data":"8225f9ae2fb8afbbee5d409c4eec286996e9926019f32c7cd6f9239176c4d013"}
Jul 05 13:18:40.972597 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:40.972572    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nltvs" event={"ID":"2c02645e-d3d4-4f5e-824f-c629da35133b","Type":"ContainerStarted","Data":"0f2de37e710a6d3b336e52c1a386091bb8e14322a6458e9b7e921b66e717a52b"}
Jul 05 13:18:40.974257 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:40.974228    2565 generic.go:356] "Generic (PLEG): container finished" podID="ed53678c-46fe-4967-b74f-c12eb3b0e626" containerID="a27ddbf2365c060cab40924b5da390f75ff3c7991d58523a8ec1a79d6ef9de08" exitCode=0
Jul 05 13:18:40.974382 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:40.974302    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2lbp" event={"ID":"ed53678c-46fe-4967-b74f-c12eb3b0e626","Type":"ContainerDied","Data":"a27ddbf2365c060cab40924b5da390f75ff3c7991d58523a8ec1a79d6ef9de08"}
Jul 05 13:18:40.975827 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:40.975800    2565 generic.go:356] "Generic (PLEG): container finished" podID="d60fe1be8856ccb927069ef5697d039f" containerID="02247b5f484df4b60cf1ee33a5e6066c230e06b1e69c4efd320e92a071770de0" exitCode=0
Jul 05 13:18:40.975932 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:40.975879    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-22.ec2.internal" event={"ID":"d60fe1be8856ccb927069ef5697d039f","Type":"ContainerDied","Data":"02247b5f484df4b60cf1ee33a5e6066c230e06b1e69c4efd320e92a071770de0"}
Jul 05 13:18:40.980895 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:40.980874    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xj7gc_6c7ce124-8975-400e-9f0b-2527ee19af46/ovn-acl-logging/0.log"
Jul 05 13:18:40.981361 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:40.981333    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc" event={"ID":"6c7ce124-8975-400e-9f0b-2527ee19af46","Type":"ContainerStarted","Data":"4a8490f919f40609cd0bd4b8d5a125998c913f151c95f870ec7932e36501d526"}
Jul 05 13:18:40.981453 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:40.981401    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc" event={"ID":"6c7ce124-8975-400e-9f0b-2527ee19af46","Type":"ContainerStarted","Data":"2d9ec755d3b63d79f64d79d9bc2b31bed611b4dc186df0e4208a3958a1a7310d"}
Jul 05 13:18:40.981453 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:40.981439    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc" event={"ID":"6c7ce124-8975-400e-9f0b-2527ee19af46","Type":"ContainerStarted","Data":"f6d1aa4ee26a51ff0cd04cc572e7ba8b20aadcb0888f170e333e413b51ce3ecf"}
Jul 05 13:18:40.981547 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:40.981469    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc" event={"ID":"6c7ce124-8975-400e-9f0b-2527ee19af46","Type":"ContainerStarted","Data":"b819314896e5c80c1a71acab4430819f5de24a0bce523aa94c11236349deb431"}
Jul 05 13:18:40.982642 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:40.982604    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zgshx" event={"ID":"2ffb49d9-ee88-454b-8b27-05a4274ef55f","Type":"ContainerStarted","Data":"de9313cdcda8f1d4e98fc545bafb116281028389fdb3c2bcd835fd0b475d33cd"}
Jul 05 13:18:40.983887 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:40.983859    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff" event={"ID":"416aff4f-940f-44b6-8cf2-8d6e1a030c14","Type":"ContainerStarted","Data":"cd40ee3e399ec818bc4039bf478c4e257b4818fb249b685e5877d3bf5a3e6f17"}
Jul 05 13:18:40.984625 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:40.984588    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pd57v" podStartSLOduration=8.774183431 podStartE2EDuration="23.984576316s" totalImagesPullingTime="15.210392885s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:40.984187978 +0000 UTC m=+23.802155958" watchObservedRunningTime="2026-07-05 13:18:40.984576316 +0000 UTC m=+23.802544272"
Jul 05 13:18:41.022344 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:41.022286    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zgshx" podStartSLOduration=4.096039355 podStartE2EDuration="24.022268962s" totalImagesPullingTime="19.926229607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:41.022268239 +0000 UTC m=+23.840236222" watchObservedRunningTime="2026-07-05 13:18:41.022268962 +0000 UTC m=+23.840236918"
Jul 05 13:18:41.040142 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:41.039851    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nltvs" podStartSLOduration=4.074100692 podStartE2EDuration="24.039829391s" totalImagesPullingTime="19.965728699s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:41.039803118 +0000 UTC m=+23.857771100" watchObservedRunningTime="2026-07-05 13:18:41.039829391 +0000 UTC m=+23.857797347"
Jul 05 13:18:41.057546 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:41.057491    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rgn5q" podStartSLOduration=4.14549289 podStartE2EDuration="24.057473404s" totalImagesPullingTime="19.911980514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:41.057148696 +0000 UTC m=+23.875116683" watchObservedRunningTime="2026-07-05 13:18:41.057473404 +0000 UTC m=+23.875441373"
Jul 05 13:18:41.735408 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:41.735369    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:41.735886 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:41.735493    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4s6n" podUID="dd27dfce-3c13-4d05-a19b-dcb32e9af21c"
Jul 05 13:18:41.817517 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:41.817309    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 05 13:18:41.989051 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:41.988964    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff" event={"ID":"416aff4f-940f-44b6-8cf2-8d6e1a030c14","Type":"ContainerStarted","Data":"53e62e05170eeb979686d0c845ef88891824518e0b7c3edefbab8ce552bf85fe"}
Jul 05 13:18:41.990933 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:41.990869    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-22.ec2.internal" event={"ID":"d60fe1be8856ccb927069ef5697d039f","Type":"ContainerStarted","Data":"2e2e2061b27a0c5445e6e8079028a3b2069a10fea08aa97451ebaf70b11f274f"}
Jul 05 13:18:42.008838 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:42.008772    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-22.ec2.internal" podStartSLOduration=24.008751274 podStartE2EDuration="24.008751274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:42.008059044 +0000 UTC m=+24.826027024" watchObservedRunningTime="2026-07-05 13:18:42.008751274 +0000 UTC m=+24.826719250"
Jul 05 13:18:42.667132 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:42.667013    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-05T13:18:41.817327849Z","UUID":"ead01803-b2d6-41c9-870e-a61b69469b4e","Handler":null,"Name":"","Endpoint":""}
Jul 05 13:18:42.668612 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:42.668587    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 05 13:18:42.668797 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:42.668647    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 05 13:18:42.735408 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:42.735322    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:42.735665 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:42.735462    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnb8k" podUID="17185f72-eafe-4930-8fcb-1d10baa8f07e"
Jul 05 13:18:42.736157 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:42.735850    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:42.736157 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:42.735941    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlllr" podUID="65ca969d-9b3d-4379-a220-fff11397bef6"
Jul 05 13:18:42.997275 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:42.997203    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xj7gc_6c7ce124-8975-400e-9f0b-2527ee19af46/ovn-acl-logging/0.log"
Jul 05 13:18:42.997681 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:42.997651    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc" event={"ID":"6c7ce124-8975-400e-9f0b-2527ee19af46","Type":"ContainerStarted","Data":"d343527e516d0cd87c648679a0c2a5fc0fadfc52f2cb92736620f8363a01b531"}
Jul 05 13:18:43.735724 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:43.735686    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:43.736272 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:43.735827    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4s6n" podUID="dd27dfce-3c13-4d05-a19b-dcb32e9af21c"
Jul 05 13:18:44.002811 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:44.002715    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff" event={"ID":"416aff4f-940f-44b6-8cf2-8d6e1a030c14","Type":"ContainerStarted","Data":"87b44e67d9de327b3c4307499adbc2e13cf4b4bb40a0eba6c63c514e900740ab"}
Jul 05 13:18:44.026595 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:44.025919    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpsff" podStartSLOduration=4.013316085 podStartE2EDuration="26.025897806s" totalImagesPullingTime="22.012581721s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:44.025313872 +0000 UTC m=+26.843281852" watchObservedRunningTime="2026-07-05 13:18:44.025897806 +0000 UTC m=+26.843865764"
Jul 05 13:18:44.735110 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:44.735070    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:44.735301 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:44.735203    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnb8k" podUID="17185f72-eafe-4930-8fcb-1d10baa8f07e"
Jul 05 13:18:44.735301 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:44.735253    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:44.735418 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:44.735378    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlllr" podUID="65ca969d-9b3d-4379-a220-fff11397bef6"
Jul 05 13:18:45.565866 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:45.565690    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zgshx"
Jul 05 13:18:45.566850 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:45.566827    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zgshx"
Jul 05 13:18:45.735593 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:45.735559    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:45.735737 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:45.735692    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4s6n" podUID="dd27dfce-3c13-4d05-a19b-dcb32e9af21c"
Jul 05 13:18:46.010207 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:46.010133    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xj7gc_6c7ce124-8975-400e-9f0b-2527ee19af46/ovn-acl-logging/0.log"
Jul 05 13:18:46.010543 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:46.010520    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc" event={"ID":"6c7ce124-8975-400e-9f0b-2527ee19af46","Type":"ContainerStarted","Data":"bdb51ee7467fd3ff213b4f4ea9a4eccaacaec7fcb23d69ed7f7fa49d7cd8e5c6"}
Jul 05 13:18:46.010838 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:46.010822    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:46.010993 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:46.010980    2565 scope.go:117] "RemoveContainer" containerID="f4292de044359cd81c416341f7e16c925d89f141607485665b81661eb229da08"
Jul 05 13:18:46.012366 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:46.012342    2565 generic.go:356] "Generic (PLEG): container finished" podID="ed53678c-46fe-4967-b74f-c12eb3b0e626" containerID="b8bf80f125edea61cd9bc44bfa908f0a622088707b985f9211ca01797e7a09ba" exitCode=0
Jul 05 13:18:46.012472 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:46.012403    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2lbp" event={"ID":"ed53678c-46fe-4967-b74f-c12eb3b0e626","Type":"ContainerDied","Data":"b8bf80f125edea61cd9bc44bfa908f0a622088707b985f9211ca01797e7a09ba"}
Jul 05 13:18:46.012530 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:46.012491    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zgshx"
Jul 05 13:18:46.013470 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:46.013304    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zgshx"
Jul 05 13:18:46.028079 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:46.028058    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:46.736222 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:46.735554    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:46.736222 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:46.735703    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlllr" podUID="65ca969d-9b3d-4379-a220-fff11397bef6"
Jul 05 13:18:46.736222 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:46.736128    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:46.736973 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:46.736235    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnb8k" podUID="17185f72-eafe-4930-8fcb-1d10baa8f07e"
Jul 05 13:18:47.018284 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:47.018216    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xj7gc_6c7ce124-8975-400e-9f0b-2527ee19af46/ovn-acl-logging/0.log"
Jul 05 13:18:47.018586 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:47.018563    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc" event={"ID":"6c7ce124-8975-400e-9f0b-2527ee19af46","Type":"ContainerStarted","Data":"b748948e8c57961385ff25166e01ed2cb6a64adda24024becb0b8bb0f456f29c"}
Jul 05 13:18:47.018895 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:47.018869    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:47.019023 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:47.018944    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:47.033985 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:47.033955    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:18:47.110573 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:47.110524    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc" podStartSLOduration=9.701635652 podStartE2EDuration="30.110508338s" totalImagesPullingTime="20.408872686s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:47.071296475 +0000 UTC m=+29.889264452" watchObservedRunningTime="2026-07-05 13:18:47.110508338 +0000 UTC m=+29.928476294"
Jul 05 13:18:47.523640 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:47.523544    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rlllr"]
Jul 05 13:18:47.523803 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:47.523671    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:47.523803 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:47.523767    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlllr" podUID="65ca969d-9b3d-4379-a220-fff11397bef6"
Jul 05 13:18:47.526881 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:47.526816    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nnb8k"]
Jul 05 13:18:47.527063 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:47.526958    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:47.527121 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:47.527074    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnb8k" podUID="17185f72-eafe-4930-8fcb-1d10baa8f07e"
Jul 05 13:18:47.527501 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:47.527479    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t4s6n"]
Jul 05 13:18:47.527611 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:47.527581    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:47.527714 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:47.527691    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4s6n" podUID="dd27dfce-3c13-4d05-a19b-dcb32e9af21c"
Jul 05 13:18:48.022418 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:48.022380    2565 generic.go:356] "Generic (PLEG): container finished" podID="ed53678c-46fe-4967-b74f-c12eb3b0e626" containerID="8e4be6059d2e1f849ca861cac35d72ac151f9197823c22f4de529995b3fed37a" exitCode=0
Jul 05 13:18:48.022939 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:48.022469    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2lbp" event={"ID":"ed53678c-46fe-4967-b74f-c12eb3b0e626","Type":"ContainerDied","Data":"8e4be6059d2e1f849ca861cac35d72ac151f9197823c22f4de529995b3fed37a"}
Jul 05 13:18:48.734728 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:48.734690    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:48.734888 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:48.734804    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlllr" podUID="65ca969d-9b3d-4379-a220-fff11397bef6"
Jul 05 13:18:49.735415 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:49.735234    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:49.735870 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:49.735234    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:49.735870 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:49.735497    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4s6n" podUID="dd27dfce-3c13-4d05-a19b-dcb32e9af21c"
Jul 05 13:18:49.735870 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:49.735586    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnb8k" podUID="17185f72-eafe-4930-8fcb-1d10baa8f07e"
Jul 05 13:18:50.030400 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:50.030359    2565 generic.go:356] "Generic (PLEG): container finished" podID="ed53678c-46fe-4967-b74f-c12eb3b0e626" containerID="02e1b75021ed11f5f068aec4b8eba3178018ace36fd7bf0e2abf45845add7eb8" exitCode=0
Jul 05 13:18:50.030400 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:50.030400    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2lbp" event={"ID":"ed53678c-46fe-4967-b74f-c12eb3b0e626","Type":"ContainerDied","Data":"02e1b75021ed11f5f068aec4b8eba3178018ace36fd7bf0e2abf45845add7eb8"}
Jul 05 13:18:50.412511 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:50.412460    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret\") pod \"global-pull-secret-syncer-t4s6n\" (UID: \"dd27dfce-3c13-4d05-a19b-dcb32e9af21c\") " pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:50.412511 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:50.412510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs\") pod \"network-metrics-daemon-rlllr\" (UID: \"65ca969d-9b3d-4379-a220-fff11397bef6\") " pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:50.412798 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:50.412530    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkwjk\" (UniqueName: \"kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk\") pod \"network-check-target-nnb8k\" (UID: \"17185f72-eafe-4930-8fcb-1d10baa8f07e\") " pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:50.412798 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:50.412622    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:18:50.412798 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:50.412627    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 05 13:18:50.412798 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:50.412682    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 05 13:18:50.412798 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:50.412691    2565 projected.go:196] Error preparing data for projected volume kube-api-access-wkwjk for pod openshift-network-diagnostics/network-check-target-nnb8k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:18:50.412798 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:50.412622    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 05 13:18:50.412798 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:50.412719    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs podName:65ca969d-9b3d-4379-a220-fff11397bef6 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:22.412702732 +0000 UTC m=+65.230670666 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs") pod "network-metrics-daemon-rlllr" (UID: "65ca969d-9b3d-4379-a220-fff11397bef6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 05 13:18:50.412798 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:50.412735    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk podName:17185f72-eafe-4930-8fcb-1d10baa8f07e nodeName:}" failed. No retries permitted until 2026-07-05 13:19:22.412728403 +0000 UTC m=+65.230696338 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wkwjk" (UniqueName: "kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk") pod "network-check-target-nnb8k" (UID: "17185f72-eafe-4930-8fcb-1d10baa8f07e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 05 13:18:50.412798 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:50.412746    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret podName:dd27dfce-3c13-4d05-a19b-dcb32e9af21c nodeName:}" failed. No retries permitted until 2026-07-05 13:19:22.412741061 +0000 UTC m=+65.230708996 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret") pod "global-pull-secret-syncer-t4s6n" (UID: "dd27dfce-3c13-4d05-a19b-dcb32e9af21c") : object "kube-system"/"original-pull-secret" not registered
Jul 05 13:18:50.735346 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:50.735264    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:50.735579 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:50.735384    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlllr" podUID="65ca969d-9b3d-4379-a220-fff11397bef6"
Jul 05 13:18:51.734912 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:51.734879    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:51.734912 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:51.734900    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:51.735109 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:51.735019    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t4s6n" podUID="dd27dfce-3c13-4d05-a19b-dcb32e9af21c"
Jul 05 13:18:51.735155 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:51.735138    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nnb8k" podUID="17185f72-eafe-4930-8fcb-1d10baa8f07e"
Jul 05 13:18:52.455081 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.454998    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-22.ec2.internal" event="NodeReady"
Jul 05 13:18:52.455496 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.455120    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 05 13:18:52.499917 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.499878    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2hswj"]
Jul 05 13:18:52.502427 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.502398    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2hswj"
Jul 05 13:18:52.503453 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.503430    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d28zj"]
Jul 05 13:18:52.504942 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.504918    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zq4hl\""
Jul 05 13:18:52.505302 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.505279    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d28zj"
Jul 05 13:18:52.505544 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.505409    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 05 13:18:52.505544 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.505454    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 05 13:18:52.505544 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.505468    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 05 13:18:52.507493 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.507474    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 05 13:18:52.507742 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.507727    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 05 13:18:52.507954 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.507938    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t7gnk\""
Jul 05 13:18:52.512180 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.512157    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2hswj"]
Jul 05 13:18:52.527274 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.527246    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d28zj"]
Jul 05 13:18:52.628990 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.628948    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-tmp-dir\") pod \"dns-default-d28zj\" (UID: \"35b816f6-4b8c-4df8-b0f1-d51fc39569f5\") " pod="openshift-dns/dns-default-d28zj"
Jul 05 13:18:52.628990 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.628996    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d43b236-bef2-4929-a053-d0b32a29301a-cert\") pod \"ingress-canary-2hswj\" (UID: \"6d43b236-bef2-4929-a053-d0b32a29301a\") " pod="openshift-ingress-canary/ingress-canary-2hswj"
Jul 05 13:18:52.629242 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.629028    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls\") pod \"dns-default-d28zj\" (UID: \"35b816f6-4b8c-4df8-b0f1-d51fc39569f5\") " pod="openshift-dns/dns-default-d28zj"
Jul 05 13:18:52.629242 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.629062    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-config-volume\") pod \"dns-default-d28zj\" (UID: \"35b816f6-4b8c-4df8-b0f1-d51fc39569f5\") " pod="openshift-dns/dns-default-d28zj"
Jul 05 13:18:52.629242 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.629107    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkqwf\" (UniqueName: \"kubernetes.io/projected/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-kube-api-access-wkqwf\") pod \"dns-default-d28zj\" (UID: \"35b816f6-4b8c-4df8-b0f1-d51fc39569f5\") " pod="openshift-dns/dns-default-d28zj"
Jul 05 13:18:52.629242 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.629166    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5l5f\" (UniqueName: \"kubernetes.io/projected/6d43b236-bef2-4929-a053-d0b32a29301a-kube-api-access-q5l5f\") pod \"ingress-canary-2hswj\" (UID: \"6d43b236-bef2-4929-a053-d0b32a29301a\") " pod="openshift-ingress-canary/ingress-canary-2hswj"
Jul 05 13:18:52.730512 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.730424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkqwf\" (UniqueName: \"kubernetes.io/projected/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-kube-api-access-wkqwf\") pod \"dns-default-d28zj\" (UID: \"35b816f6-4b8c-4df8-b0f1-d51fc39569f5\") " pod="openshift-dns/dns-default-d28zj"
Jul 05 13:18:52.730512 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.730497    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5l5f\" (UniqueName: \"kubernetes.io/projected/6d43b236-bef2-4929-a053-d0b32a29301a-kube-api-access-q5l5f\") pod \"ingress-canary-2hswj\" (UID: \"6d43b236-bef2-4929-a053-d0b32a29301a\") " pod="openshift-ingress-canary/ingress-canary-2hswj"
Jul 05 13:18:52.730776 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.730532    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-tmp-dir\") pod \"dns-default-d28zj\" (UID: \"35b816f6-4b8c-4df8-b0f1-d51fc39569f5\") " pod="openshift-dns/dns-default-d28zj"
Jul 05 13:18:52.730776 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.730557    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d43b236-bef2-4929-a053-d0b32a29301a-cert\") pod \"ingress-canary-2hswj\" (UID: \"6d43b236-bef2-4929-a053-d0b32a29301a\") " pod="openshift-ingress-canary/ingress-canary-2hswj"
Jul 05 13:18:52.730776 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.730582    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls\") pod \"dns-default-d28zj\" (UID: \"35b816f6-4b8c-4df8-b0f1-d51fc39569f5\") " pod="openshift-dns/dns-default-d28zj"
Jul 05 13:18:52.730776 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.730616    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-config-volume\") pod \"dns-default-d28zj\" (UID: \"35b816f6-4b8c-4df8-b0f1-d51fc39569f5\") " pod="openshift-dns/dns-default-d28zj"
Jul 05 13:18:52.730776 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:52.730757    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:18:52.731006 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:52.730824    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls podName:35b816f6-4b8c-4df8-b0f1-d51fc39569f5 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:53.230803955 +0000 UTC m=+36.048771894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls") pod "dns-default-d28zj" (UID: "35b816f6-4b8c-4df8-b0f1-d51fc39569f5") : secret "dns-default-metrics-tls" not found
Jul 05 13:18:52.731006 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.730942    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-tmp-dir\") pod \"dns-default-d28zj\" (UID: \"35b816f6-4b8c-4df8-b0f1-d51fc39569f5\") " pod="openshift-dns/dns-default-d28zj"
Jul 05 13:18:52.731334 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.731308    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-config-volume\") pod \"dns-default-d28zj\" (UID: \"35b816f6-4b8c-4df8-b0f1-d51fc39569f5\") " pod="openshift-dns/dns-default-d28zj"
Jul 05 13:18:52.735184 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.735156    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:18:52.736250 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.736225    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d43b236-bef2-4929-a053-d0b32a29301a-cert\") pod \"ingress-canary-2hswj\" (UID: \"6d43b236-bef2-4929-a053-d0b32a29301a\") " pod="openshift-ingress-canary/ingress-canary-2hswj"
Jul 05 13:18:52.737799 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.737761    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 05 13:18:52.737920 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.737821    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sq7qg\""
Jul 05 13:18:52.740677 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.740608    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkqwf\" (UniqueName: \"kubernetes.io/projected/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-kube-api-access-wkqwf\") pod \"dns-default-d28zj\" (UID: \"35b816f6-4b8c-4df8-b0f1-d51fc39569f5\") " pod="openshift-dns/dns-default-d28zj"
Jul 05 13:18:52.740852 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.740832    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5l5f\" (UniqueName: \"kubernetes.io/projected/6d43b236-bef2-4929-a053-d0b32a29301a-kube-api-access-q5l5f\") pod \"ingress-canary-2hswj\" (UID: \"6d43b236-bef2-4929-a053-d0b32a29301a\") " pod="openshift-ingress-canary/ingress-canary-2hswj"
Jul 05 13:18:52.815938 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:52.815897    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2hswj"
Jul 05 13:18:53.234502 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:53.234467    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls\") pod \"dns-default-d28zj\" (UID: \"35b816f6-4b8c-4df8-b0f1-d51fc39569f5\") " pod="openshift-dns/dns-default-d28zj"
Jul 05 13:18:53.234728 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:53.234587    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:18:53.234728 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:53.234681    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls podName:35b816f6-4b8c-4df8-b0f1-d51fc39569f5 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:54.234660522 +0000 UTC m=+37.052628459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls") pod "dns-default-d28zj" (UID: "35b816f6-4b8c-4df8-b0f1-d51fc39569f5") : secret "dns-default-metrics-tls" not found
Jul 05 13:18:53.735082 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:53.735044    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:18:53.735898 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:53.735236    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:18:53.738056 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:53.738027    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 05 13:18:53.739080 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:53.739058    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z2lc5\""
Jul 05 13:18:53.739080 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:53.739058    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 05 13:18:53.739242 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:53.739065    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 05 13:18:54.090566 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:54.090528    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2hswj"]
Jul 05 13:18:54.094852 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:18:54.094824    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d43b236_bef2_4929_a053_d0b32a29301a.slice/crio-38480d9aafd5aa1b08786002d96d634db3534f513094effe4850ac78e7b472c0 WatchSource:0}: Error finding container 38480d9aafd5aa1b08786002d96d634db3534f513094effe4850ac78e7b472c0: Status 404 returned error can't find the container with id 38480d9aafd5aa1b08786002d96d634db3534f513094effe4850ac78e7b472c0
Jul 05 13:18:54.242075 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:54.241966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls\") pod \"dns-default-d28zj\" (UID: \"35b816f6-4b8c-4df8-b0f1-d51fc39569f5\") " pod="openshift-dns/dns-default-d28zj"
Jul 05 13:18:54.242199 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:54.242079    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:18:54.242199 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:54.242132    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls podName:35b816f6-4b8c-4df8-b0f1-d51fc39569f5 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:56.242118873 +0000 UTC m=+39.060086808 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls") pod "dns-default-d28zj" (UID: "35b816f6-4b8c-4df8-b0f1-d51fc39569f5") : secret "dns-default-metrics-tls" not found
Jul 05 13:18:55.047597 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:55.047562    2565 generic.go:356] "Generic (PLEG): container finished" podID="ed53678c-46fe-4967-b74f-c12eb3b0e626" containerID="30933f3c629ba97fff30ed3c99a0c2c72f24f25b608f9b4fb12e1b4f4acf4d2f" exitCode=0
Jul 05 13:18:55.048222 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:55.047668    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2lbp" event={"ID":"ed53678c-46fe-4967-b74f-c12eb3b0e626","Type":"ContainerDied","Data":"30933f3c629ba97fff30ed3c99a0c2c72f24f25b608f9b4fb12e1b4f4acf4d2f"}
Jul 05 13:18:55.049270 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:55.049234    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2hswj" event={"ID":"6d43b236-bef2-4929-a053-d0b32a29301a","Type":"ContainerStarted","Data":"38480d9aafd5aa1b08786002d96d634db3534f513094effe4850ac78e7b472c0"}
Jul 05 13:18:56.056057 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:56.056023    2565 generic.go:356] "Generic (PLEG): container finished" podID="ed53678c-46fe-4967-b74f-c12eb3b0e626" containerID="7b775c8562566c4c7f165787fc5937d6c8804c78261c0c2791dc203874958bc3" exitCode=0
Jul 05 13:18:56.056612 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:56.056090    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2lbp" event={"ID":"ed53678c-46fe-4967-b74f-c12eb3b0e626","Type":"ContainerDied","Data":"7b775c8562566c4c7f165787fc5937d6c8804c78261c0c2791dc203874958bc3"}
Jul 05 13:18:56.257506 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:56.257469    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls\") pod \"dns-default-d28zj\" (UID: \"35b816f6-4b8c-4df8-b0f1-d51fc39569f5\") " pod="openshift-dns/dns-default-d28zj"
Jul 05 13:18:56.257708 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:56.257665    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:18:56.257769 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:18:56.257745    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls podName:35b816f6-4b8c-4df8-b0f1-d51fc39569f5 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:00.257721416 +0000 UTC m=+43.075689362 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls") pod "dns-default-d28zj" (UID: "35b816f6-4b8c-4df8-b0f1-d51fc39569f5") : secret "dns-default-metrics-tls" not found
Jul 05 13:18:57.063262 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:57.062979    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b2lbp" event={"ID":"ed53678c-46fe-4967-b74f-c12eb3b0e626","Type":"ContainerStarted","Data":"f9db2fc6dff5e38dc1edea66fc3bfc3f5b5fa4b844abfb4d8aa00b865b87cdb8"}
Jul 05 13:18:57.064580 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:57.064554    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2hswj" event={"ID":"6d43b236-bef2-4929-a053-d0b32a29301a","Type":"ContainerStarted","Data":"79e6e60e91a2ed1d41587d2bf5dfc9b76a28d62223df6e428bc64e2ca0329c03"}
Jul 05 13:18:57.095978 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:57.095423    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b2lbp" podStartSLOduration=9.282440213 podStartE2EDuration="40.095402579s" totalImagesPullingTime="30.812962366s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:57.095029168 +0000 UTC m=+39.912997159" watchObservedRunningTime="2026-07-05 13:18:57.095402579 +0000 UTC m=+39.913370537"
Jul 05 13:18:57.121127 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:18:57.120952    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2hswj" podStartSLOduration=2.54141353 podStartE2EDuration="5.120930348s" totalImagesPullingTime="2.579516818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:18:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:57.119053432 +0000 UTC m=+39.937021404" watchObservedRunningTime="2026-07-05 13:18:57.120930348 +0000 UTC m=+39.938898316"
Jul 05 13:19:00.288264 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:00.288217    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls\") pod \"dns-default-d28zj\" (UID: \"35b816f6-4b8c-4df8-b0f1-d51fc39569f5\") " pod="openshift-dns/dns-default-d28zj"
Jul 05 13:19:00.288654 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:00.288337    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:19:00.288654 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:00.288389    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls podName:35b816f6-4b8c-4df8-b0f1-d51fc39569f5 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:08.288375875 +0000 UTC m=+51.106343810 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls") pod "dns-default-d28zj" (UID: "35b816f6-4b8c-4df8-b0f1-d51fc39569f5") : secret "dns-default-metrics-tls" not found
Jul 05 13:19:08.346874 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:08.346820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls\") pod \"dns-default-d28zj\" (UID: \"35b816f6-4b8c-4df8-b0f1-d51fc39569f5\") " pod="openshift-dns/dns-default-d28zj"
Jul 05 13:19:08.347368 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:08.346983    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:19:08.347368 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:08.347049    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls podName:35b816f6-4b8c-4df8-b0f1-d51fc39569f5 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:24.347032553 +0000 UTC m=+67.165000491 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls") pod "dns-default-d28zj" (UID: "35b816f6-4b8c-4df8-b0f1-d51fc39569f5") : secret "dns-default-metrics-tls" not found
Jul 05 13:19:16.597889 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.597855    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xxj2g"]
Jul 05 13:19:16.600335 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.600317    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xxj2g"
Jul 05 13:19:16.602811 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.602782    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 05 13:19:16.602946 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.602834    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 05 13:19:16.602946 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.602839    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 05 13:19:16.603824 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.603802    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vmbcd\""
Jul 05 13:19:16.603824 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.603822    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 05 13:19:16.611361 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.611333    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xxj2g"]
Jul 05 13:19:16.705237 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.705194    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl7jq\" (UniqueName: \"kubernetes.io/projected/6b02bb25-5475-4e7d-b02f-d89a084096cb-kube-api-access-sl7jq\") pod \"kube-storage-version-migrator-operator-846bf668f7-xxj2g\" (UID: \"6b02bb25-5475-4e7d-b02f-d89a084096cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xxj2g"
Jul 05 13:19:16.705415 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.705263    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b02bb25-5475-4e7d-b02f-d89a084096cb-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-xxj2g\" (UID: \"6b02bb25-5475-4e7d-b02f-d89a084096cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xxj2g"
Jul 05 13:19:16.705415 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.705365    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6b02bb25-5475-4e7d-b02f-d89a084096cb-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-xxj2g\" (UID: \"6b02bb25-5475-4e7d-b02f-d89a084096cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xxj2g"
Jul 05 13:19:16.713519 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.713491    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj"]
Jul 05 13:19:16.715483 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.715461    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj"
Jul 05 13:19:16.719230 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.719203    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 05 13:19:16.719355 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.719250    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hnkwv\""
Jul 05 13:19:16.719355 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.719205    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 05 13:19:16.719355 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.719210    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 05 13:19:16.719355 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.719208    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 05 13:19:16.726709 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.726684    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj"]
Jul 05 13:19:16.806295 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.806244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b02bb25-5475-4e7d-b02f-d89a084096cb-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-xxj2g\" (UID: \"6b02bb25-5475-4e7d-b02f-d89a084096cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xxj2g"
Jul 05 13:19:16.806295 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.806299    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4f2b028a-938b-4fca-80a7-047076e70861-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-ftkpj\" (UID: \"4f2b028a-938b-4fca-80a7-047076e70861\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj"
Jul 05 13:19:16.806545 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.806356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6b02bb25-5475-4e7d-b02f-d89a084096cb-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-xxj2g\" (UID: \"6b02bb25-5475-4e7d-b02f-d89a084096cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xxj2g"
Jul 05 13:19:16.806545 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.806389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px6qz\" (UniqueName: \"kubernetes.io/projected/4f2b028a-938b-4fca-80a7-047076e70861-kube-api-access-px6qz\") pod \"cluster-monitoring-operator-64786d9cbb-ftkpj\" (UID: \"4f2b028a-938b-4fca-80a7-047076e70861\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj"
Jul 05 13:19:16.806545 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.806464    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl7jq\" (UniqueName: \"kubernetes.io/projected/6b02bb25-5475-4e7d-b02f-d89a084096cb-kube-api-access-sl7jq\") pod \"kube-storage-version-migrator-operator-846bf668f7-xxj2g\" (UID: \"6b02bb25-5475-4e7d-b02f-d89a084096cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xxj2g"
Jul 05 13:19:16.806545 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.806535    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f2b028a-938b-4fca-80a7-047076e70861-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ftkpj\" (UID: \"4f2b028a-938b-4fca-80a7-047076e70861\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj"
Jul 05 13:19:16.807075 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.807051    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6b02bb25-5475-4e7d-b02f-d89a084096cb-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-xxj2g\" (UID: \"6b02bb25-5475-4e7d-b02f-d89a084096cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xxj2g"
Jul 05 13:19:16.810382 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.810359    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b02bb25-5475-4e7d-b02f-d89a084096cb-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-xxj2g\" (UID: \"6b02bb25-5475-4e7d-b02f-d89a084096cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xxj2g"
Jul 05 13:19:16.823249 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.823213    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl7jq\" (UniqueName: \"kubernetes.io/projected/6b02bb25-5475-4e7d-b02f-d89a084096cb-kube-api-access-sl7jq\") pod \"kube-storage-version-migrator-operator-846bf668f7-xxj2g\" (UID: \"6b02bb25-5475-4e7d-b02f-d89a084096cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xxj2g"
Jul 05 13:19:16.834790 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.834754    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-b99jf"]
Jul 05 13:19:16.837144 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.837122    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bb8874f4b-crpk2"]
Jul 05 13:19:16.837284 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.837269    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-b99jf"
Jul 05 13:19:16.838891 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.838869    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:16.840464 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.840446    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 05 13:19:16.840573 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.840471    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 05 13:19:16.840573 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.840485    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 05 13:19:16.840875 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.840825    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 05 13:19:16.840875 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.840841    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-hfcz8\""
Jul 05 13:19:16.840988 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.840972    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 05 13:19:16.843460 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.843442    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 05 13:19:16.843570 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.843477    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ckkjd\""
Jul 05 13:19:16.843787 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.843771    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 05 13:19:16.847478 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.847456    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 05 13:19:16.850572 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.850515    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 05 13:19:16.865078 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.865026    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bb8874f4b-crpk2"]
Jul 05 13:19:16.865980 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.865951    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-b99jf"]
Jul 05 13:19:16.907283 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.907248    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4f2b028a-938b-4fca-80a7-047076e70861-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-ftkpj\" (UID: \"4f2b028a-938b-4fca-80a7-047076e70861\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj"
Jul 05 13:19:16.907283 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.907282    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98jjh\" (UniqueName: \"kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-kube-api-access-98jjh\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:16.907494 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.907318    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:16.907494 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.907341    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58b76a86-1e5e-48b6-8792-80536cafcb5c-config\") pod \"console-operator-68b757fb67-b99jf\" (UID: \"58b76a86-1e5e-48b6-8792-80536cafcb5c\") " pod="openshift-console-operator/console-operator-68b757fb67-b99jf"
Jul 05 13:19:16.907494 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.907366    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58b76a86-1e5e-48b6-8792-80536cafcb5c-serving-cert\") pod \"console-operator-68b757fb67-b99jf\" (UID: \"58b76a86-1e5e-48b6-8792-80536cafcb5c\") " pod="openshift-console-operator/console-operator-68b757fb67-b99jf"
Jul 05 13:19:16.907494 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.907425    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-bound-sa-token\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:16.907494 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.907448    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54f06856-ccc6-48ef-9c06-340b1a24f963-trusted-ca\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:16.907494 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.907465    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q7jq\" (UniqueName: \"kubernetes.io/projected/58b76a86-1e5e-48b6-8792-80536cafcb5c-kube-api-access-2q7jq\") pod \"console-operator-68b757fb67-b99jf\" (UID: \"58b76a86-1e5e-48b6-8792-80536cafcb5c\") " pod="openshift-console-operator/console-operator-68b757fb67-b99jf"
Jul 05 13:19:16.907494 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.907492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px6qz\" (UniqueName: \"kubernetes.io/projected/4f2b028a-938b-4fca-80a7-047076e70861-kube-api-access-px6qz\") pod \"cluster-monitoring-operator-64786d9cbb-ftkpj\" (UID: \"4f2b028a-938b-4fca-80a7-047076e70861\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj"
Jul 05 13:19:16.907723 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.907508    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54f06856-ccc6-48ef-9c06-340b1a24f963-image-registry-private-configuration\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:16.907723 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.907574    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-certificates\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:16.907723 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.907612    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54f06856-ccc6-48ef-9c06-340b1a24f963-installation-pull-secrets\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:16.907723 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.907650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58b76a86-1e5e-48b6-8792-80536cafcb5c-trusted-ca\") pod \"console-operator-68b757fb67-b99jf\" (UID: \"58b76a86-1e5e-48b6-8792-80536cafcb5c\") " pod="openshift-console-operator/console-operator-68b757fb67-b99jf"
Jul 05 13:19:16.907723 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.907674    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54f06856-ccc6-48ef-9c06-340b1a24f963-ca-trust-extracted\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:16.907875 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.907717    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f2b028a-938b-4fca-80a7-047076e70861-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ftkpj\" (UID: \"4f2b028a-938b-4fca-80a7-047076e70861\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj"
Jul 05 13:19:16.907875 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:16.907811    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 05 13:19:16.907875 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:16.907870    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f2b028a-938b-4fca-80a7-047076e70861-cluster-monitoring-operator-tls podName:4f2b028a-938b-4fca-80a7-047076e70861 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:17.407857842 +0000 UTC m=+60.225825778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f2b028a-938b-4fca-80a7-047076e70861-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-ftkpj" (UID: "4f2b028a-938b-4fca-80a7-047076e70861") : secret "cluster-monitoring-operator-tls" not found
Jul 05 13:19:16.908010 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.907993    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4f2b028a-938b-4fca-80a7-047076e70861-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-ftkpj\" (UID: \"4f2b028a-938b-4fca-80a7-047076e70861\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj"
Jul 05 13:19:16.908614 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.908599    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xxj2g"
Jul 05 13:19:16.919557 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:16.919521    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px6qz\" (UniqueName: \"kubernetes.io/projected/4f2b028a-938b-4fca-80a7-047076e70861-kube-api-access-px6qz\") pod \"cluster-monitoring-operator-64786d9cbb-ftkpj\" (UID: \"4f2b028a-938b-4fca-80a7-047076e70861\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj"
Jul 05 13:19:17.009819 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.009006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54f06856-ccc6-48ef-9c06-340b1a24f963-trusted-ca\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:17.009819 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.009041    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q7jq\" (UniqueName: \"kubernetes.io/projected/58b76a86-1e5e-48b6-8792-80536cafcb5c-kube-api-access-2q7jq\") pod \"console-operator-68b757fb67-b99jf\" (UID: \"58b76a86-1e5e-48b6-8792-80536cafcb5c\") " pod="openshift-console-operator/console-operator-68b757fb67-b99jf"
Jul 05 13:19:17.009819 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.009067    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54f06856-ccc6-48ef-9c06-340b1a24f963-image-registry-private-configuration\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:17.009819 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.009099    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-certificates\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:17.009819 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.009548    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-certificates\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:17.009819 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.009725    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54f06856-ccc6-48ef-9c06-340b1a24f963-installation-pull-secrets\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:17.009819 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.009779    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58b76a86-1e5e-48b6-8792-80536cafcb5c-trusted-ca\") pod \"console-operator-68b757fb67-b99jf\" (UID: \"58b76a86-1e5e-48b6-8792-80536cafcb5c\") " pod="openshift-console-operator/console-operator-68b757fb67-b99jf"
Jul 05 13:19:17.009819 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.009813    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54f06856-ccc6-48ef-9c06-340b1a24f963-ca-trust-extracted\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:17.010342 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.009904    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98jjh\" (UniqueName: \"kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-kube-api-access-98jjh\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:17.010342 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.009955    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:17.010342 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.009980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58b76a86-1e5e-48b6-8792-80536cafcb5c-config\") pod \"console-operator-68b757fb67-b99jf\" (UID: \"58b76a86-1e5e-48b6-8792-80536cafcb5c\") " pod="openshift-console-operator/console-operator-68b757fb67-b99jf"
Jul 05 13:19:17.010342 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.010003    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58b76a86-1e5e-48b6-8792-80536cafcb5c-serving-cert\") pod \"console-operator-68b757fb67-b99jf\" (UID: \"58b76a86-1e5e-48b6-8792-80536cafcb5c\") " pod="openshift-console-operator/console-operator-68b757fb67-b99jf"
Jul 05 13:19:17.010342 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.010081    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54f06856-ccc6-48ef-9c06-340b1a24f963-trusted-ca\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:17.010342 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:17.010167    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 05 13:19:17.010342 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:17.010180    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bb8874f4b-crpk2: secret "image-registry-tls" not found
Jul 05 13:19:17.010342 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:17.010233    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls podName:54f06856-ccc6-48ef-9c06-340b1a24f963 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:17.51021431 +0000 UTC m=+60.328182252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls") pod "image-registry-6bb8874f4b-crpk2" (UID: "54f06856-ccc6-48ef-9c06-340b1a24f963") : secret "image-registry-tls" not found
Jul 05 13:19:17.010800 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.010455    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-bound-sa-token\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:17.010800 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.010553    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54f06856-ccc6-48ef-9c06-340b1a24f963-ca-trust-extracted\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:17.010800 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.010659    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58b76a86-1e5e-48b6-8792-80536cafcb5c-trusted-ca\") pod \"console-operator-68b757fb67-b99jf\" (UID: \"58b76a86-1e5e-48b6-8792-80536cafcb5c\") " pod="openshift-console-operator/console-operator-68b757fb67-b99jf"
Jul 05 13:19:17.011142 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.011102    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/58b76a86-1e5e-48b6-8792-80536cafcb5c-config\") pod \"console-operator-68b757fb67-b99jf\" (UID: \"58b76a86-1e5e-48b6-8792-80536cafcb5c\") " pod="openshift-console-operator/console-operator-68b757fb67-b99jf"
Jul 05 13:19:17.012673 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.012650    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54f06856-ccc6-48ef-9c06-340b1a24f963-image-registry-private-configuration\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:17.012793 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.012772    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54f06856-ccc6-48ef-9c06-340b1a24f963-installation-pull-secrets\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:17.012942 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.012921    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/58b76a86-1e5e-48b6-8792-80536cafcb5c-serving-cert\") pod \"console-operator-68b757fb67-b99jf\" (UID: \"58b76a86-1e5e-48b6-8792-80536cafcb5c\") " pod="openshift-console-operator/console-operator-68b757fb67-b99jf"
Jul 05 13:19:17.022164 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.022042    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-bound-sa-token\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:17.025741 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.025709    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98jjh\" (UniqueName: \"kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-kube-api-access-98jjh\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:17.025950 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.025927    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q7jq\" (UniqueName: \"kubernetes.io/projected/58b76a86-1e5e-48b6-8792-80536cafcb5c-kube-api-access-2q7jq\") pod \"console-operator-68b757fb67-b99jf\" (UID: \"58b76a86-1e5e-48b6-8792-80536cafcb5c\") " pod="openshift-console-operator/console-operator-68b757fb67-b99jf"
Jul 05 13:19:17.065949 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.065911    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xxj2g"]
Jul 05 13:19:17.071014 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:19:17.070984    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b02bb25_5475_4e7d_b02f_d89a084096cb.slice/crio-beb9264d91ccddca61b862b14db8deeb419c4e0b7d5dda9947d6d5771c1c5d1f WatchSource:0}: Error finding container beb9264d91ccddca61b862b14db8deeb419c4e0b7d5dda9947d6d5771c1c5d1f: Status 404 returned error can't find the container with id beb9264d91ccddca61b862b14db8deeb419c4e0b7d5dda9947d6d5771c1c5d1f
Jul 05 13:19:17.112135 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.112040    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xxj2g" event={"ID":"6b02bb25-5475-4e7d-b02f-d89a084096cb","Type":"ContainerStarted","Data":"beb9264d91ccddca61b862b14db8deeb419c4e0b7d5dda9947d6d5771c1c5d1f"}
Jul 05 13:19:17.148499 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.148438    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-b99jf"
Jul 05 13:19:17.273592 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.273556    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-b99jf"]
Jul 05 13:19:17.276256 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:19:17.276217    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b76a86_1e5e_48b6_8792_80536cafcb5c.slice/crio-11dbad1bbebd178622bcf1a6528eca3f7c2125401d0af16b2c2262eb912b80cf WatchSource:0}: Error finding container 11dbad1bbebd178622bcf1a6528eca3f7c2125401d0af16b2c2262eb912b80cf: Status 404 returned error can't find the container with id 11dbad1bbebd178622bcf1a6528eca3f7c2125401d0af16b2c2262eb912b80cf
Jul 05 13:19:17.413193 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.413100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f2b028a-938b-4fca-80a7-047076e70861-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ftkpj\" (UID: \"4f2b028a-938b-4fca-80a7-047076e70861\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj"
Jul 05 13:19:17.413341 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:17.413261    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 05 13:19:17.413341 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:17.413328    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f2b028a-938b-4fca-80a7-047076e70861-cluster-monitoring-operator-tls podName:4f2b028a-938b-4fca-80a7-047076e70861 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:18.413311106 +0000 UTC m=+61.231279062 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f2b028a-938b-4fca-80a7-047076e70861-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-ftkpj" (UID: "4f2b028a-938b-4fca-80a7-047076e70861") : secret "cluster-monitoring-operator-tls" not found
Jul 05 13:19:17.513666 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:17.513612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:17.513836 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:17.513766    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 05 13:19:17.513836 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:17.513781    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bb8874f4b-crpk2: secret "image-registry-tls" not found
Jul 05 13:19:17.513959 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:17.513863    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls podName:54f06856-ccc6-48ef-9c06-340b1a24f963 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:18.513845977 +0000 UTC m=+61.331813932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls") pod "image-registry-6bb8874f4b-crpk2" (UID: "54f06856-ccc6-48ef-9c06-340b1a24f963") : secret "image-registry-tls" not found
Jul 05 13:19:18.116622 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:18.116560    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-b99jf" event={"ID":"58b76a86-1e5e-48b6-8792-80536cafcb5c","Type":"ContainerStarted","Data":"11dbad1bbebd178622bcf1a6528eca3f7c2125401d0af16b2c2262eb912b80cf"}
Jul 05 13:19:18.424406 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:18.424311    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f2b028a-938b-4fca-80a7-047076e70861-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ftkpj\" (UID: \"4f2b028a-938b-4fca-80a7-047076e70861\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj"
Jul 05 13:19:18.424580 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:18.424487    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 05 13:19:18.424580 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:18.424573    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f2b028a-938b-4fca-80a7-047076e70861-cluster-monitoring-operator-tls podName:4f2b028a-938b-4fca-80a7-047076e70861 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:20.424551803 +0000 UTC m=+63.242519752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f2b028a-938b-4fca-80a7-047076e70861-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-ftkpj" (UID: "4f2b028a-938b-4fca-80a7-047076e70861") : secret "cluster-monitoring-operator-tls" not found
Jul 05 13:19:18.525929 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:18.525883    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:18.526122 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:18.525994    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 05 13:19:18.526122 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:18.526016    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bb8874f4b-crpk2: secret "image-registry-tls" not found
Jul 05 13:19:18.526122 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:18.526087    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls podName:54f06856-ccc6-48ef-9c06-340b1a24f963 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:20.526066645 +0000 UTC m=+63.344034581 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls") pod "image-registry-6bb8874f4b-crpk2" (UID: "54f06856-ccc6-48ef-9c06-340b1a24f963") : secret "image-registry-tls" not found
Jul 05 13:19:19.040376 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:19.040339    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xj7gc"
Jul 05 13:19:20.127122 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:20.127067    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xxj2g" event={"ID":"6b02bb25-5475-4e7d-b02f-d89a084096cb","Type":"ContainerStarted","Data":"5eaad92c48119518893562f11b95de202191bed5c1bac8d95160358f8aa4676b"}
Jul 05 13:19:20.129209 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:20.129188    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/0.log"
Jul 05 13:19:20.129300 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:20.129226    2565 generic.go:356] "Generic (PLEG): container finished" podID="58b76a86-1e5e-48b6-8792-80536cafcb5c" containerID="83ef196d62c2753800fdf308d98a338bd73a975aa6b25a3f1bad5a6329a164d4" exitCode=255
Jul 05 13:19:20.129300 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:20.129283    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-b99jf" event={"ID":"58b76a86-1e5e-48b6-8792-80536cafcb5c","Type":"ContainerDied","Data":"83ef196d62c2753800fdf308d98a338bd73a975aa6b25a3f1bad5a6329a164d4"}
Jul 05 13:19:20.129482 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:20.129470    2565 scope.go:117] "RemoveContainer" containerID="83ef196d62c2753800fdf308d98a338bd73a975aa6b25a3f1bad5a6329a164d4"
Jul 05 13:19:20.154131 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:20.153692    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xxj2g" podStartSLOduration=1.860811725 podStartE2EDuration="4.153669583s" totalImagesPullingTime="2.292857858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:20.15286326 +0000 UTC m=+62.970831241" watchObservedRunningTime="2026-07-05 13:19:20.153669583 +0000 UTC m=+62.971637540"
Jul 05 13:19:20.441785 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:20.441694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f2b028a-938b-4fca-80a7-047076e70861-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ftkpj\" (UID: \"4f2b028a-938b-4fca-80a7-047076e70861\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj"
Jul 05 13:19:20.441934 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:20.441815    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 05 13:19:20.441934 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:20.441880    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f2b028a-938b-4fca-80a7-047076e70861-cluster-monitoring-operator-tls podName:4f2b028a-938b-4fca-80a7-047076e70861 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:24.441864735 +0000 UTC m=+67.259832669 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f2b028a-938b-4fca-80a7-047076e70861-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-ftkpj" (UID: "4f2b028a-938b-4fca-80a7-047076e70861") : secret "cluster-monitoring-operator-tls" not found
Jul 05 13:19:20.542659 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:20.542601    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:20.542849 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:20.542776    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 05 13:19:20.542849 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:20.542801    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bb8874f4b-crpk2: secret "image-registry-tls" not found
Jul 05 13:19:20.542970 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:20.542870    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls podName:54f06856-ccc6-48ef-9c06-340b1a24f963 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:24.542849859 +0000 UTC m=+67.360817793 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls") pod "image-registry-6bb8874f4b-crpk2" (UID: "54f06856-ccc6-48ef-9c06-340b1a24f963") : secret "image-registry-tls" not found
Jul 05 13:19:21.133026 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.132997    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/1.log"
Jul 05 13:19:21.133427 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.133410    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/0.log"
Jul 05 13:19:21.133491 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.133449    2565 generic.go:356] "Generic (PLEG): container finished" podID="58b76a86-1e5e-48b6-8792-80536cafcb5c" containerID="ae4dd093388a7f47bd9910f807b1855e6ef4d1943bfbc0dc13ff9d6d768d84f5" exitCode=255
Jul 05 13:19:21.133542 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.133526    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-b99jf" event={"ID":"58b76a86-1e5e-48b6-8792-80536cafcb5c","Type":"ContainerDied","Data":"ae4dd093388a7f47bd9910f807b1855e6ef4d1943bfbc0dc13ff9d6d768d84f5"}
Jul 05 13:19:21.133576 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.133571    2565 scope.go:117] "RemoveContainer" containerID="83ef196d62c2753800fdf308d98a338bd73a975aa6b25a3f1bad5a6329a164d4"
Jul 05 13:19:21.133823 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.133801    2565 scope.go:117] "RemoveContainer" containerID="ae4dd093388a7f47bd9910f807b1855e6ef4d1943bfbc0dc13ff9d6d768d84f5"
Jul 05 13:19:21.134012 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:21.133989    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-b99jf_openshift-console-operator(58b76a86-1e5e-48b6-8792-80536cafcb5c)\"" pod="openshift-console-operator/console-operator-68b757fb67-b99jf" podUID="58b76a86-1e5e-48b6-8792-80536cafcb5c"
Jul 05 13:19:21.343375 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.343342    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9k6px"]
Jul 05 13:19:21.346313 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.346286    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:21.348820 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.348799    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 05 13:19:21.349606 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.349588    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n6z8z\""
Jul 05 13:19:21.349863 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.349841    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 05 13:19:21.349971 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.349869    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 05 13:19:21.350681 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.350664    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 05 13:19:21.417477 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.417384    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9k6px"]
Jul 05 13:19:21.450526 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.450486    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/69b9856f-38ad-40b1-996e-2ce488db00b3-crio-socket\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:21.450526 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.450527    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/69b9856f-38ad-40b1-996e-2ce488db00b3-data-volume\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:21.450742 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.450570    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69b9856f-38ad-40b1-996e-2ce488db00b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:21.450742 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.450614    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52cbt\" (UniqueName: \"kubernetes.io/projected/69b9856f-38ad-40b1-996e-2ce488db00b3-kube-api-access-52cbt\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:21.450742 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.450681    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69b9856f-38ad-40b1-996e-2ce488db00b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:21.551372 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.551318    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69b9856f-38ad-40b1-996e-2ce488db00b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:21.551545 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.551395    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/69b9856f-38ad-40b1-996e-2ce488db00b3-crio-socket\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:21.551545 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.551429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/69b9856f-38ad-40b1-996e-2ce488db00b3-data-volume\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:21.551545 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.551481    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69b9856f-38ad-40b1-996e-2ce488db00b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:21.551545 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:21.551485    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:21.551756 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:21.551553    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b9856f-38ad-40b1-996e-2ce488db00b3-insights-runtime-extractor-tls podName:69b9856f-38ad-40b1-996e-2ce488db00b3 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:22.051535415 +0000 UTC m=+64.869503366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69b9856f-38ad-40b1-996e-2ce488db00b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9k6px" (UID: "69b9856f-38ad-40b1-996e-2ce488db00b3") : secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:21.551756 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.551549    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/69b9856f-38ad-40b1-996e-2ce488db00b3-crio-socket\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:21.551756 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.551573    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52cbt\" (UniqueName: \"kubernetes.io/projected/69b9856f-38ad-40b1-996e-2ce488db00b3-kube-api-access-52cbt\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:21.551756 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:21.551581    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 13:19:21.551756 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:21.551668    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69b9856f-38ad-40b1-996e-2ce488db00b3-kube-rbac-proxy-cm podName:69b9856f-38ad-40b1-996e-2ce488db00b3 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:22.05162734 +0000 UTC m=+64.869595275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/69b9856f-38ad-40b1-996e-2ce488db00b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9k6px" (UID: "69b9856f-38ad-40b1-996e-2ce488db00b3") : configmap "kube-rbac-proxy" not found
Jul 05 13:19:21.551961 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.551838    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/69b9856f-38ad-40b1-996e-2ce488db00b3-data-volume\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:21.598345 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:21.598311    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52cbt\" (UniqueName: \"kubernetes.io/projected/69b9856f-38ad-40b1-996e-2ce488db00b3-kube-api-access-52cbt\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:22.055976 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:22.055934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69b9856f-38ad-40b1-996e-2ce488db00b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:22.056192 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:22.056041    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69b9856f-38ad-40b1-996e-2ce488db00b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:22.056192 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:22.056116    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:22.056192 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:22.056151    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 13:19:22.056192 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:22.056185    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b9856f-38ad-40b1-996e-2ce488db00b3-insights-runtime-extractor-tls podName:69b9856f-38ad-40b1-996e-2ce488db00b3 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:23.056169683 +0000 UTC m=+65.874137619 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69b9856f-38ad-40b1-996e-2ce488db00b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9k6px" (UID: "69b9856f-38ad-40b1-996e-2ce488db00b3") : secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:22.056374 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:22.056228    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69b9856f-38ad-40b1-996e-2ce488db00b3-kube-rbac-proxy-cm podName:69b9856f-38ad-40b1-996e-2ce488db00b3 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:23.056210756 +0000 UTC m=+65.874178691 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/69b9856f-38ad-40b1-996e-2ce488db00b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9k6px" (UID: "69b9856f-38ad-40b1-996e-2ce488db00b3") : configmap "kube-rbac-proxy" not found
Jul 05 13:19:22.137723 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:22.137694    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/1.log"
Jul 05 13:19:22.138203 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:22.138147    2565 scope.go:117] "RemoveContainer" containerID="ae4dd093388a7f47bd9910f807b1855e6ef4d1943bfbc0dc13ff9d6d768d84f5"
Jul 05 13:19:22.138351 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:22.138328    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-b99jf_openshift-console-operator(58b76a86-1e5e-48b6-8792-80536cafcb5c)\"" pod="openshift-console-operator/console-operator-68b757fb67-b99jf" podUID="58b76a86-1e5e-48b6-8792-80536cafcb5c"
Jul 05 13:19:22.458436 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:22.458397    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret\") pod \"global-pull-secret-syncer-t4s6n\" (UID: \"dd27dfce-3c13-4d05-a19b-dcb32e9af21c\") " pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:19:22.458656 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:22.458453    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkwjk\" (UniqueName: \"kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk\") pod \"network-check-target-nnb8k\" (UID: \"17185f72-eafe-4930-8fcb-1d10baa8f07e\") " pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:19:22.458656 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:22.458471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs\") pod \"network-metrics-daemon-rlllr\" (UID: \"65ca969d-9b3d-4379-a220-fff11397bef6\") " pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:19:22.462700 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:22.462668    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 05 13:19:22.462807 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:22.462671    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 05 13:19:22.462807 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:22.462672    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 05 13:19:22.469118 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:22.469088    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 05 13:19:22.469199 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:22.469185    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs podName:65ca969d-9b3d-4379-a220-fff11397bef6 nodeName:}" failed. No retries permitted until 2026-07-05 13:20:26.469163691 +0000 UTC m=+129.287131636 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs") pod "network-metrics-daemon-rlllr" (UID: "65ca969d-9b3d-4379-a220-fff11397bef6") : secret "metrics-daemon-secret" not found
Jul 05 13:19:22.471367 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:22.471342    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd27dfce-3c13-4d05-a19b-dcb32e9af21c-original-pull-secret\") pod \"global-pull-secret-syncer-t4s6n\" (UID: \"dd27dfce-3c13-4d05-a19b-dcb32e9af21c\") " pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:19:22.471877 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:22.471861    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 05 13:19:22.482321 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:22.482283    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkwjk\" (UniqueName: \"kubernetes.io/projected/17185f72-eafe-4930-8fcb-1d10baa8f07e-kube-api-access-wkwjk\") pod \"network-check-target-nnb8k\" (UID: \"17185f72-eafe-4930-8fcb-1d10baa8f07e\") " pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:19:22.548574 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:22.548529    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t4s6n"
Jul 05 13:19:22.558444 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:22.558419    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z2lc5\""
Jul 05 13:19:22.565903 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:22.565875    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:19:22.688190 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:22.688146    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t4s6n"]
Jul 05 13:19:22.691912 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:19:22.691884    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd27dfce_3c13_4d05_a19b_dcb32e9af21c.slice/crio-08f55b6426845cdcafe6b14273590e18c541fc5d1279af34bf2ac552a32c05e5 WatchSource:0}: Error finding container 08f55b6426845cdcafe6b14273590e18c541fc5d1279af34bf2ac552a32c05e5: Status 404 returned error can't find the container with id 08f55b6426845cdcafe6b14273590e18c541fc5d1279af34bf2ac552a32c05e5
Jul 05 13:19:22.714776 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:22.711860    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nnb8k"]
Jul 05 13:19:22.715307 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:19:22.715280    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17185f72_eafe_4930_8fcb_1d10baa8f07e.slice/crio-d15142a87d6ee9003abadafa903632723688059c36cbaa597005d69280196100 WatchSource:0}: Error finding container d15142a87d6ee9003abadafa903632723688059c36cbaa597005d69280196100: Status 404 returned error can't find the container with id d15142a87d6ee9003abadafa903632723688059c36cbaa597005d69280196100
Jul 05 13:19:23.062903 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.062791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69b9856f-38ad-40b1-996e-2ce488db00b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:23.062903 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.062869    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69b9856f-38ad-40b1-996e-2ce488db00b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:23.063144 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:23.062926    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 13:19:23.063144 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:23.062968    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:23.063144 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:23.063009    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69b9856f-38ad-40b1-996e-2ce488db00b3-kube-rbac-proxy-cm podName:69b9856f-38ad-40b1-996e-2ce488db00b3 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:25.062987866 +0000 UTC m=+67.880955801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/69b9856f-38ad-40b1-996e-2ce488db00b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9k6px" (UID: "69b9856f-38ad-40b1-996e-2ce488db00b3") : configmap "kube-rbac-proxy" not found
Jul 05 13:19:23.063144 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:23.063029    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b9856f-38ad-40b1-996e-2ce488db00b3-insights-runtime-extractor-tls podName:69b9856f-38ad-40b1-996e-2ce488db00b3 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:25.063020579 +0000 UTC m=+67.880988514 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69b9856f-38ad-40b1-996e-2ce488db00b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9k6px" (UID: "69b9856f-38ad-40b1-996e-2ce488db00b3") : secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:23.074974 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.074943    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nltvs_2c02645e-d3d4-4f5e-824f-c629da35133b/dns-node-resolver/0.log"
Jul 05 13:19:23.141848 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.141816    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nnb8k" event={"ID":"17185f72-eafe-4930-8fcb-1d10baa8f07e","Type":"ContainerStarted","Data":"d15142a87d6ee9003abadafa903632723688059c36cbaa597005d69280196100"}
Jul 05 13:19:23.143019 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.142992    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t4s6n" event={"ID":"dd27dfce-3c13-4d05-a19b-dcb32e9af21c","Type":"ContainerStarted","Data":"08f55b6426845cdcafe6b14273590e18c541fc5d1279af34bf2ac552a32c05e5"}
Jul 05 13:19:23.208804 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.208770    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-5m95b"]
Jul 05 13:19:23.210890 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.210861    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-5m95b"
Jul 05 13:19:23.215082 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.215022    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 05 13:19:23.215987 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.215248    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 05 13:19:23.215987 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.215487    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 05 13:19:23.215987 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.215490    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 05 13:19:23.215987 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.215973    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-tgtvx\""
Jul 05 13:19:23.223022 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.222611    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-5m95b"]
Jul 05 13:19:23.264174 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.264135    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a86c5bfe-f6a3-4ae1-bccc-2e5103015719-signing-key\") pod \"service-ca-758f599c5-5m95b\" (UID: \"a86c5bfe-f6a3-4ae1-bccc-2e5103015719\") " pod="openshift-service-ca/service-ca-758f599c5-5m95b"
Jul 05 13:19:23.264370 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.264189    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a86c5bfe-f6a3-4ae1-bccc-2e5103015719-signing-cabundle\") pod \"service-ca-758f599c5-5m95b\" (UID: \"a86c5bfe-f6a3-4ae1-bccc-2e5103015719\") " pod="openshift-service-ca/service-ca-758f599c5-5m95b"
Jul 05 13:19:23.264370 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.264323    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnz4d\" (UniqueName: \"kubernetes.io/projected/a86c5bfe-f6a3-4ae1-bccc-2e5103015719-kube-api-access-wnz4d\") pod \"service-ca-758f599c5-5m95b\" (UID: \"a86c5bfe-f6a3-4ae1-bccc-2e5103015719\") " pod="openshift-service-ca/service-ca-758f599c5-5m95b"
Jul 05 13:19:23.365427 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.365384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnz4d\" (UniqueName: \"kubernetes.io/projected/a86c5bfe-f6a3-4ae1-bccc-2e5103015719-kube-api-access-wnz4d\") pod \"service-ca-758f599c5-5m95b\" (UID: \"a86c5bfe-f6a3-4ae1-bccc-2e5103015719\") " pod="openshift-service-ca/service-ca-758f599c5-5m95b"
Jul 05 13:19:23.365654 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.365488    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a86c5bfe-f6a3-4ae1-bccc-2e5103015719-signing-key\") pod \"service-ca-758f599c5-5m95b\" (UID: \"a86c5bfe-f6a3-4ae1-bccc-2e5103015719\") " pod="openshift-service-ca/service-ca-758f599c5-5m95b"
Jul 05 13:19:23.365654 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.365517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a86c5bfe-f6a3-4ae1-bccc-2e5103015719-signing-cabundle\") pod \"service-ca-758f599c5-5m95b\" (UID: \"a86c5bfe-f6a3-4ae1-bccc-2e5103015719\") " pod="openshift-service-ca/service-ca-758f599c5-5m95b"
Jul 05 13:19:23.366325 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.366271    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a86c5bfe-f6a3-4ae1-bccc-2e5103015719-signing-cabundle\") pod \"service-ca-758f599c5-5m95b\" (UID: \"a86c5bfe-f6a3-4ae1-bccc-2e5103015719\") " pod="openshift-service-ca/service-ca-758f599c5-5m95b"
Jul 05 13:19:23.369217 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.369158    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a86c5bfe-f6a3-4ae1-bccc-2e5103015719-signing-key\") pod \"service-ca-758f599c5-5m95b\" (UID: \"a86c5bfe-f6a3-4ae1-bccc-2e5103015719\") " pod="openshift-service-ca/service-ca-758f599c5-5m95b"
Jul 05 13:19:23.381610 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.381567    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnz4d\" (UniqueName: \"kubernetes.io/projected/a86c5bfe-f6a3-4ae1-bccc-2e5103015719-kube-api-access-wnz4d\") pod \"service-ca-758f599c5-5m95b\" (UID: \"a86c5bfe-f6a3-4ae1-bccc-2e5103015719\") " pod="openshift-service-ca/service-ca-758f599c5-5m95b"
Jul 05 13:19:23.524183 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.524149    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-5m95b"
Jul 05 13:19:23.705900 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:23.705830    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-5m95b"]
Jul 05 13:19:23.711394 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:19:23.711256    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda86c5bfe_f6a3_4ae1_bccc_2e5103015719.slice/crio-8e3c99bbdf2485f58ed68a04a21911fd009ea86a6bd871f46c39ba1a79eb2b1a WatchSource:0}: Error finding container 8e3c99bbdf2485f58ed68a04a21911fd009ea86a6bd871f46c39ba1a79eb2b1a: Status 404 returned error can't find the container with id 8e3c99bbdf2485f58ed68a04a21911fd009ea86a6bd871f46c39ba1a79eb2b1a
Jul 05 13:19:24.149425 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:24.149351    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-5m95b" event={"ID":"a86c5bfe-f6a3-4ae1-bccc-2e5103015719","Type":"ContainerStarted","Data":"8e3c99bbdf2485f58ed68a04a21911fd009ea86a6bd871f46c39ba1a79eb2b1a"}
Jul 05 13:19:24.284772 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:24.284740    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rgn5q_8b968b72-7bc0-4186-aa14-7405cf541b16/node-ca/0.log"
Jul 05 13:19:24.376121 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:24.376085    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls\") pod \"dns-default-d28zj\" (UID: \"35b816f6-4b8c-4df8-b0f1-d51fc39569f5\") " pod="openshift-dns/dns-default-d28zj"
Jul 05 13:19:24.376404 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:24.376265    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 05 13:19:24.376404 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:24.376340    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls podName:35b816f6-4b8c-4df8-b0f1-d51fc39569f5 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:56.376309345 +0000 UTC m=+99.194277287 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls") pod "dns-default-d28zj" (UID: "35b816f6-4b8c-4df8-b0f1-d51fc39569f5") : secret "dns-default-metrics-tls" not found
Jul 05 13:19:24.477695 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:24.477592    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f2b028a-938b-4fca-80a7-047076e70861-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ftkpj\" (UID: \"4f2b028a-938b-4fca-80a7-047076e70861\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj"
Jul 05 13:19:24.477877 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:24.477772    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 05 13:19:24.477877 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:24.477840    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f2b028a-938b-4fca-80a7-047076e70861-cluster-monitoring-operator-tls podName:4f2b028a-938b-4fca-80a7-047076e70861 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:32.477819843 +0000 UTC m=+75.295787780 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f2b028a-938b-4fca-80a7-047076e70861-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-ftkpj" (UID: "4f2b028a-938b-4fca-80a7-047076e70861") : secret "cluster-monitoring-operator-tls" not found
Jul 05 13:19:24.579062 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:24.579020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:24.579339 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:24.579275    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 05 13:19:24.579339 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:24.579299    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bb8874f4b-crpk2: secret "image-registry-tls" not found
Jul 05 13:19:24.579508 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:24.579357    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls podName:54f06856-ccc6-48ef-9c06-340b1a24f963 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:32.579339282 +0000 UTC m=+75.397307219 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls") pod "image-registry-6bb8874f4b-crpk2" (UID: "54f06856-ccc6-48ef-9c06-340b1a24f963") : secret "image-registry-tls" not found
Jul 05 13:19:24.873506 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:24.873469    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2hswj_6d43b236-bef2-4929-a053-d0b32a29301a/serve-healthcheck-canary/0.log"
Jul 05 13:19:25.084150 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:25.083807    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69b9856f-38ad-40b1-996e-2ce488db00b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:25.084150 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:25.083920    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69b9856f-38ad-40b1-996e-2ce488db00b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:25.084150 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:25.083948    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 13:19:25.084150 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:25.084095    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69b9856f-38ad-40b1-996e-2ce488db00b3-kube-rbac-proxy-cm podName:69b9856f-38ad-40b1-996e-2ce488db00b3 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:29.084078332 +0000 UTC m=+71.902046271 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/69b9856f-38ad-40b1-996e-2ce488db00b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9k6px" (UID: "69b9856f-38ad-40b1-996e-2ce488db00b3") : configmap "kube-rbac-proxy" not found
Jul 05 13:19:25.084150 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:25.084035    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:25.084150 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:25.084132    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b9856f-38ad-40b1-996e-2ce488db00b3-insights-runtime-extractor-tls podName:69b9856f-38ad-40b1-996e-2ce488db00b3 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:29.084126046 +0000 UTC m=+71.902093985 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69b9856f-38ad-40b1-996e-2ce488db00b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9k6px" (UID: "69b9856f-38ad-40b1-996e-2ce488db00b3") : secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:27.149224 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:27.149173    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-b99jf"
Jul 05 13:19:27.149682 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:27.149261    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-b99jf"
Jul 05 13:19:27.149764 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:27.149726    2565 scope.go:117] "RemoveContainer" containerID="ae4dd093388a7f47bd9910f807b1855e6ef4d1943bfbc0dc13ff9d6d768d84f5"
Jul 05 13:19:27.149945 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:27.149921    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-b99jf_openshift-console-operator(58b76a86-1e5e-48b6-8792-80536cafcb5c)\"" pod="openshift-console-operator/console-operator-68b757fb67-b99jf" podUID="58b76a86-1e5e-48b6-8792-80536cafcb5c"
Jul 05 13:19:28.163418 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:28.163375    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-5m95b" event={"ID":"a86c5bfe-f6a3-4ae1-bccc-2e5103015719","Type":"ContainerStarted","Data":"7f43e9d03948e2cc425e5bb42e08a1cb340bdac6dbe16a0eb1da52a6bb9ae916"}
Jul 05 13:19:28.165525 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:28.165491    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nnb8k" event={"ID":"17185f72-eafe-4930-8fcb-1d10baa8f07e","Type":"ContainerStarted","Data":"7b2cf451b1c502785777b9637073044d3302cc4e95164a54c0a0133d0bc5c315"}
Jul 05 13:19:28.165705 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:28.165549    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:19:28.167326 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:28.167285    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t4s6n" event={"ID":"dd27dfce-3c13-4d05-a19b-dcb32e9af21c","Type":"ContainerStarted","Data":"13e0ac121c153016c7618888a1877eb657f17b6759b823275bf9c2109a4f46a8"}
Jul 05 13:19:28.206681 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:28.206601    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-5m95b" podStartSLOduration=0.858550844 podStartE2EDuration="5.206579763s" totalImagesPullingTime="4.348028919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:28.20650339 +0000 UTC m=+71.024471376" watchObservedRunningTime="2026-07-05 13:19:28.206579763 +0000 UTC m=+71.024547720"
Jul 05 13:19:28.229722 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:28.229622    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nnb8k" podStartSLOduration=65.889987682 podStartE2EDuration="1m11.229597193s" totalImagesPullingTime="5.339609511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:28.228807953 +0000 UTC m=+71.046775944" watchObservedRunningTime="2026-07-05 13:19:28.229597193 +0000 UTC m=+71.047565150"
Jul 05 13:19:28.263618 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:28.263560    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-t4s6n" podStartSLOduration=64.88789779 podStartE2EDuration="1m10.263541301s" totalImagesPullingTime="5.375643511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:28.262152906 +0000 UTC m=+71.080120894" watchObservedRunningTime="2026-07-05 13:19:28.263541301 +0000 UTC m=+71.081509247"
Jul 05 13:19:29.121201 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:29.121150    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69b9856f-38ad-40b1-996e-2ce488db00b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:29.121386 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:29.121224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69b9856f-38ad-40b1-996e-2ce488db00b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:29.121386 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:29.121314    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 05 13:19:29.121386 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:29.121315    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:29.121386 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:29.121365    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69b9856f-38ad-40b1-996e-2ce488db00b3-kube-rbac-proxy-cm podName:69b9856f-38ad-40b1-996e-2ce488db00b3 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:37.12135299 +0000 UTC m=+79.939320925 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/69b9856f-38ad-40b1-996e-2ce488db00b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9k6px" (UID: "69b9856f-38ad-40b1-996e-2ce488db00b3") : configmap "kube-rbac-proxy" not found
Jul 05 13:19:29.121386 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:29.121378    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b9856f-38ad-40b1-996e-2ce488db00b3-insights-runtime-extractor-tls podName:69b9856f-38ad-40b1-996e-2ce488db00b3 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:37.121372468 +0000 UTC m=+79.939340404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69b9856f-38ad-40b1-996e-2ce488db00b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9k6px" (UID: "69b9856f-38ad-40b1-996e-2ce488db00b3") : secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:32.550137 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:32.550086    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f2b028a-938b-4fca-80a7-047076e70861-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ftkpj\" (UID: \"4f2b028a-938b-4fca-80a7-047076e70861\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj"
Jul 05 13:19:32.550604 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:32.550248    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 05 13:19:32.550604 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:32.550318    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f2b028a-938b-4fca-80a7-047076e70861-cluster-monitoring-operator-tls podName:4f2b028a-938b-4fca-80a7-047076e70861 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:48.550302569 +0000 UTC m=+91.368270507 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f2b028a-938b-4fca-80a7-047076e70861-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-ftkpj" (UID: "4f2b028a-938b-4fca-80a7-047076e70861") : secret "cluster-monitoring-operator-tls" not found
Jul 05 13:19:32.650761 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:32.650723    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:32.650920 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:32.650892    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 05 13:19:32.650920 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:32.650914    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bb8874f4b-crpk2: secret "image-registry-tls" not found
Jul 05 13:19:32.651023 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:32.650983    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls podName:54f06856-ccc6-48ef-9c06-340b1a24f963 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:48.650963783 +0000 UTC m=+91.468931721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls") pod "image-registry-6bb8874f4b-crpk2" (UID: "54f06856-ccc6-48ef-9c06-340b1a24f963") : secret "image-registry-tls" not found
Jul 05 13:19:37.196047 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:37.196008    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69b9856f-38ad-40b1-996e-2ce488db00b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:37.196531 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:37.196139    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69b9856f-38ad-40b1-996e-2ce488db00b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:37.196531 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:37.196179    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:37.196531 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:19:37.196274    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b9856f-38ad-40b1-996e-2ce488db00b3-insights-runtime-extractor-tls podName:69b9856f-38ad-40b1-996e-2ce488db00b3 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:53.196252711 +0000 UTC m=+96.014220658 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69b9856f-38ad-40b1-996e-2ce488db00b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9k6px" (UID: "69b9856f-38ad-40b1-996e-2ce488db00b3") : secret "insights-runtime-extractor-tls" not found
Jul 05 13:19:37.196836 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:37.196814    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69b9856f-38ad-40b1-996e-2ce488db00b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:41.735785 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:41.735659    2565 scope.go:117] "RemoveContainer" containerID="ae4dd093388a7f47bd9910f807b1855e6ef4d1943bfbc0dc13ff9d6d768d84f5"
Jul 05 13:19:42.215097 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:42.215066    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/1.log"
Jul 05 13:19:42.215288 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:42.215146    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-b99jf" event={"ID":"58b76a86-1e5e-48b6-8792-80536cafcb5c","Type":"ContainerStarted","Data":"6d8cd64aa1512406a15b46c173931a391f6104b571125cbdd1a889196a903514"}
Jul 05 13:19:42.215486 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:42.215457    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-b99jf"
Jul 05 13:19:42.244023 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:42.243971    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-b99jf" podStartSLOduration=24.155655417 podStartE2EDuration="26.243954216s" totalImagesPullingTime="2.088298799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:42.243027969 +0000 UTC m=+85.060995947" watchObservedRunningTime="2026-07-05 13:19:42.243954216 +0000 UTC m=+85.061922184"
Jul 05 13:19:42.787236 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:42.787206    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-b99jf"
Jul 05 13:19:48.594743 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:48.594699    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f2b028a-938b-4fca-80a7-047076e70861-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ftkpj\" (UID: \"4f2b028a-938b-4fca-80a7-047076e70861\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj"
Jul 05 13:19:48.597256 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:48.597225    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f2b028a-938b-4fca-80a7-047076e70861-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-ftkpj\" (UID: \"4f2b028a-938b-4fca-80a7-047076e70861\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj"
Jul 05 13:19:48.695812 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:48.695767    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:48.698233 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:48.698197    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls\") pod \"image-registry-6bb8874f4b-crpk2\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") " pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:48.829310 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:48.829277    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hnkwv\""
Jul 05 13:19:48.836363 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:48.836318    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj"
Jul 05 13:19:48.958064 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:48.958035    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ckkjd\""
Jul 05 13:19:48.963771 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:48.963747    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:48.984186 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:48.984153    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj"]
Jul 05 13:19:48.987409 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:19:48.987380    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f2b028a_938b_4fca_80a7_047076e70861.slice/crio-68a1f07bf5f29310dc94ac927f0e4c4fc1de5c065510cf3ef9397a46c4ac62e8 WatchSource:0}: Error finding container 68a1f07bf5f29310dc94ac927f0e4c4fc1de5c065510cf3ef9397a46c4ac62e8: Status 404 returned error can't find the container with id 68a1f07bf5f29310dc94ac927f0e4c4fc1de5c065510cf3ef9397a46c4ac62e8
Jul 05 13:19:49.118272 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:49.118184    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bb8874f4b-crpk2"]
Jul 05 13:19:49.124927 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:19:49.124897    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54f06856_ccc6_48ef_9c06_340b1a24f963.slice/crio-8e79ddb99b9e2a85fee43ccff4d37896682a10716b1a4ae69f8460f0e00b24e1 WatchSource:0}: Error finding container 8e79ddb99b9e2a85fee43ccff4d37896682a10716b1a4ae69f8460f0e00b24e1: Status 404 returned error can't find the container with id 8e79ddb99b9e2a85fee43ccff4d37896682a10716b1a4ae69f8460f0e00b24e1
Jul 05 13:19:49.238288 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:49.238245    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj" event={"ID":"4f2b028a-938b-4fca-80a7-047076e70861","Type":"ContainerStarted","Data":"68a1f07bf5f29310dc94ac927f0e4c4fc1de5c065510cf3ef9397a46c4ac62e8"}
Jul 05 13:19:49.239761 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:49.239733    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2" event={"ID":"54f06856-ccc6-48ef-9c06-340b1a24f963","Type":"ContainerStarted","Data":"328bdcb8f224e52fb212bd8d2d51633e3e5a8fb3c4db56959f62f02bc654683e"}
Jul 05 13:19:49.239914 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:49.239772    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2" event={"ID":"54f06856-ccc6-48ef-9c06-340b1a24f963","Type":"ContainerStarted","Data":"8e79ddb99b9e2a85fee43ccff4d37896682a10716b1a4ae69f8460f0e00b24e1"}
Jul 05 13:19:49.239914 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:49.239869    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:19:49.277377 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:49.277324    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2" podStartSLOduration=33.277306392 podStartE2EDuration="33.277306392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:49.275930556 +0000 UTC m=+92.093898534" watchObservedRunningTime="2026-07-05 13:19:49.277306392 +0000 UTC m=+92.095274359"
Jul 05 13:19:51.248733 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:51.248690    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj" event={"ID":"4f2b028a-938b-4fca-80a7-047076e70861","Type":"ContainerStarted","Data":"9e05fe445222f074c7dec44743570eb8ba1e200afa52e8789ff2a08722d4747f"}
Jul 05 13:19:51.267797 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:51.267715    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-ftkpj" podStartSLOduration=33.799632963 podStartE2EDuration="35.267699963s" totalImagesPullingTime="1.468067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:51.267594879 +0000 UTC m=+94.085562862" watchObservedRunningTime="2026-07-05 13:19:51.267699963 +0000 UTC m=+94.085667920"
Jul 05 13:19:53.237297 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.237250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69b9856f-38ad-40b1-996e-2ce488db00b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:53.239583 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.239553    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69b9856f-38ad-40b1-996e-2ce488db00b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9k6px\" (UID: \"69b9856f-38ad-40b1-996e-2ce488db00b3\") " pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:53.454824 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.454778    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9k6px"
Jul 05 13:19:53.499123 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.499043    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"]
Jul 05 13:19:53.502788 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.502763    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"
Jul 05 13:19:53.508618 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.508392    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 05 13:19:53.509365 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.509338    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 05 13:19:53.509594 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.509569    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 05 13:19:53.509690 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.509665    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 05 13:19:53.509953 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.509765    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 05 13:19:53.509953 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.509583    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 05 13:19:53.510115 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.510018    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 05 13:19:53.579597 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.579566    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"]
Jul 05 13:19:53.616487 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.616447    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bb8874f4b-crpk2"]
Jul 05 13:19:53.640396 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.640362    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4b50cef7-df02-40d2-a72b-2ed621290c41-hub\") pod \"cluster-proxy-proxy-agent-66696dfb57-h5snk\" (UID: \"4b50cef7-df02-40d2-a72b-2ed621290c41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"
Jul 05 13:19:53.640739 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.640404    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4b50cef7-df02-40d2-a72b-2ed621290c41-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66696dfb57-h5snk\" (UID: \"4b50cef7-df02-40d2-a72b-2ed621290c41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"
Jul 05 13:19:53.640739 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.640436    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhtxk\" (UniqueName: \"kubernetes.io/projected/4b50cef7-df02-40d2-a72b-2ed621290c41-kube-api-access-nhtxk\") pod \"cluster-proxy-proxy-agent-66696dfb57-h5snk\" (UID: \"4b50cef7-df02-40d2-a72b-2ed621290c41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"
Jul 05 13:19:53.640739 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.640503    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b50cef7-df02-40d2-a72b-2ed621290c41-additional-service-ca\") pod \"cluster-proxy-proxy-agent-66696dfb57-h5snk\" (UID: \"4b50cef7-df02-40d2-a72b-2ed621290c41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"
Jul 05 13:19:53.640739 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.640585    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b50cef7-df02-40d2-a72b-2ed621290c41-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66696dfb57-h5snk\" (UID: \"4b50cef7-df02-40d2-a72b-2ed621290c41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"
Jul 05 13:19:53.640739 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.640681    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4b50cef7-df02-40d2-a72b-2ed621290c41-ca\") pod \"cluster-proxy-proxy-agent-66696dfb57-h5snk\" (UID: \"4b50cef7-df02-40d2-a72b-2ed621290c41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"
Jul 05 13:19:53.703382 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.703336    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9k6px"]
Jul 05 13:19:53.713953 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:19:53.713921    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69b9856f_38ad_40b1_996e_2ce488db00b3.slice/crio-0fc41d1e18144fcf9f3d4ac5b55412aa180748a0d3aec49c5a31fab9f2564963 WatchSource:0}: Error finding container 0fc41d1e18144fcf9f3d4ac5b55412aa180748a0d3aec49c5a31fab9f2564963: Status 404 returned error can't find the container with id 0fc41d1e18144fcf9f3d4ac5b55412aa180748a0d3aec49c5a31fab9f2564963
Jul 05 13:19:53.741376 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.741343    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4b50cef7-df02-40d2-a72b-2ed621290c41-ca\") pod \"cluster-proxy-proxy-agent-66696dfb57-h5snk\" (UID: \"4b50cef7-df02-40d2-a72b-2ed621290c41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"
Jul 05 13:19:53.741376 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.741381    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4b50cef7-df02-40d2-a72b-2ed621290c41-hub\") pod \"cluster-proxy-proxy-agent-66696dfb57-h5snk\" (UID: \"4b50cef7-df02-40d2-a72b-2ed621290c41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"
Jul 05 13:19:53.741651 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.741403    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4b50cef7-df02-40d2-a72b-2ed621290c41-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66696dfb57-h5snk\" (UID: \"4b50cef7-df02-40d2-a72b-2ed621290c41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"
Jul 05 13:19:53.741651 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.741442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhtxk\" (UniqueName: \"kubernetes.io/projected/4b50cef7-df02-40d2-a72b-2ed621290c41-kube-api-access-nhtxk\") pod \"cluster-proxy-proxy-agent-66696dfb57-h5snk\" (UID: \"4b50cef7-df02-40d2-a72b-2ed621290c41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"
Jul 05 13:19:53.741651 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.741463    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b50cef7-df02-40d2-a72b-2ed621290c41-additional-service-ca\") pod \"cluster-proxy-proxy-agent-66696dfb57-h5snk\" (UID: \"4b50cef7-df02-40d2-a72b-2ed621290c41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"
Jul 05 13:19:53.741651 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.741507    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b50cef7-df02-40d2-a72b-2ed621290c41-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66696dfb57-h5snk\" (UID: \"4b50cef7-df02-40d2-a72b-2ed621290c41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"
Jul 05 13:19:53.742259 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.742227    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b50cef7-df02-40d2-a72b-2ed621290c41-additional-service-ca\") pod \"cluster-proxy-proxy-agent-66696dfb57-h5snk\" (UID: \"4b50cef7-df02-40d2-a72b-2ed621290c41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"
Jul 05 13:19:53.744098 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.744076    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4b50cef7-df02-40d2-a72b-2ed621290c41-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66696dfb57-h5snk\" (UID: \"4b50cef7-df02-40d2-a72b-2ed621290c41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"
Jul 05 13:19:53.744406 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.744386    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4b50cef7-df02-40d2-a72b-2ed621290c41-ca\") pod \"cluster-proxy-proxy-agent-66696dfb57-h5snk\" (UID: \"4b50cef7-df02-40d2-a72b-2ed621290c41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"
Jul 05 13:19:53.744581 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.744562    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4b50cef7-df02-40d2-a72b-2ed621290c41-hub\") pod \"cluster-proxy-proxy-agent-66696dfb57-h5snk\" (UID: \"4b50cef7-df02-40d2-a72b-2ed621290c41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"
Jul 05 13:19:53.744661 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.744618    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b50cef7-df02-40d2-a72b-2ed621290c41-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66696dfb57-h5snk\" (UID: \"4b50cef7-df02-40d2-a72b-2ed621290c41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"
Jul 05 13:19:53.776676 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.776592    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhtxk\" (UniqueName: \"kubernetes.io/projected/4b50cef7-df02-40d2-a72b-2ed621290c41-kube-api-access-nhtxk\") pod \"cluster-proxy-proxy-agent-66696dfb57-h5snk\" (UID: \"4b50cef7-df02-40d2-a72b-2ed621290c41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"
Jul 05 13:19:53.824786 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:53.824736    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"
Jul 05 13:19:54.102506 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:19:54.102476    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b50cef7_df02_40d2_a72b_2ed621290c41.slice/crio-9c45cd3e9cfe8f67965dd4d72d4dc9d1b16cabdd928f436b8cb5c07b8810cf10 WatchSource:0}: Error finding container 9c45cd3e9cfe8f67965dd4d72d4dc9d1b16cabdd928f436b8cb5c07b8810cf10: Status 404 returned error can't find the container with id 9c45cd3e9cfe8f67965dd4d72d4dc9d1b16cabdd928f436b8cb5c07b8810cf10
Jul 05 13:19:54.111087 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:54.111060    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk"]
Jul 05 13:19:54.260034 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:54.259996    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk" event={"ID":"4b50cef7-df02-40d2-a72b-2ed621290c41","Type":"ContainerStarted","Data":"9c45cd3e9cfe8f67965dd4d72d4dc9d1b16cabdd928f436b8cb5c07b8810cf10"}
Jul 05 13:19:54.261425 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:54.261398    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9k6px" event={"ID":"69b9856f-38ad-40b1-996e-2ce488db00b3","Type":"ContainerStarted","Data":"0fc41d1e18144fcf9f3d4ac5b55412aa180748a0d3aec49c5a31fab9f2564963"}
Jul 05 13:19:56.470761 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:56.470695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls\") pod \"dns-default-d28zj\" (UID: \"35b816f6-4b8c-4df8-b0f1-d51fc39569f5\") " pod="openshift-dns/dns-default-d28zj"
Jul 05 13:19:56.473937 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:56.473870    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35b816f6-4b8c-4df8-b0f1-d51fc39569f5-metrics-tls\") pod \"dns-default-d28zj\" (UID: \"35b816f6-4b8c-4df8-b0f1-d51fc39569f5\") " pod="openshift-dns/dns-default-d28zj"
Jul 05 13:19:56.725015 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:56.724914    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t7gnk\""
Jul 05 13:19:56.733237 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:56.733200    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d28zj"
Jul 05 13:19:59.173246 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:59.173205    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nnb8k"
Jul 05 13:19:59.891577 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:19:59.891556    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d28zj"]
Jul 05 13:19:59.900966 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:19:59.900930    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35b816f6_4b8c_4df8_b0f1_d51fc39569f5.slice/crio-5ce27a328672e3b83dff3b5e124cbee20d8f71788e67c2a715d0cac71ac48697 WatchSource:0}: Error finding container 5ce27a328672e3b83dff3b5e124cbee20d8f71788e67c2a715d0cac71ac48697: Status 404 returned error can't find the container with id 5ce27a328672e3b83dff3b5e124cbee20d8f71788e67c2a715d0cac71ac48697
Jul 05 13:20:00.290916 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:00.290816    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk" event={"ID":"4b50cef7-df02-40d2-a72b-2ed621290c41","Type":"ContainerStarted","Data":"7020a538c661c8f258f1eedd08f51dfab99fc70b2f30916698a073cf9cc91c9e"}
Jul 05 13:20:00.290916 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:00.290858    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk" event={"ID":"4b50cef7-df02-40d2-a72b-2ed621290c41","Type":"ContainerStarted","Data":"4cd379cc15dee5789c110218426c904cca01d84276baf4b99b1394b3966440d4"}
Jul 05 13:20:00.290916 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:00.290876    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk" event={"ID":"4b50cef7-df02-40d2-a72b-2ed621290c41","Type":"ContainerStarted","Data":"3370b07450654fb57a64e19791bdfb8a1de491d8f0f398377eea0d9657edfc99"}
Jul 05 13:20:00.292177 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:00.292149    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9k6px" event={"ID":"69b9856f-38ad-40b1-996e-2ce488db00b3","Type":"ContainerStarted","Data":"7766c34701cbc1dd6f13d0e9cd4a64960ac774aeb392bf33269134dfecfb09a5"}
Jul 05 13:20:00.293126 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:00.293106    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d28zj" event={"ID":"35b816f6-4b8c-4df8-b0f1-d51fc39569f5","Type":"ContainerStarted","Data":"5ce27a328672e3b83dff3b5e124cbee20d8f71788e67c2a715d0cac71ac48697"}
Jul 05 13:20:00.317627 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:00.317550    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66696dfb57-h5snk" podStartSLOduration=1.647242446 podStartE2EDuration="7.317526716s" totalImagesPullingTime="5.67028427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:00.315809595 +0000 UTC m=+103.133777554" watchObservedRunningTime="2026-07-05 13:20:00.317526716 +0000 UTC m=+103.135494674"
Jul 05 13:20:01.299021 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:01.298925    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9k6px" event={"ID":"69b9856f-38ad-40b1-996e-2ce488db00b3","Type":"ContainerStarted","Data":"baa942a40b4f6ce0d4124c529965482cf5c78a5cdebcc9f383da3dc3cde67925"}
Jul 05 13:20:02.305263 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:02.305221    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d28zj" event={"ID":"35b816f6-4b8c-4df8-b0f1-d51fc39569f5","Type":"ContainerStarted","Data":"9eb5f8d22b88ba363625ddc94f81ecb97807257d1e6374961d495377d603051d"}
Jul 05 13:20:02.305724 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:02.305292    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d28zj" event={"ID":"35b816f6-4b8c-4df8-b0f1-d51fc39569f5","Type":"ContainerStarted","Data":"b3a40733c7cdc1a8a37d1e4a9bbf2bc8b928a677611fe855db8e269f3414f3b1"}
Jul 05 13:20:02.306068 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:02.306051    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d28zj"
Jul 05 13:20:02.351245 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:02.351184    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-d28zj" podStartSLOduration=68.295793643 podStartE2EDuration="1m10.351162266s" totalImagesPullingTime="2.055368623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:18:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:02.350648629 +0000 UTC m=+105.168616618" watchObservedRunningTime="2026-07-05 13:20:02.351162266 +0000 UTC m=+105.169130225"
Jul 05 13:20:05.318580 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:05.318545    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9k6px" event={"ID":"69b9856f-38ad-40b1-996e-2ce488db00b3","Type":"ContainerStarted","Data":"9bcfb61d12661aea38c2047ce5a856e41866cf64253c7f571be776a4a63e1e3e"}
Jul 05 13:20:05.379614 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:05.379559    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9k6px" podStartSLOduration=33.768756455 podStartE2EDuration="44.379542236s" totalImagesPullingTime="10.610785781s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:19:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:05.37926955 +0000 UTC m=+108.197237511" watchObservedRunningTime="2026-07-05 13:20:05.379542236 +0000 UTC m=+108.197510192"
Jul 05 13:20:13.315360 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:13.315324    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d28zj"
Jul 05 13:20:13.622906 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:13.622878    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:20:16.086155 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.086122    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gpjqv"]
Jul 05 13:20:16.088762 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.088736    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.095108 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.095077    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8xvgv\""
Jul 05 13:20:16.095289 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.095107    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 05 13:20:16.095656 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.095387    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 05 13:20:16.095956 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.095937    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 05 13:20:16.097621 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.097603    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 05 13:20:16.133291 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.133247    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz2nh\" (UniqueName: \"kubernetes.io/projected/92188d56-7bf7-4ce6-a7a0-93aff69707ca-kube-api-access-pz2nh\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.133473 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.133295    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92188d56-7bf7-4ce6-a7a0-93aff69707ca-node-exporter-wtmp\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.133473 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.133369    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92188d56-7bf7-4ce6-a7a0-93aff69707ca-node-exporter-tls\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.133473 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.133388    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92188d56-7bf7-4ce6-a7a0-93aff69707ca-metrics-client-ca\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.133473 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.133411    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92188d56-7bf7-4ce6-a7a0-93aff69707ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.133625 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.133512    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92188d56-7bf7-4ce6-a7a0-93aff69707ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.133625 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.133559    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92188d56-7bf7-4ce6-a7a0-93aff69707ca-root\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.133625 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.133618    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92188d56-7bf7-4ce6-a7a0-93aff69707ca-sys\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.133758 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.133672    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92188d56-7bf7-4ce6-a7a0-93aff69707ca-node-exporter-textfile\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.234863 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.234828    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92188d56-7bf7-4ce6-a7a0-93aff69707ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.235109 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.234880    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92188d56-7bf7-4ce6-a7a0-93aff69707ca-root\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.235109 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.234922    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92188d56-7bf7-4ce6-a7a0-93aff69707ca-sys\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.235109 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.234946    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92188d56-7bf7-4ce6-a7a0-93aff69707ca-node-exporter-textfile\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.235109 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.234978    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz2nh\" (UniqueName: \"kubernetes.io/projected/92188d56-7bf7-4ce6-a7a0-93aff69707ca-kube-api-access-pz2nh\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.235109 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.235025    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92188d56-7bf7-4ce6-a7a0-93aff69707ca-root\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.235109 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.235054    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92188d56-7bf7-4ce6-a7a0-93aff69707ca-node-exporter-wtmp\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.235395 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.235117    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92188d56-7bf7-4ce6-a7a0-93aff69707ca-node-exporter-tls\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.235395 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.235138    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92188d56-7bf7-4ce6-a7a0-93aff69707ca-metrics-client-ca\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.235395 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.235034    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92188d56-7bf7-4ce6-a7a0-93aff69707ca-sys\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.235395 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.235163    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92188d56-7bf7-4ce6-a7a0-93aff69707ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.235395 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.235189    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92188d56-7bf7-4ce6-a7a0-93aff69707ca-node-exporter-wtmp\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.235395 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.235297    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92188d56-7bf7-4ce6-a7a0-93aff69707ca-node-exporter-textfile\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.235582 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.235459    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92188d56-7bf7-4ce6-a7a0-93aff69707ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.235680 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.235660    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92188d56-7bf7-4ce6-a7a0-93aff69707ca-metrics-client-ca\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.237550 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.237526    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92188d56-7bf7-4ce6-a7a0-93aff69707ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.237765 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.237741    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92188d56-7bf7-4ce6-a7a0-93aff69707ca-node-exporter-tls\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.259398 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.259370    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz2nh\" (UniqueName: \"kubernetes.io/projected/92188d56-7bf7-4ce6-a7a0-93aff69707ca-kube-api-access-pz2nh\") pod \"node-exporter-gpjqv\" (UID: \"92188d56-7bf7-4ce6-a7a0-93aff69707ca\") " pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.398174 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:16.398131    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gpjqv"
Jul 05 13:20:16.407442 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:20:16.407414    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92188d56_7bf7_4ce6_a7a0_93aff69707ca.slice/crio-7a694fb2a874cac11003ab001e6a1b0192c07fda589bde48a346aa9c1f9675f2 WatchSource:0}: Error finding container 7a694fb2a874cac11003ab001e6a1b0192c07fda589bde48a346aa9c1f9675f2: Status 404 returned error can't find the container with id 7a694fb2a874cac11003ab001e6a1b0192c07fda589bde48a346aa9c1f9675f2
Jul 05 13:20:17.357938 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:17.357901    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gpjqv" event={"ID":"92188d56-7bf7-4ce6-a7a0-93aff69707ca","Type":"ContainerStarted","Data":"30540e2e200ecd876828fc5ae7e8bd8843d30a81006659a84581d8c19e4a9898"}
Jul 05 13:20:17.358339 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:17.357975    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gpjqv" event={"ID":"92188d56-7bf7-4ce6-a7a0-93aff69707ca","Type":"ContainerStarted","Data":"7a694fb2a874cac11003ab001e6a1b0192c07fda589bde48a346aa9c1f9675f2"}
Jul 05 13:20:18.362496 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:18.362458    2565 generic.go:356] "Generic (PLEG): container finished" podID="92188d56-7bf7-4ce6-a7a0-93aff69707ca" containerID="30540e2e200ecd876828fc5ae7e8bd8843d30a81006659a84581d8c19e4a9898" exitCode=0
Jul 05 13:20:18.362900 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:18.362538    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gpjqv" event={"ID":"92188d56-7bf7-4ce6-a7a0-93aff69707ca","Type":"ContainerDied","Data":"30540e2e200ecd876828fc5ae7e8bd8843d30a81006659a84581d8c19e4a9898"}
Jul 05 13:20:18.637971 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:18.637864    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2" podUID="54f06856-ccc6-48ef-9c06-340b1a24f963" containerName="registry" containerID="cri-o://328bdcb8f224e52fb212bd8d2d51633e3e5a8fb3c4db56959f62f02bc654683e" gracePeriod=30
Jul 05 13:20:18.879503 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:18.879479    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:20:18.956005 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:18.955903    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54f06856-ccc6-48ef-9c06-340b1a24f963-image-registry-private-configuration\") pod \"54f06856-ccc6-48ef-9c06-340b1a24f963\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") "
Jul 05 13:20:18.956005 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:18.955957    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-certificates\") pod \"54f06856-ccc6-48ef-9c06-340b1a24f963\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") "
Jul 05 13:20:18.956005 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:18.955994    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls\") pod \"54f06856-ccc6-48ef-9c06-340b1a24f963\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") "
Jul 05 13:20:18.956299 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:18.956030    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98jjh\" (UniqueName: \"kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-kube-api-access-98jjh\") pod \"54f06856-ccc6-48ef-9c06-340b1a24f963\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") "
Jul 05 13:20:18.956299 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:18.956070    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-bound-sa-token\") pod \"54f06856-ccc6-48ef-9c06-340b1a24f963\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") "
Jul 05 13:20:18.956299 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:18.956123    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54f06856-ccc6-48ef-9c06-340b1a24f963-installation-pull-secrets\") pod \"54f06856-ccc6-48ef-9c06-340b1a24f963\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") "
Jul 05 13:20:18.956299 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:18.956194    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54f06856-ccc6-48ef-9c06-340b1a24f963-trusted-ca\") pod \"54f06856-ccc6-48ef-9c06-340b1a24f963\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") "
Jul 05 13:20:18.956299 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:18.956221    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54f06856-ccc6-48ef-9c06-340b1a24f963-ca-trust-extracted\") pod \"54f06856-ccc6-48ef-9c06-340b1a24f963\" (UID: \"54f06856-ccc6-48ef-9c06-340b1a24f963\") "
Jul 05 13:20:18.956553 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:18.956436    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "54f06856-ccc6-48ef-9c06-340b1a24f963" (UID: "54f06856-ccc6-48ef-9c06-340b1a24f963"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:20:18.957133 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:18.957090    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54f06856-ccc6-48ef-9c06-340b1a24f963-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "54f06856-ccc6-48ef-9c06-340b1a24f963" (UID: "54f06856-ccc6-48ef-9c06-340b1a24f963"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:20:18.959235 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:18.959206    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "54f06856-ccc6-48ef-9c06-340b1a24f963" (UID: "54f06856-ccc6-48ef-9c06-340b1a24f963"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:20:18.959444 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:18.959417    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-kube-api-access-98jjh" (OuterVolumeSpecName: "kube-api-access-98jjh") pod "54f06856-ccc6-48ef-9c06-340b1a24f963" (UID: "54f06856-ccc6-48ef-9c06-340b1a24f963"). InnerVolumeSpecName "kube-api-access-98jjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:20:18.959891 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:18.959859    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54f06856-ccc6-48ef-9c06-340b1a24f963-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "54f06856-ccc6-48ef-9c06-340b1a24f963" (UID: "54f06856-ccc6-48ef-9c06-340b1a24f963"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:20:18.960000 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:18.959897    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "54f06856-ccc6-48ef-9c06-340b1a24f963" (UID: "54f06856-ccc6-48ef-9c06-340b1a24f963"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:20:18.961335 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:18.961306    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54f06856-ccc6-48ef-9c06-340b1a24f963-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "54f06856-ccc6-48ef-9c06-340b1a24f963" (UID: "54f06856-ccc6-48ef-9c06-340b1a24f963"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:20:18.966982 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:18.966949    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54f06856-ccc6-48ef-9c06-340b1a24f963-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "54f06856-ccc6-48ef-9c06-340b1a24f963" (UID: "54f06856-ccc6-48ef-9c06-340b1a24f963"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:20:19.057151 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:19.057101    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-bound-sa-token\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:20:19.057151 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:19.057142    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54f06856-ccc6-48ef-9c06-340b1a24f963-installation-pull-secrets\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:20:19.057151 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:19.057156    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54f06856-ccc6-48ef-9c06-340b1a24f963-trusted-ca\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:20:19.057446 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:19.057169    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54f06856-ccc6-48ef-9c06-340b1a24f963-ca-trust-extracted\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:20:19.057446 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:19.057183    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54f06856-ccc6-48ef-9c06-340b1a24f963-image-registry-private-configuration\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:20:19.057446 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:19.057196    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-certificates\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:20:19.057446 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:19.057210    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-registry-tls\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:20:19.057446 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:19.057222    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98jjh\" (UniqueName: \"kubernetes.io/projected/54f06856-ccc6-48ef-9c06-340b1a24f963-kube-api-access-98jjh\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:20:19.366858 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:19.366814    2565 generic.go:356] "Generic (PLEG): container finished" podID="54f06856-ccc6-48ef-9c06-340b1a24f963" containerID="328bdcb8f224e52fb212bd8d2d51633e3e5a8fb3c4db56959f62f02bc654683e" exitCode=0
Jul 05 13:20:19.367334 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:19.366860    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2"
Jul 05 13:20:19.367334 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:19.366899    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2" event={"ID":"54f06856-ccc6-48ef-9c06-340b1a24f963","Type":"ContainerDied","Data":"328bdcb8f224e52fb212bd8d2d51633e3e5a8fb3c4db56959f62f02bc654683e"}
Jul 05 13:20:19.367334 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:19.366953    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bb8874f4b-crpk2" event={"ID":"54f06856-ccc6-48ef-9c06-340b1a24f963","Type":"ContainerDied","Data":"8e79ddb99b9e2a85fee43ccff4d37896682a10716b1a4ae69f8460f0e00b24e1"}
Jul 05 13:20:19.367334 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:19.366979    2565 scope.go:117] "RemoveContainer" containerID="328bdcb8f224e52fb212bd8d2d51633e3e5a8fb3c4db56959f62f02bc654683e"
Jul 05 13:20:19.369448 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:19.369426    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gpjqv" event={"ID":"92188d56-7bf7-4ce6-a7a0-93aff69707ca","Type":"ContainerStarted","Data":"2b2f3949c1dc243b5d3a40beee909b434bedd15c8d137f7625f6a0ab6404f629"}
Jul 05 13:20:19.369578 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:19.369468    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gpjqv" event={"ID":"92188d56-7bf7-4ce6-a7a0-93aff69707ca","Type":"ContainerStarted","Data":"26e1f488c859ea63cd04e2b440b657538cf5e5b2baf9029d778520a1193a34d4"}
Jul 05 13:20:19.375415 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:19.375395    2565 scope.go:117] "RemoveContainer" containerID="328bdcb8f224e52fb212bd8d2d51633e3e5a8fb3c4db56959f62f02bc654683e"
Jul 05 13:20:19.375755 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:20:19.375729    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"328bdcb8f224e52fb212bd8d2d51633e3e5a8fb3c4db56959f62f02bc654683e\": container with ID starting with 328bdcb8f224e52fb212bd8d2d51633e3e5a8fb3c4db56959f62f02bc654683e not found: ID does not exist" containerID="328bdcb8f224e52fb212bd8d2d51633e3e5a8fb3c4db56959f62f02bc654683e"
Jul 05 13:20:19.375834 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:19.375773    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"328bdcb8f224e52fb212bd8d2d51633e3e5a8fb3c4db56959f62f02bc654683e"} err="failed to get container status \"328bdcb8f224e52fb212bd8d2d51633e3e5a8fb3c4db56959f62f02bc654683e\": rpc error: code = NotFound desc = could not find container \"328bdcb8f224e52fb212bd8d2d51633e3e5a8fb3c4db56959f62f02bc654683e\": container with ID starting with 328bdcb8f224e52fb212bd8d2d51633e3e5a8fb3c4db56959f62f02bc654683e not found: ID does not exist"
Jul 05 13:20:19.410421 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:19.410362    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gpjqv" podStartSLOduration=2.461444276 podStartE2EDuration="3.410343182s" totalImagesPullingTime="880.717462ms" totalInitContainerRuntime="68.181444ms" isStatefulPod=true podCreationTimestamp="2026-07-05 13:20:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:19.409786728 +0000 UTC m=+122.227754705" watchObservedRunningTime="2026-07-05 13:20:19.410343182 +0000 UTC m=+122.228311157"
Jul 05 13:20:19.451027 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:19.450994    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bb8874f4b-crpk2"]
Jul 05 13:20:19.466525 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:19.466494    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bb8874f4b-crpk2"]
Jul 05 13:20:19.739663 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:19.739562    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54f06856-ccc6-48ef-9c06-340b1a24f963" path="/var/lib/kubelet/pods/54f06856-ccc6-48ef-9c06-340b1a24f963/volumes"
Jul 05 13:20:20.614394 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.614350    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-22s4g"]
Jul 05 13:20:20.614892 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.614731    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54f06856-ccc6-48ef-9c06-340b1a24f963" containerName="registry"
Jul 05 13:20:20.614892 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.614748    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="54f06856-ccc6-48ef-9c06-340b1a24f963" containerName="registry"
Jul 05 13:20:20.614892 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.614824    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="54f06856-ccc6-48ef-9c06-340b1a24f963" containerName="registry"
Jul 05 13:20:20.621820 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.621790    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-22s4g"
Jul 05 13:20:20.624324 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.624296    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 05 13:20:20.624645 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.624610    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hxg46\""
Jul 05 13:20:20.629485 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.629458    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-22s4g"]
Jul 05 13:20:20.651510 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.651470    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-66559985c7-scwp2"]
Jul 05 13:20:20.655190 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.655160    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:20.658185 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.658154    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 05 13:20:20.658526 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.658504    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 05 13:20:20.658705 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.658676    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-c2jrm\""
Jul 05 13:20:20.658875 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.658851    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-21mkiqoat121u\""
Jul 05 13:20:20.658875 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.658860    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 05 13:20:20.659294 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.659278    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 05 13:20:20.671797 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.671767    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66559985c7-scwp2"]
Jul 05 13:20:20.673808 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.673779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6zkz\" (UniqueName: \"kubernetes.io/projected/d4e7f0ba-4a2c-4f5f-9164-7490215eb010-kube-api-access-l6zkz\") pod \"monitoring-plugin-d5dcff7cf-22s4g\" (UID: \"d4e7f0ba-4a2c-4f5f-9164-7490215eb010\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-22s4g"
Jul 05 13:20:20.673959 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.673821    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4e7f0ba-4a2c-4f5f-9164-7490215eb010-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-22s4g\" (UID: \"d4e7f0ba-4a2c-4f5f-9164-7490215eb010\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-22s4g"
Jul 05 13:20:20.774717 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.774615    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae16044f-cbe4-42b8-bfbc-5cee0ac9750e-client-ca-bundle\") pod \"metrics-server-66559985c7-scwp2\" (UID: \"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e\") " pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:20.774931 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.774759    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6zkz\" (UniqueName: \"kubernetes.io/projected/d4e7f0ba-4a2c-4f5f-9164-7490215eb010-kube-api-access-l6zkz\") pod \"monitoring-plugin-d5dcff7cf-22s4g\" (UID: \"d4e7f0ba-4a2c-4f5f-9164-7490215eb010\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-22s4g"
Jul 05 13:20:20.774931 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.774793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae16044f-cbe4-42b8-bfbc-5cee0ac9750e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66559985c7-scwp2\" (UID: \"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e\") " pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:20.774931 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.774825    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4e7f0ba-4a2c-4f5f-9164-7490215eb010-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-22s4g\" (UID: \"d4e7f0ba-4a2c-4f5f-9164-7490215eb010\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-22s4g"
Jul 05 13:20:20.775071 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.774933    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n64x\" (UniqueName: \"kubernetes.io/projected/ae16044f-cbe4-42b8-bfbc-5cee0ac9750e-kube-api-access-9n64x\") pod \"metrics-server-66559985c7-scwp2\" (UID: \"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e\") " pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:20.775071 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.774961    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ae16044f-cbe4-42b8-bfbc-5cee0ac9750e-secret-metrics-server-client-certs\") pod \"metrics-server-66559985c7-scwp2\" (UID: \"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e\") " pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:20.775071 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:20:20.774968    2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 05 13:20:20.775071 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.774997    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ae16044f-cbe4-42b8-bfbc-5cee0ac9750e-audit-log\") pod \"metrics-server-66559985c7-scwp2\" (UID: \"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e\") " pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:20.775071 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:20:20.775036    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4e7f0ba-4a2c-4f5f-9164-7490215eb010-monitoring-plugin-cert podName:d4e7f0ba-4a2c-4f5f-9164-7490215eb010 nodeName:}" failed. No retries permitted until 2026-07-05 13:20:21.275013729 +0000 UTC m=+124.092981665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/d4e7f0ba-4a2c-4f5f-9164-7490215eb010-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-22s4g" (UID: "d4e7f0ba-4a2c-4f5f-9164-7490215eb010") : secret "monitoring-plugin-cert" not found
Jul 05 13:20:20.775280 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.775150    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ae16044f-cbe4-42b8-bfbc-5cee0ac9750e-metrics-server-audit-profiles\") pod \"metrics-server-66559985c7-scwp2\" (UID: \"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e\") " pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:20.775280 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.775198    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ae16044f-cbe4-42b8-bfbc-5cee0ac9750e-secret-metrics-server-tls\") pod \"metrics-server-66559985c7-scwp2\" (UID: \"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e\") " pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:20.783590 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.783552    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6zkz\" (UniqueName: \"kubernetes.io/projected/d4e7f0ba-4a2c-4f5f-9164-7490215eb010-kube-api-access-l6zkz\") pod \"monitoring-plugin-d5dcff7cf-22s4g\" (UID: \"d4e7f0ba-4a2c-4f5f-9164-7490215eb010\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-22s4g"
Jul 05 13:20:20.875910 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.875816    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ae16044f-cbe4-42b8-bfbc-5cee0ac9750e-metrics-server-audit-profiles\") pod \"metrics-server-66559985c7-scwp2\" (UID: \"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e\") " pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:20.875910 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.875855    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ae16044f-cbe4-42b8-bfbc-5cee0ac9750e-secret-metrics-server-tls\") pod \"metrics-server-66559985c7-scwp2\" (UID: \"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e\") " pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:20.875910 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.875900    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae16044f-cbe4-42b8-bfbc-5cee0ac9750e-client-ca-bundle\") pod \"metrics-server-66559985c7-scwp2\" (UID: \"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e\") " pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:20.876137 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.875922    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae16044f-cbe4-42b8-bfbc-5cee0ac9750e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66559985c7-scwp2\" (UID: \"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e\") " pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:20.876137 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.875951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n64x\" (UniqueName: \"kubernetes.io/projected/ae16044f-cbe4-42b8-bfbc-5cee0ac9750e-kube-api-access-9n64x\") pod \"metrics-server-66559985c7-scwp2\" (UID: \"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e\") " pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:20.876137 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.876104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ae16044f-cbe4-42b8-bfbc-5cee0ac9750e-secret-metrics-server-client-certs\") pod \"metrics-server-66559985c7-scwp2\" (UID: \"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e\") " pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:20.876278 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.876145    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ae16044f-cbe4-42b8-bfbc-5cee0ac9750e-audit-log\") pod \"metrics-server-66559985c7-scwp2\" (UID: \"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e\") " pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:20.876561 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.876533    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ae16044f-cbe4-42b8-bfbc-5cee0ac9750e-audit-log\") pod \"metrics-server-66559985c7-scwp2\" (UID: \"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e\") " pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:20.876766 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.876745    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae16044f-cbe4-42b8-bfbc-5cee0ac9750e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66559985c7-scwp2\" (UID: \"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e\") " pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:20.877115 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.877091    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ae16044f-cbe4-42b8-bfbc-5cee0ac9750e-metrics-server-audit-profiles\") pod \"metrics-server-66559985c7-scwp2\" (UID: \"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e\") " pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:20.878447 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.878424    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ae16044f-cbe4-42b8-bfbc-5cee0ac9750e-client-ca-bundle\") pod \"metrics-server-66559985c7-scwp2\" (UID: \"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e\") " pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:20.878558 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.878541    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ae16044f-cbe4-42b8-bfbc-5cee0ac9750e-secret-metrics-server-client-certs\") pod \"metrics-server-66559985c7-scwp2\" (UID: \"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e\") " pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:20.878610 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.878559    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ae16044f-cbe4-42b8-bfbc-5cee0ac9750e-secret-metrics-server-tls\") pod \"metrics-server-66559985c7-scwp2\" (UID: \"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e\") " pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:20.884924 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.884897    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n64x\" (UniqueName: \"kubernetes.io/projected/ae16044f-cbe4-42b8-bfbc-5cee0ac9750e-kube-api-access-9n64x\") pod \"metrics-server-66559985c7-scwp2\" (UID: \"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e\") " pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:20.964040 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:20.963995    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:21.099657 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:21.099606    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66559985c7-scwp2"]
Jul 05 13:20:21.103206 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:20:21.103184    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae16044f_cbe4_42b8_bfbc_5cee0ac9750e.slice/crio-2827cfe778e5a82a0d7417d4b983560413e1d7530fd9affda8277adaa4ff316d WatchSource:0}: Error finding container 2827cfe778e5a82a0d7417d4b983560413e1d7530fd9affda8277adaa4ff316d: Status 404 returned error can't find the container with id 2827cfe778e5a82a0d7417d4b983560413e1d7530fd9affda8277adaa4ff316d
Jul 05 13:20:21.278695 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:21.278605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4e7f0ba-4a2c-4f5f-9164-7490215eb010-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-22s4g\" (UID: \"d4e7f0ba-4a2c-4f5f-9164-7490215eb010\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-22s4g"
Jul 05 13:20:21.281047 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:21.281018    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d4e7f0ba-4a2c-4f5f-9164-7490215eb010-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-22s4g\" (UID: \"d4e7f0ba-4a2c-4f5f-9164-7490215eb010\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-22s4g"
Jul 05 13:20:21.378782 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:21.378747    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66559985c7-scwp2" event={"ID":"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e","Type":"ContainerStarted","Data":"2827cfe778e5a82a0d7417d4b983560413e1d7530fd9affda8277adaa4ff316d"}
Jul 05 13:20:21.531830 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:21.531739    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-22s4g"
Jul 05 13:20:21.688685 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:21.688649    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-22s4g"]
Jul 05 13:20:21.692365 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:20:21.692334    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e7f0ba_4a2c_4f5f_9164_7490215eb010.slice/crio-8fba5b12f4e4b542c6f202aef95a061561893e0fb02d5c8d2f16ec760104ce08 WatchSource:0}: Error finding container 8fba5b12f4e4b542c6f202aef95a061561893e0fb02d5c8d2f16ec760104ce08: Status 404 returned error can't find the container with id 8fba5b12f4e4b542c6f202aef95a061561893e0fb02d5c8d2f16ec760104ce08
Jul 05 13:20:22.385042 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:22.385008    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-22s4g" event={"ID":"d4e7f0ba-4a2c-4f5f-9164-7490215eb010","Type":"ContainerStarted","Data":"8fba5b12f4e4b542c6f202aef95a061561893e0fb02d5c8d2f16ec760104ce08"}
Jul 05 13:20:23.390010 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:23.389969    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66559985c7-scwp2" event={"ID":"ae16044f-cbe4-42b8-bfbc-5cee0ac9750e","Type":"ContainerStarted","Data":"bf9cb48dca500f967fc64b70a7e571180ff46eb6a7ac38725a51100d828ad700"}
Jul 05 13:20:23.391482 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:23.391456    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-22s4g" event={"ID":"d4e7f0ba-4a2c-4f5f-9164-7490215eb010","Type":"ContainerStarted","Data":"d73a42d112eaa0877ff33957639597b99ace09c43b23f5b5e7e15a4c330f4cf3"}
Jul 05 13:20:23.391645 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:23.391612    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-22s4g"
Jul 05 13:20:23.396369 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:23.396349    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-22s4g"
Jul 05 13:20:23.411846 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:23.411792    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-66559985c7-scwp2" podStartSLOduration=2.177034294 podStartE2EDuration="3.411774125s" totalImagesPullingTime="1.234739831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:23.409937052 +0000 UTC m=+126.227905010" watchObservedRunningTime="2026-07-05 13:20:23.411774125 +0000 UTC m=+126.229742093"
Jul 05 13:20:23.436615 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:23.436559    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-22s4g" podStartSLOduration=2.053893183 podStartE2EDuration="3.436544471s" totalImagesPullingTime="1.382651288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:23.436234455 +0000 UTC m=+126.254202428" watchObservedRunningTime="2026-07-05 13:20:23.436544471 +0000 UTC m=+126.254512479"
Jul 05 13:20:26.523022 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:26.522969    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs\") pod \"network-metrics-daemon-rlllr\" (UID: \"65ca969d-9b3d-4379-a220-fff11397bef6\") " pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:20:26.525304 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:26.525283    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65ca969d-9b3d-4379-a220-fff11397bef6-metrics-certs\") pod \"network-metrics-daemon-rlllr\" (UID: \"65ca969d-9b3d-4379-a220-fff11397bef6\") " pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:20:26.660380 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:26.660340    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sq7qg\""
Jul 05 13:20:26.668712 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:26.668678    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlllr"
Jul 05 13:20:26.801711 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:26.801687    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rlllr"]
Jul 05 13:20:26.804048 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:20:26.804018    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ca969d_9b3d_4379_a220_fff11397bef6.slice/crio-06adbf2e618ece161f4647a62d06eee88a39e46655f73eceab315dd6458253d1 WatchSource:0}: Error finding container 06adbf2e618ece161f4647a62d06eee88a39e46655f73eceab315dd6458253d1: Status 404 returned error can't find the container with id 06adbf2e618ece161f4647a62d06eee88a39e46655f73eceab315dd6458253d1
Jul 05 13:20:27.407519 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:27.407487    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rlllr" event={"ID":"65ca969d-9b3d-4379-a220-fff11397bef6","Type":"ContainerStarted","Data":"06adbf2e618ece161f4647a62d06eee88a39e46655f73eceab315dd6458253d1"}
Jul 05 13:20:28.412243 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:28.412200    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rlllr" event={"ID":"65ca969d-9b3d-4379-a220-fff11397bef6","Type":"ContainerStarted","Data":"301ec6d1885b8bc3358650495ef6b6749bd60fc3d88b2ea75c75ab246a8a9f33"}
Jul 05 13:20:28.412723 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:28.412256    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rlllr" event={"ID":"65ca969d-9b3d-4379-a220-fff11397bef6","Type":"ContainerStarted","Data":"f47894670e30eeab2691359b60161f8be7a203af39dadab02e3155e1d6ef74e7"}
Jul 05 13:20:28.429256 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:28.429200    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rlllr" podStartSLOduration=130.414787069 podStartE2EDuration="2m11.429180307s" totalImagesPullingTime="1.014393238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:28.428194274 +0000 UTC m=+131.246162251" watchObservedRunningTime="2026-07-05 13:20:28.429180307 +0000 UTC m=+131.247148269"
Jul 05 13:20:40.964128 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:40.964088    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:40.964537 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:40.964157    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:20:50.489145 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:50.489108    2565 generic.go:356] "Generic (PLEG): container finished" podID="6b02bb25-5475-4e7d-b02f-d89a084096cb" containerID="5eaad92c48119518893562f11b95de202191bed5c1bac8d95160358f8aa4676b" exitCode=0
Jul 05 13:20:50.489528 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:50.489185    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xxj2g" event={"ID":"6b02bb25-5475-4e7d-b02f-d89a084096cb","Type":"ContainerDied","Data":"5eaad92c48119518893562f11b95de202191bed5c1bac8d95160358f8aa4676b"}
Jul 05 13:20:50.489528 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:50.489510    2565 scope.go:117] "RemoveContainer" containerID="5eaad92c48119518893562f11b95de202191bed5c1bac8d95160358f8aa4676b"
Jul 05 13:20:51.494804 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:20:51.494762    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xxj2g" event={"ID":"6b02bb25-5475-4e7d-b02f-d89a084096cb","Type":"ContainerStarted","Data":"ad3d27e2e66958ffb9e3c3976c91d5853f28f3fdab7de2e44e3e82afe402ccf5"}
Jul 05 13:21:00.970218 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:21:00.970183    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:21:00.974226 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:21:00.974198    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-66559985c7-scwp2"
Jul 05 13:23:17.556177 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:23:17.556149    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/1.log"
Jul 05 13:23:17.556659 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:23:17.556204    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/1.log"
Jul 05 13:23:17.562679 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:23:17.562656    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xj7gc_6c7ce124-8975-400e-9f0b-2527ee19af46/ovn-acl-logging/0.log"
Jul 05 13:23:17.562844 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:23:17.562655    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xj7gc_6c7ce124-8975-400e-9f0b-2527ee19af46/ovn-acl-logging/0.log"
Jul 05 13:23:17.568243 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:23:17.568220    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 05 13:24:07.190236 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:07.190195    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq"]
Jul 05 13:24:07.193424 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:07.193402    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq"
Jul 05 13:24:07.199045 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:07.199015    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 05 13:24:07.199206 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:07.199061    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8h2q5\""
Jul 05 13:24:07.200032 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:07.200012    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 05 13:24:07.230426 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:07.230391    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq"]
Jul 05 13:24:07.286396 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:07.286356    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4jg2\" (UniqueName: \"kubernetes.io/projected/6caa73e0-9ee2-4e44-a710-3039b0809fc2-kube-api-access-n4jg2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq\" (UID: \"6caa73e0-9ee2-4e44-a710-3039b0809fc2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq"
Jul 05 13:24:07.286594 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:07.286425    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6caa73e0-9ee2-4e44-a710-3039b0809fc2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq\" (UID: \"6caa73e0-9ee2-4e44-a710-3039b0809fc2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq"
Jul 05 13:24:07.286594 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:07.286471    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6caa73e0-9ee2-4e44-a710-3039b0809fc2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq\" (UID: \"6caa73e0-9ee2-4e44-a710-3039b0809fc2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq"
Jul 05 13:24:07.387443 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:07.387407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4jg2\" (UniqueName: \"kubernetes.io/projected/6caa73e0-9ee2-4e44-a710-3039b0809fc2-kube-api-access-n4jg2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq\" (UID: \"6caa73e0-9ee2-4e44-a710-3039b0809fc2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq"
Jul 05 13:24:07.387616 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:07.387450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6caa73e0-9ee2-4e44-a710-3039b0809fc2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq\" (UID: \"6caa73e0-9ee2-4e44-a710-3039b0809fc2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq"
Jul 05 13:24:07.387616 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:07.387478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6caa73e0-9ee2-4e44-a710-3039b0809fc2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq\" (UID: \"6caa73e0-9ee2-4e44-a710-3039b0809fc2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq"
Jul 05 13:24:07.387849 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:07.387833    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6caa73e0-9ee2-4e44-a710-3039b0809fc2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq\" (UID: \"6caa73e0-9ee2-4e44-a710-3039b0809fc2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq"
Jul 05 13:24:07.387921 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:07.387900    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6caa73e0-9ee2-4e44-a710-3039b0809fc2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq\" (UID: \"6caa73e0-9ee2-4e44-a710-3039b0809fc2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq"
Jul 05 13:24:07.398945 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:07.398920    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4jg2\" (UniqueName: \"kubernetes.io/projected/6caa73e0-9ee2-4e44-a710-3039b0809fc2-kube-api-access-n4jg2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq\" (UID: \"6caa73e0-9ee2-4e44-a710-3039b0809fc2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq"
Jul 05 13:24:07.503030 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:07.502943    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq"
Jul 05 13:24:07.651488 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:07.651406    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq"]
Jul 05 13:24:07.656197 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:24:07.656164    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6caa73e0_9ee2_4e44_a710_3039b0809fc2.slice/crio-a407334af0a8b0d60e866c39a53e4166cda01894b23d949de7ea3b08c8338617 WatchSource:0}: Error finding container a407334af0a8b0d60e866c39a53e4166cda01894b23d949de7ea3b08c8338617: Status 404 returned error can't find the container with id a407334af0a8b0d60e866c39a53e4166cda01894b23d949de7ea3b08c8338617
Jul 05 13:24:07.658226 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:07.658209    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 13:24:08.178779 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:08.178733    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq" event={"ID":"6caa73e0-9ee2-4e44-a710-3039b0809fc2","Type":"ContainerStarted","Data":"a407334af0a8b0d60e866c39a53e4166cda01894b23d949de7ea3b08c8338617"}
Jul 05 13:24:14.205451 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:14.205414    2565 generic.go:356] "Generic (PLEG): container finished" podID="6caa73e0-9ee2-4e44-a710-3039b0809fc2" containerID="020a2f24e34726962b6d8caaa74c02e827cd774f09d5425ce885f442fa7b0590" exitCode=0
Jul 05 13:24:14.205876 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:14.205506    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq" event={"ID":"6caa73e0-9ee2-4e44-a710-3039b0809fc2","Type":"ContainerDied","Data":"020a2f24e34726962b6d8caaa74c02e827cd774f09d5425ce885f442fa7b0590"}
Jul 05 13:24:16.216860 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:16.216764    2565 generic.go:356] "Generic (PLEG): container finished" podID="6caa73e0-9ee2-4e44-a710-3039b0809fc2" containerID="2f9f45bfd3105d82cb3fce2615e2703d3cfd8311f8369fe96ef5916c85702992" exitCode=0
Jul 05 13:24:16.216860 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:16.216798    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq" event={"ID":"6caa73e0-9ee2-4e44-a710-3039b0809fc2","Type":"ContainerDied","Data":"2f9f45bfd3105d82cb3fce2615e2703d3cfd8311f8369fe96ef5916c85702992"}
Jul 05 13:24:23.246330 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:23.246286    2565 generic.go:356] "Generic (PLEG): container finished" podID="6caa73e0-9ee2-4e44-a710-3039b0809fc2" containerID="1aa0718b1714d729478481e3151b2ee0b8ec6bfae0a10aa7c0b1980d277c0aff" exitCode=0
Jul 05 13:24:23.246758 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:23.246362    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq" event={"ID":"6caa73e0-9ee2-4e44-a710-3039b0809fc2","Type":"ContainerDied","Data":"1aa0718b1714d729478481e3151b2ee0b8ec6bfae0a10aa7c0b1980d277c0aff"}
Jul 05 13:24:24.371963 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:24.371938    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq"
Jul 05 13:24:24.533474 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:24.533386    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6caa73e0-9ee2-4e44-a710-3039b0809fc2-util\") pod \"6caa73e0-9ee2-4e44-a710-3039b0809fc2\" (UID: \"6caa73e0-9ee2-4e44-a710-3039b0809fc2\") "
Jul 05 13:24:24.533474 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:24.533439    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6caa73e0-9ee2-4e44-a710-3039b0809fc2-bundle\") pod \"6caa73e0-9ee2-4e44-a710-3039b0809fc2\" (UID: \"6caa73e0-9ee2-4e44-a710-3039b0809fc2\") "
Jul 05 13:24:24.533474 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:24.533473    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4jg2\" (UniqueName: \"kubernetes.io/projected/6caa73e0-9ee2-4e44-a710-3039b0809fc2-kube-api-access-n4jg2\") pod \"6caa73e0-9ee2-4e44-a710-3039b0809fc2\" (UID: \"6caa73e0-9ee2-4e44-a710-3039b0809fc2\") "
Jul 05 13:24:24.534145 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:24.534112    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6caa73e0-9ee2-4e44-a710-3039b0809fc2-bundle" (OuterVolumeSpecName: "bundle") pod "6caa73e0-9ee2-4e44-a710-3039b0809fc2" (UID: "6caa73e0-9ee2-4e44-a710-3039b0809fc2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:24:24.535694 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:24.535661    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6caa73e0-9ee2-4e44-a710-3039b0809fc2-kube-api-access-n4jg2" (OuterVolumeSpecName: "kube-api-access-n4jg2") pod "6caa73e0-9ee2-4e44-a710-3039b0809fc2" (UID: "6caa73e0-9ee2-4e44-a710-3039b0809fc2"). InnerVolumeSpecName "kube-api-access-n4jg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:24:24.537279 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:24.537256    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6caa73e0-9ee2-4e44-a710-3039b0809fc2-util" (OuterVolumeSpecName: "util") pod "6caa73e0-9ee2-4e44-a710-3039b0809fc2" (UID: "6caa73e0-9ee2-4e44-a710-3039b0809fc2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:24:24.634239 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:24.634197    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4jg2\" (UniqueName: \"kubernetes.io/projected/6caa73e0-9ee2-4e44-a710-3039b0809fc2-kube-api-access-n4jg2\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:24:24.634239 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:24.634232    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6caa73e0-9ee2-4e44-a710-3039b0809fc2-util\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:24:24.634239 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:24.634242    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6caa73e0-9ee2-4e44-a710-3039b0809fc2-bundle\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:24:25.254973 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:25.254946    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq"
Jul 05 13:24:25.255144 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:25.254945    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bg6rq" event={"ID":"6caa73e0-9ee2-4e44-a710-3039b0809fc2","Type":"ContainerDied","Data":"a407334af0a8b0d60e866c39a53e4166cda01894b23d949de7ea3b08c8338617"}
Jul 05 13:24:25.255144 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:25.255064    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a407334af0a8b0d60e866c39a53e4166cda01894b23d949de7ea3b08c8338617"
Jul 05 13:24:32.512925 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:32.512893    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nn784"]
Jul 05 13:24:32.513401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:32.513136    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6caa73e0-9ee2-4e44-a710-3039b0809fc2" containerName="util"
Jul 05 13:24:32.513401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:32.513149    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6caa73e0-9ee2-4e44-a710-3039b0809fc2" containerName="util"
Jul 05 13:24:32.513401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:32.513162    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6caa73e0-9ee2-4e44-a710-3039b0809fc2" containerName="extract"
Jul 05 13:24:32.513401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:32.513171    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6caa73e0-9ee2-4e44-a710-3039b0809fc2" containerName="extract"
Jul 05 13:24:32.513401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:32.513193    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6caa73e0-9ee2-4e44-a710-3039b0809fc2" containerName="pull"
Jul 05 13:24:32.513401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:32.513199    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6caa73e0-9ee2-4e44-a710-3039b0809fc2" containerName="pull"
Jul 05 13:24:32.513401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:32.513242    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6caa73e0-9ee2-4e44-a710-3039b0809fc2" containerName="extract"
Jul 05 13:24:32.516439 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:32.516420    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nn784"
Jul 05 13:24:32.525605 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:32.525571    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 05 13:24:32.525943 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:32.525923    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 05 13:24:32.526250 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:32.526232    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mpdr9\""
Jul 05 13:24:32.554414 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:32.554379    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nn784"]
Jul 05 13:24:32.593784 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:32.593748    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df2fd941-bcda-4ca9-809f-87ff9987e97b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nn784\" (UID: \"df2fd941-bcda-4ca9-809f-87ff9987e97b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nn784"
Jul 05 13:24:32.593964 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:32.593800    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sb5b\" (UniqueName: \"kubernetes.io/projected/df2fd941-bcda-4ca9-809f-87ff9987e97b-kube-api-access-5sb5b\") pod \"cert-manager-operator-controller-manager-55c444bf86-nn784\" (UID: \"df2fd941-bcda-4ca9-809f-87ff9987e97b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nn784"
Jul 05 13:24:32.694685 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:32.694625    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sb5b\" (UniqueName: \"kubernetes.io/projected/df2fd941-bcda-4ca9-809f-87ff9987e97b-kube-api-access-5sb5b\") pod \"cert-manager-operator-controller-manager-55c444bf86-nn784\" (UID: \"df2fd941-bcda-4ca9-809f-87ff9987e97b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nn784"
Jul 05 13:24:32.694850 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:32.694719    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df2fd941-bcda-4ca9-809f-87ff9987e97b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nn784\" (UID: \"df2fd941-bcda-4ca9-809f-87ff9987e97b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nn784"
Jul 05 13:24:32.695056 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:32.695041    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df2fd941-bcda-4ca9-809f-87ff9987e97b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nn784\" (UID: \"df2fd941-bcda-4ca9-809f-87ff9987e97b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nn784"
Jul 05 13:24:32.710114 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:32.710081    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sb5b\" (UniqueName: \"kubernetes.io/projected/df2fd941-bcda-4ca9-809f-87ff9987e97b-kube-api-access-5sb5b\") pod \"cert-manager-operator-controller-manager-55c444bf86-nn784\" (UID: \"df2fd941-bcda-4ca9-809f-87ff9987e97b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nn784"
Jul 05 13:24:32.826960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:32.826865    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nn784"
Jul 05 13:24:32.988527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:32.988492    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nn784"]
Jul 05 13:24:32.991937 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:24:32.991900    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf2fd941_bcda_4ca9_809f_87ff9987e97b.slice/crio-1db440fa3b0bdc5f63404baee773d6917e0e094b39506f9acfbac5ddf9830a87 WatchSource:0}: Error finding container 1db440fa3b0bdc5f63404baee773d6917e0e094b39506f9acfbac5ddf9830a87: Status 404 returned error can't find the container with id 1db440fa3b0bdc5f63404baee773d6917e0e094b39506f9acfbac5ddf9830a87
Jul 05 13:24:33.284839 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:33.284806    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nn784" event={"ID":"df2fd941-bcda-4ca9-809f-87ff9987e97b","Type":"ContainerStarted","Data":"1db440fa3b0bdc5f63404baee773d6917e0e094b39506f9acfbac5ddf9830a87"}
Jul 05 13:24:35.294924 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:35.294888    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nn784" event={"ID":"df2fd941-bcda-4ca9-809f-87ff9987e97b","Type":"ContainerStarted","Data":"b6381ac4cb4be2843f3b7e605ec412b3137c62ed8eae2bde5e860d54bd292fda"}
Jul 05 13:24:35.333978 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:35.333918    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nn784" podStartSLOduration=1.935752474 podStartE2EDuration="3.333898186s" totalImagesPullingTime="1.398145712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:24:35.332846399 +0000 UTC m=+378.150814356" watchObservedRunningTime="2026-07-05 13:24:35.333898186 +0000 UTC m=+378.151866155"
Jul 05 13:24:36.477259 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:36.477222    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr"]
Jul 05 13:24:36.480679 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:36.480658    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr"
Jul 05 13:24:36.486024 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:36.485996    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8h2q5\""
Jul 05 13:24:36.486790 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:36.486765    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 05 13:24:36.488397 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:36.488374    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 05 13:24:36.503584 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:36.503547    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr"]
Jul 05 13:24:36.631004 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:36.630963    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzhdt\" (UniqueName: \"kubernetes.io/projected/e8582dc5-114f-42bf-8fe2-3884987a0cea-kube-api-access-wzhdt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr\" (UID: \"e8582dc5-114f-42bf-8fe2-3884987a0cea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr"
Jul 05 13:24:36.631004 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:36.631007    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8582dc5-114f-42bf-8fe2-3884987a0cea-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr\" (UID: \"e8582dc5-114f-42bf-8fe2-3884987a0cea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr"
Jul 05 13:24:36.631238 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:36.631043    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8582dc5-114f-42bf-8fe2-3884987a0cea-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr\" (UID: \"e8582dc5-114f-42bf-8fe2-3884987a0cea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr"
Jul 05 13:24:36.732409 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:36.732303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8582dc5-114f-42bf-8fe2-3884987a0cea-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr\" (UID: \"e8582dc5-114f-42bf-8fe2-3884987a0cea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr"
Jul 05 13:24:36.732409 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:36.732377    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzhdt\" (UniqueName: \"kubernetes.io/projected/e8582dc5-114f-42bf-8fe2-3884987a0cea-kube-api-access-wzhdt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr\" (UID: \"e8582dc5-114f-42bf-8fe2-3884987a0cea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr"
Jul 05 13:24:36.732409 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:36.732402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8582dc5-114f-42bf-8fe2-3884987a0cea-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr\" (UID: \"e8582dc5-114f-42bf-8fe2-3884987a0cea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr"
Jul 05 13:24:36.732815 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:36.732792    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8582dc5-114f-42bf-8fe2-3884987a0cea-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr\" (UID: \"e8582dc5-114f-42bf-8fe2-3884987a0cea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr"
Jul 05 13:24:36.732890 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:36.732818    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8582dc5-114f-42bf-8fe2-3884987a0cea-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr\" (UID: \"e8582dc5-114f-42bf-8fe2-3884987a0cea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr"
Jul 05 13:24:36.747567 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:36.747537    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzhdt\" (UniqueName: \"kubernetes.io/projected/e8582dc5-114f-42bf-8fe2-3884987a0cea-kube-api-access-wzhdt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr\" (UID: \"e8582dc5-114f-42bf-8fe2-3884987a0cea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr"
Jul 05 13:24:36.790142 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:36.790100    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr"
Jul 05 13:24:36.942135 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:36.942103    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr"]
Jul 05 13:24:36.945054 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:24:36.945024    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8582dc5_114f_42bf_8fe2_3884987a0cea.slice/crio-e66457d2adf19520511a593efcf6cf63f6d36a90afa167dce0666051f97f42fe WatchSource:0}: Error finding container e66457d2adf19520511a593efcf6cf63f6d36a90afa167dce0666051f97f42fe: Status 404 returned error can't find the container with id e66457d2adf19520511a593efcf6cf63f6d36a90afa167dce0666051f97f42fe
Jul 05 13:24:37.304100 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:37.304001    2565 generic.go:356] "Generic (PLEG): container finished" podID="e8582dc5-114f-42bf-8fe2-3884987a0cea" containerID="c3bdd80de67e6bc714af3f63d2c192e3e63b9dd87935e8b7a7ce331073eba70b" exitCode=0
Jul 05 13:24:37.304262 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:37.304096    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr" event={"ID":"e8582dc5-114f-42bf-8fe2-3884987a0cea","Type":"ContainerDied","Data":"c3bdd80de67e6bc714af3f63d2c192e3e63b9dd87935e8b7a7ce331073eba70b"}
Jul 05 13:24:37.304262 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:37.304155    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr" event={"ID":"e8582dc5-114f-42bf-8fe2-3884987a0cea","Type":"ContainerStarted","Data":"e66457d2adf19520511a593efcf6cf63f6d36a90afa167dce0666051f97f42fe"}
Jul 05 13:24:39.314432 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:39.314335    2565 generic.go:356] "Generic (PLEG): container finished" podID="e8582dc5-114f-42bf-8fe2-3884987a0cea" containerID="bcdb19d8851a2a5d15e62b791457242092a0812e432944a7cda8f00e7b71414a" exitCode=0
Jul 05 13:24:39.314432 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:39.314419    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr" event={"ID":"e8582dc5-114f-42bf-8fe2-3884987a0cea","Type":"ContainerDied","Data":"bcdb19d8851a2a5d15e62b791457242092a0812e432944a7cda8f00e7b71414a"}
Jul 05 13:24:40.319895 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:40.319856    2565 generic.go:356] "Generic (PLEG): container finished" podID="e8582dc5-114f-42bf-8fe2-3884987a0cea" containerID="cd46b95bc1fba2552dfc0e974356ebd82e68dfd543db4806d78c01001e1f4347" exitCode=0
Jul 05 13:24:40.320285 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:40.319941    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr" event={"ID":"e8582dc5-114f-42bf-8fe2-3884987a0cea","Type":"ContainerDied","Data":"cd46b95bc1fba2552dfc0e974356ebd82e68dfd543db4806d78c01001e1f4347"}
Jul 05 13:24:41.452070 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:41.452035    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr"
Jul 05 13:24:41.575366 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:41.575277    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8582dc5-114f-42bf-8fe2-3884987a0cea-util\") pod \"e8582dc5-114f-42bf-8fe2-3884987a0cea\" (UID: \"e8582dc5-114f-42bf-8fe2-3884987a0cea\") "
Jul 05 13:24:41.575366 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:41.575348    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzhdt\" (UniqueName: \"kubernetes.io/projected/e8582dc5-114f-42bf-8fe2-3884987a0cea-kube-api-access-wzhdt\") pod \"e8582dc5-114f-42bf-8fe2-3884987a0cea\" (UID: \"e8582dc5-114f-42bf-8fe2-3884987a0cea\") "
Jul 05 13:24:41.575569 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:41.575389    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8582dc5-114f-42bf-8fe2-3884987a0cea-bundle\") pod \"e8582dc5-114f-42bf-8fe2-3884987a0cea\" (UID: \"e8582dc5-114f-42bf-8fe2-3884987a0cea\") "
Jul 05 13:24:41.575848 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:41.575823    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8582dc5-114f-42bf-8fe2-3884987a0cea-bundle" (OuterVolumeSpecName: "bundle") pod "e8582dc5-114f-42bf-8fe2-3884987a0cea" (UID: "e8582dc5-114f-42bf-8fe2-3884987a0cea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:24:41.577529 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:41.577501    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8582dc5-114f-42bf-8fe2-3884987a0cea-kube-api-access-wzhdt" (OuterVolumeSpecName: "kube-api-access-wzhdt") pod "e8582dc5-114f-42bf-8fe2-3884987a0cea" (UID: "e8582dc5-114f-42bf-8fe2-3884987a0cea"). InnerVolumeSpecName "kube-api-access-wzhdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:24:41.580911 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:41.580880    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8582dc5-114f-42bf-8fe2-3884987a0cea-util" (OuterVolumeSpecName: "util") pod "e8582dc5-114f-42bf-8fe2-3884987a0cea" (UID: "e8582dc5-114f-42bf-8fe2-3884987a0cea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:24:41.676467 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:41.676429    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8582dc5-114f-42bf-8fe2-3884987a0cea-bundle\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:24:41.676467 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:41.676460    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8582dc5-114f-42bf-8fe2-3884987a0cea-util\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:24:41.676467 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:41.676473    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzhdt\" (UniqueName: \"kubernetes.io/projected/e8582dc5-114f-42bf-8fe2-3884987a0cea-kube-api-access-wzhdt\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:24:42.330626 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:42.330589    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr" event={"ID":"e8582dc5-114f-42bf-8fe2-3884987a0cea","Type":"ContainerDied","Data":"e66457d2adf19520511a593efcf6cf63f6d36a90afa167dce0666051f97f42fe"}
Jul 05 13:24:42.330626 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:42.330625    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffqdnr"
Jul 05 13:24:42.330848 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:42.330660    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e66457d2adf19520511a593efcf6cf63f6d36a90afa167dce0666051f97f42fe"
Jul 05 13:24:48.342410 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.342354    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct55r"]
Jul 05 13:24:48.342903 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.342669    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8582dc5-114f-42bf-8fe2-3884987a0cea" containerName="util"
Jul 05 13:24:48.342903 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.342680    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8582dc5-114f-42bf-8fe2-3884987a0cea" containerName="util"
Jul 05 13:24:48.342903 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.342698    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8582dc5-114f-42bf-8fe2-3884987a0cea" containerName="extract"
Jul 05 13:24:48.342903 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.342703    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8582dc5-114f-42bf-8fe2-3884987a0cea" containerName="extract"
Jul 05 13:24:48.342903 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.342710    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8582dc5-114f-42bf-8fe2-3884987a0cea" containerName="pull"
Jul 05 13:24:48.342903 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.342715    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8582dc5-114f-42bf-8fe2-3884987a0cea" containerName="pull"
Jul 05 13:24:48.342903 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.342765    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8582dc5-114f-42bf-8fe2-3884987a0cea" containerName="extract"
Jul 05 13:24:48.348889 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.348868    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct55r"
Jul 05 13:24:48.355573 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.355332    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 05 13:24:48.355573 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.355412    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-cnb9b\""
Jul 05 13:24:48.355573 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.355338    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 05 13:24:48.372530 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.372497    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct55r"]
Jul 05 13:24:48.393070 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.393037    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m7wtg"]
Jul 05 13:24:48.396169 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.396142    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-m7wtg"
Jul 05 13:24:48.401850 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.401825    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 05 13:24:48.407313 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.407292    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8zkq7\""
Jul 05 13:24:48.407429 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.407417    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 05 13:24:48.421035 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.421000    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rw56\" (UniqueName: \"kubernetes.io/projected/e2c3caab-4512-4cd5-b44b-27df5957d5b5-kube-api-access-6rw56\") pod \"openshift-lws-operator-fd8ccff4c-ct55r\" (UID: \"e2c3caab-4512-4cd5-b44b-27df5957d5b5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct55r"
Jul 05 13:24:48.421035 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.421051    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8bb8d4ee-5629-4cd0-9ff0-e979c5522cd1-bound-sa-token\") pod \"cert-manager-55b4d954d5-m7wtg\" (UID: \"8bb8d4ee-5629-4cd0-9ff0-e979c5522cd1\") " pod="cert-manager/cert-manager-55b4d954d5-m7wtg"
Jul 05 13:24:48.421340 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.421319    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh7wn\" (UniqueName: \"kubernetes.io/projected/8bb8d4ee-5629-4cd0-9ff0-e979c5522cd1-kube-api-access-kh7wn\") pod \"cert-manager-55b4d954d5-m7wtg\" (UID: \"8bb8d4ee-5629-4cd0-9ff0-e979c5522cd1\") " pod="cert-manager/cert-manager-55b4d954d5-m7wtg"
Jul 05 13:24:48.421408 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.421393    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2c3caab-4512-4cd5-b44b-27df5957d5b5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ct55r\" (UID: \"e2c3caab-4512-4cd5-b44b-27df5957d5b5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct55r"
Jul 05 13:24:48.423895 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.423868    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m7wtg"]
Jul 05 13:24:48.522867 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.522829    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rw56\" (UniqueName: \"kubernetes.io/projected/e2c3caab-4512-4cd5-b44b-27df5957d5b5-kube-api-access-6rw56\") pod \"openshift-lws-operator-fd8ccff4c-ct55r\" (UID: \"e2c3caab-4512-4cd5-b44b-27df5957d5b5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct55r"
Jul 05 13:24:48.523073 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.522880    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8bb8d4ee-5629-4cd0-9ff0-e979c5522cd1-bound-sa-token\") pod \"cert-manager-55b4d954d5-m7wtg\" (UID: \"8bb8d4ee-5629-4cd0-9ff0-e979c5522cd1\") " pod="cert-manager/cert-manager-55b4d954d5-m7wtg"
Jul 05 13:24:48.523073 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.522905    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh7wn\" (UniqueName: \"kubernetes.io/projected/8bb8d4ee-5629-4cd0-9ff0-e979c5522cd1-kube-api-access-kh7wn\") pod \"cert-manager-55b4d954d5-m7wtg\" (UID: \"8bb8d4ee-5629-4cd0-9ff0-e979c5522cd1\") " pod="cert-manager/cert-manager-55b4d954d5-m7wtg"
Jul 05 13:24:48.523073 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.522942    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2c3caab-4512-4cd5-b44b-27df5957d5b5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ct55r\" (UID: \"e2c3caab-4512-4cd5-b44b-27df5957d5b5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct55r"
Jul 05 13:24:48.523356 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.523334    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2c3caab-4512-4cd5-b44b-27df5957d5b5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ct55r\" (UID: \"e2c3caab-4512-4cd5-b44b-27df5957d5b5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct55r"
Jul 05 13:24:48.554898 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.554868    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rw56\" (UniqueName: \"kubernetes.io/projected/e2c3caab-4512-4cd5-b44b-27df5957d5b5-kube-api-access-6rw56\") pod \"openshift-lws-operator-fd8ccff4c-ct55r\" (UID: \"e2c3caab-4512-4cd5-b44b-27df5957d5b5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct55r"
Jul 05 13:24:48.556411 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.556387    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh7wn\" (UniqueName: \"kubernetes.io/projected/8bb8d4ee-5629-4cd0-9ff0-e979c5522cd1-kube-api-access-kh7wn\") pod \"cert-manager-55b4d954d5-m7wtg\" (UID: \"8bb8d4ee-5629-4cd0-9ff0-e979c5522cd1\") " pod="cert-manager/cert-manager-55b4d954d5-m7wtg"
Jul 05 13:24:48.556539 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.556460    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8bb8d4ee-5629-4cd0-9ff0-e979c5522cd1-bound-sa-token\") pod \"cert-manager-55b4d954d5-m7wtg\" (UID: \"8bb8d4ee-5629-4cd0-9ff0-e979c5522cd1\") " pod="cert-manager/cert-manager-55b4d954d5-m7wtg"
Jul 05 13:24:48.657701 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.657658    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct55r"
Jul 05 13:24:48.705051 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.705015    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-m7wtg"
Jul 05 13:24:48.833596 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.833562    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct55r"]
Jul 05 13:24:48.838361 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:24:48.838318    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2c3caab_4512_4cd5_b44b_27df5957d5b5.slice/crio-0343b8e1f96ef906fc8161acc6f70a1c7bf47b0f52bd78df1ff7e17b94ced2f4 WatchSource:0}: Error finding container 0343b8e1f96ef906fc8161acc6f70a1c7bf47b0f52bd78df1ff7e17b94ced2f4: Status 404 returned error can't find the container with id 0343b8e1f96ef906fc8161acc6f70a1c7bf47b0f52bd78df1ff7e17b94ced2f4
Jul 05 13:24:48.862217 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:48.862182    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m7wtg"]
Jul 05 13:24:48.864726 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:24:48.864702    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8bb8d4ee_5629_4cd0_9ff0_e979c5522cd1.slice/crio-d3520c66bfa9af79ffed80ff0fc5058315a4ee862b45f2748e7108330107edc6 WatchSource:0}: Error finding container d3520c66bfa9af79ffed80ff0fc5058315a4ee862b45f2748e7108330107edc6: Status 404 returned error can't find the container with id d3520c66bfa9af79ffed80ff0fc5058315a4ee862b45f2748e7108330107edc6
Jul 05 13:24:49.361573 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:49.361528    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct55r" event={"ID":"e2c3caab-4512-4cd5-b44b-27df5957d5b5","Type":"ContainerStarted","Data":"0343b8e1f96ef906fc8161acc6f70a1c7bf47b0f52bd78df1ff7e17b94ced2f4"}
Jul 05 13:24:49.363081 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:49.363036    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-m7wtg" event={"ID":"8bb8d4ee-5629-4cd0-9ff0-e979c5522cd1","Type":"ContainerStarted","Data":"d3520c66bfa9af79ffed80ff0fc5058315a4ee862b45f2748e7108330107edc6"}
Jul 05 13:24:52.378949 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:52.378903    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct55r" event={"ID":"e2c3caab-4512-4cd5-b44b-27df5957d5b5","Type":"ContainerStarted","Data":"854041f2b8d4115ddd095f911730b33322c778905b9d0116596564aedf9fa6ac"}
Jul 05 13:24:52.380362 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:52.380328    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-m7wtg" event={"ID":"8bb8d4ee-5629-4cd0-9ff0-e979c5522cd1","Type":"ContainerStarted","Data":"5ee18810ff6144072d7945c2c2013c9cb0653b716099f3449339c76f8c333640"}
Jul 05 13:24:52.420307 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:52.420252    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ct55r" podStartSLOduration=1.8058315390000002 podStartE2EDuration="4.420234349s" totalImagesPullingTime="2.61440281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:24:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:24:52.419672868 +0000 UTC m=+395.237640825" watchObservedRunningTime="2026-07-05 13:24:52.420234349 +0000 UTC m=+395.238202306"
Jul 05 13:24:52.460717 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:52.460661    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-m7wtg" podStartSLOduration=1.868667063 podStartE2EDuration="4.460621133s" totalImagesPullingTime="2.59195407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:24:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:24:52.459112834 +0000 UTC m=+395.277080791" watchObservedRunningTime="2026-07-05 13:24:52.460621133 +0000 UTC m=+395.278589089"
Jul 05 13:24:54.858151 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:54.858110    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz"]
Jul 05 13:24:54.873218 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:54.873184    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz"]
Jul 05 13:24:54.873370 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:54.873351    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz"
Jul 05 13:24:54.876165 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:54.876145    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 05 13:24:54.877077 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:54.877056    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8h2q5\""
Jul 05 13:24:54.877207 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:54.877146    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 05 13:24:54.982227 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:54.982192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz\" (UID: \"bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz"
Jul 05 13:24:54.982227 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:54.982225    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82c4x\" (UniqueName: \"kubernetes.io/projected/bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c-kube-api-access-82c4x\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz\" (UID: \"bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz"
Jul 05 13:24:54.982443 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:54.982259    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz\" (UID: \"bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz"
Jul 05 13:24:55.082908 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:55.082872    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz\" (UID: \"bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz"
Jul 05 13:24:55.083094 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:55.082909    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82c4x\" (UniqueName: \"kubernetes.io/projected/bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c-kube-api-access-82c4x\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz\" (UID: \"bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz"
Jul 05 13:24:55.083094 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:55.083012    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz\" (UID: \"bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz"
Jul 05 13:24:55.083346 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:55.083324    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz\" (UID: \"bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz"
Jul 05 13:24:55.083415 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:55.083352    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz\" (UID: \"bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz"
Jul 05 13:24:55.101968 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:55.101937    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82c4x\" (UniqueName: \"kubernetes.io/projected/bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c-kube-api-access-82c4x\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz\" (UID: \"bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz"
Jul 05 13:24:55.184947 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:55.184860    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz"
Jul 05 13:24:55.318199 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:55.318154    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz"]
Jul 05 13:24:55.320270 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:24:55.320224    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdd4a3b8_76b0_4dc6_b495_cf2b0cfb263c.slice/crio-afd2122c582fa6075020fe1f3e2a9c20ecfe1c59936efdb02addee6538d554f6 WatchSource:0}: Error finding container afd2122c582fa6075020fe1f3e2a9c20ecfe1c59936efdb02addee6538d554f6: Status 404 returned error can't find the container with id afd2122c582fa6075020fe1f3e2a9c20ecfe1c59936efdb02addee6538d554f6
Jul 05 13:24:55.394691 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:55.394646    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz" event={"ID":"bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c","Type":"ContainerStarted","Data":"70cf58aaa35c0e5ea7b4d3d98697b91d79002a27b50d7317b88cfb44f48cbb34"}
Jul 05 13:24:55.394840 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:55.394716    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz" event={"ID":"bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c","Type":"ContainerStarted","Data":"afd2122c582fa6075020fe1f3e2a9c20ecfe1c59936efdb02addee6538d554f6"}
Jul 05 13:24:56.400836 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:56.400742    2565 generic.go:356] "Generic (PLEG): container finished" podID="bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c" containerID="70cf58aaa35c0e5ea7b4d3d98697b91d79002a27b50d7317b88cfb44f48cbb34" exitCode=0
Jul 05 13:24:56.401240 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:56.400824    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz" event={"ID":"bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c","Type":"ContainerDied","Data":"70cf58aaa35c0e5ea7b4d3d98697b91d79002a27b50d7317b88cfb44f48cbb34"}
Jul 05 13:24:57.406761 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:57.406721    2565 generic.go:356] "Generic (PLEG): container finished" podID="bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c" containerID="116a9af159d66c3beb7d348f0a93f28b567f671b8f75b7c1ee4c245d8708d3c2" exitCode=0
Jul 05 13:24:57.407156 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:57.406805    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz" event={"ID":"bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c","Type":"ContainerDied","Data":"116a9af159d66c3beb7d348f0a93f28b567f671b8f75b7c1ee4c245d8708d3c2"}
Jul 05 13:24:58.412615 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:58.412576    2565 generic.go:356] "Generic (PLEG): container finished" podID="bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c" containerID="a3971416484c07b9de33b069b84c4f7c58b237c94115be47228a420699a80fe3" exitCode=0
Jul 05 13:24:58.413019 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:58.412675    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz" event={"ID":"bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c","Type":"ContainerDied","Data":"a3971416484c07b9de33b069b84c4f7c58b237c94115be47228a420699a80fe3"}
Jul 05 13:24:59.546563 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:59.546536    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz"
Jul 05 13:24:59.620191 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:59.620158    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c-bundle\") pod \"bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c\" (UID: \"bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c\") "
Jul 05 13:24:59.620407 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:59.620217    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82c4x\" (UniqueName: \"kubernetes.io/projected/bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c-kube-api-access-82c4x\") pod \"bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c\" (UID: \"bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c\") "
Jul 05 13:24:59.620407 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:59.620244    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c-util\") pod \"bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c\" (UID: \"bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c\") "
Jul 05 13:24:59.620926 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:59.620890    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c-bundle" (OuterVolumeSpecName: "bundle") pod "bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c" (UID: "bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:24:59.622389 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:59.622361    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c-kube-api-access-82c4x" (OuterVolumeSpecName: "kube-api-access-82c4x") pod "bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c" (UID: "bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c"). InnerVolumeSpecName "kube-api-access-82c4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:24:59.626052 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:59.626009    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c-util" (OuterVolumeSpecName: "util") pod "bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c" (UID: "bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:24:59.721507 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:59.721412    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c-bundle\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:24:59.721507 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:59.721448    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82c4x\" (UniqueName: \"kubernetes.io/projected/bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c-kube-api-access-82c4x\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:24:59.721507 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:24:59.721460    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c-util\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:25:00.424248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:00.424214    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz"
Jul 05 13:25:00.424248 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:00.424229    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxnjz" event={"ID":"bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c","Type":"ContainerDied","Data":"afd2122c582fa6075020fe1f3e2a9c20ecfe1c59936efdb02addee6538d554f6"}
Jul 05 13:25:00.424434 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:00.424280    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="afd2122c582fa6075020fe1f3e2a9c20ecfe1c59936efdb02addee6538d554f6"
Jul 05 13:25:09.781326 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:09.781291    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm"]
Jul 05 13:25:09.781843 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:09.781555    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c" containerName="pull"
Jul 05 13:25:09.781843 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:09.781566    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c" containerName="pull"
Jul 05 13:25:09.781843 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:09.781579    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c" containerName="util"
Jul 05 13:25:09.781843 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:09.781584    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c" containerName="util"
Jul 05 13:25:09.781843 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:09.781598    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c" containerName="extract"
Jul 05 13:25:09.781843 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:09.781603    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c" containerName="extract"
Jul 05 13:25:09.781843 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:09.781672    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdd4a3b8-76b0-4dc6-b495-cf2b0cfb263c" containerName="extract"
Jul 05 13:25:09.784588 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:09.784568    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm"
Jul 05 13:25:09.788464 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:09.788431    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-24rg9\""
Jul 05 13:25:09.788464 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:09.788431    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 05 13:25:09.788730 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:09.788520    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 05 13:25:09.788799 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:09.788735    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 05 13:25:09.788799 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:09.788770    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 05 13:25:09.830038 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:09.830004    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm"]
Jul 05 13:25:09.904910 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:09.904875    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61f1d132-2c31-42cb-9564-f9d637db66e8-webhook-cert\") pod \"opendatahub-operator-controller-manager-54547f4bcb-6ljqm\" (UID: \"61f1d132-2c31-42cb-9564-f9d637db66e8\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm"
Jul 05 13:25:09.904910 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:09.904911    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/61f1d132-2c31-42cb-9564-f9d637db66e8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54547f4bcb-6ljqm\" (UID: \"61f1d132-2c31-42cb-9564-f9d637db66e8\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm"
Jul 05 13:25:09.905115 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:09.904946    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61f1d132-2c31-42cb-9564-f9d637db66e8-tmp\") pod \"opendatahub-operator-controller-manager-54547f4bcb-6ljqm\" (UID: \"61f1d132-2c31-42cb-9564-f9d637db66e8\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm"
Jul 05 13:25:09.905115 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:09.905001    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/61f1d132-2c31-42cb-9564-f9d637db66e8-manifests\") pod \"opendatahub-operator-controller-manager-54547f4bcb-6ljqm\" (UID: \"61f1d132-2c31-42cb-9564-f9d637db66e8\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm"
Jul 05 13:25:09.905115 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:09.905036    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb8h9\" (UniqueName: \"kubernetes.io/projected/61f1d132-2c31-42cb-9564-f9d637db66e8-kube-api-access-qb8h9\") pod \"opendatahub-operator-controller-manager-54547f4bcb-6ljqm\" (UID: \"61f1d132-2c31-42cb-9564-f9d637db66e8\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm"
Jul 05 13:25:10.006274 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:10.006235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb8h9\" (UniqueName: \"kubernetes.io/projected/61f1d132-2c31-42cb-9564-f9d637db66e8-kube-api-access-qb8h9\") pod \"opendatahub-operator-controller-manager-54547f4bcb-6ljqm\" (UID: \"61f1d132-2c31-42cb-9564-f9d637db66e8\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm"
Jul 05 13:25:10.006274 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:10.006277    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61f1d132-2c31-42cb-9564-f9d637db66e8-webhook-cert\") pod \"opendatahub-operator-controller-manager-54547f4bcb-6ljqm\" (UID: \"61f1d132-2c31-42cb-9564-f9d637db66e8\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm"
Jul 05 13:25:10.006504 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:10.006301    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/61f1d132-2c31-42cb-9564-f9d637db66e8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54547f4bcb-6ljqm\" (UID: \"61f1d132-2c31-42cb-9564-f9d637db66e8\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm"
Jul 05 13:25:10.006504 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:10.006327    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61f1d132-2c31-42cb-9564-f9d637db66e8-tmp\") pod \"opendatahub-operator-controller-manager-54547f4bcb-6ljqm\" (UID: \"61f1d132-2c31-42cb-9564-f9d637db66e8\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm"
Jul 05 13:25:10.006504 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:10.006364    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/61f1d132-2c31-42cb-9564-f9d637db66e8-manifests\") pod \"opendatahub-operator-controller-manager-54547f4bcb-6ljqm\" (UID: \"61f1d132-2c31-42cb-9564-f9d637db66e8\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm"
Jul 05 13:25:10.006993 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:10.006964    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/61f1d132-2c31-42cb-9564-f9d637db66e8-manifests\") pod \"opendatahub-operator-controller-manager-54547f4bcb-6ljqm\" (UID: \"61f1d132-2c31-42cb-9564-f9d637db66e8\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm"
Jul 05 13:25:10.008926 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:10.008900    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61f1d132-2c31-42cb-9564-f9d637db66e8-tmp\") pod \"opendatahub-operator-controller-manager-54547f4bcb-6ljqm\" (UID: \"61f1d132-2c31-42cb-9564-f9d637db66e8\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm"
Jul 05 13:25:10.009028 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:10.008978    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/61f1d132-2c31-42cb-9564-f9d637db66e8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54547f4bcb-6ljqm\" (UID: \"61f1d132-2c31-42cb-9564-f9d637db66e8\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm"
Jul 05 13:25:10.009028 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:10.009006    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61f1d132-2c31-42cb-9564-f9d637db66e8-webhook-cert\") pod \"opendatahub-operator-controller-manager-54547f4bcb-6ljqm\" (UID: \"61f1d132-2c31-42cb-9564-f9d637db66e8\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm"
Jul 05 13:25:10.037078 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:10.037002    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb8h9\" (UniqueName: \"kubernetes.io/projected/61f1d132-2c31-42cb-9564-f9d637db66e8-kube-api-access-qb8h9\") pod \"opendatahub-operator-controller-manager-54547f4bcb-6ljqm\" (UID: \"61f1d132-2c31-42cb-9564-f9d637db66e8\") " pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm"
Jul 05 13:25:10.095059 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:10.095024    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm"
Jul 05 13:25:10.290188 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:10.290100    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm"]
Jul 05 13:25:10.295810 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:25:10.295778    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61f1d132_2c31_42cb_9564_f9d637db66e8.slice/crio-b02749e379a060ee55cafab7322c92f2e1817827ce89d3b1911628e3160751e8 WatchSource:0}: Error finding container b02749e379a060ee55cafab7322c92f2e1817827ce89d3b1911628e3160751e8: Status 404 returned error can't find the container with id b02749e379a060ee55cafab7322c92f2e1817827ce89d3b1911628e3160751e8
Jul 05 13:25:10.471990 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:10.471951    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm" event={"ID":"61f1d132-2c31-42cb-9564-f9d637db66e8","Type":"ContainerStarted","Data":"b02749e379a060ee55cafab7322c92f2e1817827ce89d3b1911628e3160751e8"}
Jul 05 13:25:13.488359 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:13.488314    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm" event={"ID":"61f1d132-2c31-42cb-9564-f9d637db66e8","Type":"ContainerStarted","Data":"9edd25f017dc01f77e7d08fa8cc3f93ba4a19a8a39e2991377b319f75102c462"}
Jul 05 13:25:14.494762 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:14.494721    2565 generic.go:356] "Generic (PLEG): container finished" podID="61f1d132-2c31-42cb-9564-f9d637db66e8" containerID="9edd25f017dc01f77e7d08fa8cc3f93ba4a19a8a39e2991377b319f75102c462" exitCode=0
Jul 05 13:25:14.495146 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:14.494782    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm" event={"ID":"61f1d132-2c31-42cb-9564-f9d637db66e8","Type":"ContainerDied","Data":"9edd25f017dc01f77e7d08fa8cc3f93ba4a19a8a39e2991377b319f75102c462"}
Jul 05 13:25:15.502780 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:15.502745    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm" event={"ID":"61f1d132-2c31-42cb-9564-f9d637db66e8","Type":"ContainerStarted","Data":"29039ca0548ccee9b35cfc14b917298d05b338b0b5dbcd36312ddd232c07c5e2"}
Jul 05 13:25:15.503219 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:15.502926    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm"
Jul 05 13:25:15.556545 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:15.556487    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm" podStartSLOduration=2.5162947669999998 podStartE2EDuration="6.556469369s" totalImagesPullingTime="3.035190128s" totalInitContainerRuntime="1.004984474s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:25:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:25:15.555075821 +0000 UTC m=+418.373043811" watchObservedRunningTime="2026-07-05 13:25:15.556469369 +0000 UTC m=+418.374437337"
Jul 05 13:25:26.510279 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:26.510246    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54547f4bcb-6ljqm"
Jul 05 13:25:30.604717 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:30.604674    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-776bddfb77-6q7kk"]
Jul 05 13:25:30.611522 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:30.611491    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-776bddfb77-6q7kk"
Jul 05 13:25:30.615318 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:30.615280    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 05 13:25:30.615318 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:30.615295    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 05 13:25:30.615597 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:30.615295    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 05 13:25:30.615597 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:30.615295    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4tzjt\""
Jul 05 13:25:30.615597 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:30.615575    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 05 13:25:30.644993 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:30.644954    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-776bddfb77-6q7kk"]
Jul 05 13:25:30.789943 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:30.789905    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9478\" (UniqueName: \"kubernetes.io/projected/387d4097-0fb8-427f-8a30-5c4b3d383327-kube-api-access-x9478\") pod \"kube-auth-proxy-776bddfb77-6q7kk\" (UID: \"387d4097-0fb8-427f-8a30-5c4b3d383327\") " pod="openshift-ingress/kube-auth-proxy-776bddfb77-6q7kk"
Jul 05 13:25:30.789943 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:30.789956    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/387d4097-0fb8-427f-8a30-5c4b3d383327-tmp\") pod \"kube-auth-proxy-776bddfb77-6q7kk\" (UID: \"387d4097-0fb8-427f-8a30-5c4b3d383327\") " pod="openshift-ingress/kube-auth-proxy-776bddfb77-6q7kk"
Jul 05 13:25:30.790168 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:30.789984    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/387d4097-0fb8-427f-8a30-5c4b3d383327-tls-certs\") pod \"kube-auth-proxy-776bddfb77-6q7kk\" (UID: \"387d4097-0fb8-427f-8a30-5c4b3d383327\") " pod="openshift-ingress/kube-auth-proxy-776bddfb77-6q7kk"
Jul 05 13:25:30.891300 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:30.891196    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/387d4097-0fb8-427f-8a30-5c4b3d383327-tls-certs\") pod \"kube-auth-proxy-776bddfb77-6q7kk\" (UID: \"387d4097-0fb8-427f-8a30-5c4b3d383327\") " pod="openshift-ingress/kube-auth-proxy-776bddfb77-6q7kk"
Jul 05 13:25:30.891300 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:30.891269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9478\" (UniqueName: \"kubernetes.io/projected/387d4097-0fb8-427f-8a30-5c4b3d383327-kube-api-access-x9478\") pod \"kube-auth-proxy-776bddfb77-6q7kk\" (UID: \"387d4097-0fb8-427f-8a30-5c4b3d383327\") " pod="openshift-ingress/kube-auth-proxy-776bddfb77-6q7kk"
Jul 05 13:25:30.891534 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:30.891324    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/387d4097-0fb8-427f-8a30-5c4b3d383327-tmp\") pod \"kube-auth-proxy-776bddfb77-6q7kk\" (UID: \"387d4097-0fb8-427f-8a30-5c4b3d383327\") " pod="openshift-ingress/kube-auth-proxy-776bddfb77-6q7kk"
Jul 05 13:25:30.893803 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:30.893759    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/387d4097-0fb8-427f-8a30-5c4b3d383327-tmp\") pod \"kube-auth-proxy-776bddfb77-6q7kk\" (UID: \"387d4097-0fb8-427f-8a30-5c4b3d383327\") " pod="openshift-ingress/kube-auth-proxy-776bddfb77-6q7kk"
Jul 05 13:25:30.893959 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:30.893920    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/387d4097-0fb8-427f-8a30-5c4b3d383327-tls-certs\") pod \"kube-auth-proxy-776bddfb77-6q7kk\" (UID: \"387d4097-0fb8-427f-8a30-5c4b3d383327\") " pod="openshift-ingress/kube-auth-proxy-776bddfb77-6q7kk"
Jul 05 13:25:30.925300 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:30.925265    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9478\" (UniqueName: \"kubernetes.io/projected/387d4097-0fb8-427f-8a30-5c4b3d383327-kube-api-access-x9478\") pod \"kube-auth-proxy-776bddfb77-6q7kk\" (UID: \"387d4097-0fb8-427f-8a30-5c4b3d383327\") " pod="openshift-ingress/kube-auth-proxy-776bddfb77-6q7kk"
Jul 05 13:25:31.222222 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:31.222140    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-776bddfb77-6q7kk"
Jul 05 13:25:31.376499 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:31.376461    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-776bddfb77-6q7kk"]
Jul 05 13:25:31.378911 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:25:31.378873    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod387d4097_0fb8_427f_8a30_5c4b3d383327.slice/crio-24e05a8255ee1b05ac449f48578560cba0c72892f12080992434f6305ae5df7d WatchSource:0}: Error finding container 24e05a8255ee1b05ac449f48578560cba0c72892f12080992434f6305ae5df7d: Status 404 returned error can't find the container with id 24e05a8255ee1b05ac449f48578560cba0c72892f12080992434f6305ae5df7d
Jul 05 13:25:31.576855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:31.576749    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-776bddfb77-6q7kk" event={"ID":"387d4097-0fb8-427f-8a30-5c4b3d383327","Type":"ContainerStarted","Data":"24e05a8255ee1b05ac449f48578560cba0c72892f12080992434f6305ae5df7d"}
Jul 05 13:25:33.588461 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:33.588423    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-776bddfb77-6q7kk" event={"ID":"387d4097-0fb8-427f-8a30-5c4b3d383327","Type":"ContainerStarted","Data":"33ccd385305c6bba306625083ad3e84d051766c2dea343c24cb6a03f22dec67a"}
Jul 05 13:25:33.657466 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:33.657355    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-776bddfb77-6q7kk" podStartSLOduration=1.6789447389999999 podStartE2EDuration="3.657335675s" totalImagesPullingTime="1.978390936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:25:33.65725524 +0000 UTC m=+436.475223221" watchObservedRunningTime="2026-07-05 13:25:33.657335675 +0000 UTC m=+436.475303631"
Jul 05 13:25:36.881084 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:36.881042    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-cfb4f694f-n79qn"]
Jul 05 13:25:36.883515 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:36.883495    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-cfb4f694f-n79qn"
Jul 05 13:25:36.887169 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:36.887132    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-djcd4\""
Jul 05 13:25:36.888981 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:36.888950    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 05 13:25:36.889511 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:36.889492    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 05 13:25:36.889602 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:36.889545    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 05 13:25:36.905967 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:36.905934    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-cfb4f694f-n79qn"]
Jul 05 13:25:37.047321 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:37.047284    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af0302e7-8728-4e6b-a29b-308b5c155c6f-cert\") pod \"lws-controller-manager-cfb4f694f-n79qn\" (UID: \"af0302e7-8728-4e6b-a29b-308b5c155c6f\") " pod="openshift-lws-operator/lws-controller-manager-cfb4f694f-n79qn"
Jul 05 13:25:37.047321 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:37.047331    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtwht\" (UniqueName: \"kubernetes.io/projected/af0302e7-8728-4e6b-a29b-308b5c155c6f-kube-api-access-jtwht\") pod \"lws-controller-manager-cfb4f694f-n79qn\" (UID: \"af0302e7-8728-4e6b-a29b-308b5c155c6f\") " pod="openshift-lws-operator/lws-controller-manager-cfb4f694f-n79qn"
Jul 05 13:25:37.047546 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:37.047405    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/af0302e7-8728-4e6b-a29b-308b5c155c6f-manager-config\") pod \"lws-controller-manager-cfb4f694f-n79qn\" (UID: \"af0302e7-8728-4e6b-a29b-308b5c155c6f\") " pod="openshift-lws-operator/lws-controller-manager-cfb4f694f-n79qn"
Jul 05 13:25:37.047546 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:37.047496    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/af0302e7-8728-4e6b-a29b-308b5c155c6f-metrics-cert\") pod \"lws-controller-manager-cfb4f694f-n79qn\" (UID: \"af0302e7-8728-4e6b-a29b-308b5c155c6f\") " pod="openshift-lws-operator/lws-controller-manager-cfb4f694f-n79qn"
Jul 05 13:25:37.148406 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:37.148298    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/af0302e7-8728-4e6b-a29b-308b5c155c6f-metrics-cert\") pod \"lws-controller-manager-cfb4f694f-n79qn\" (UID: \"af0302e7-8728-4e6b-a29b-308b5c155c6f\") " pod="openshift-lws-operator/lws-controller-manager-cfb4f694f-n79qn"
Jul 05 13:25:37.148406 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:37.148385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af0302e7-8728-4e6b-a29b-308b5c155c6f-cert\") pod \"lws-controller-manager-cfb4f694f-n79qn\" (UID: \"af0302e7-8728-4e6b-a29b-308b5c155c6f\") " pod="openshift-lws-operator/lws-controller-manager-cfb4f694f-n79qn"
Jul 05 13:25:37.148666 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:37.148411    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtwht\" (UniqueName: \"kubernetes.io/projected/af0302e7-8728-4e6b-a29b-308b5c155c6f-kube-api-access-jtwht\") pod \"lws-controller-manager-cfb4f694f-n79qn\" (UID: \"af0302e7-8728-4e6b-a29b-308b5c155c6f\") " pod="openshift-lws-operator/lws-controller-manager-cfb4f694f-n79qn"
Jul 05 13:25:37.148666 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:37.148447    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/af0302e7-8728-4e6b-a29b-308b5c155c6f-manager-config\") pod \"lws-controller-manager-cfb4f694f-n79qn\" (UID: \"af0302e7-8728-4e6b-a29b-308b5c155c6f\") " pod="openshift-lws-operator/lws-controller-manager-cfb4f694f-n79qn"
Jul 05 13:25:37.149275 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:37.149238    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/af0302e7-8728-4e6b-a29b-308b5c155c6f-manager-config\") pod \"lws-controller-manager-cfb4f694f-n79qn\" (UID: \"af0302e7-8728-4e6b-a29b-308b5c155c6f\") " pod="openshift-lws-operator/lws-controller-manager-cfb4f694f-n79qn"
Jul 05 13:25:37.151137 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:37.151110    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/af0302e7-8728-4e6b-a29b-308b5c155c6f-cert\") pod \"lws-controller-manager-cfb4f694f-n79qn\" (UID: \"af0302e7-8728-4e6b-a29b-308b5c155c6f\") " pod="openshift-lws-operator/lws-controller-manager-cfb4f694f-n79qn"
Jul 05 13:25:37.151338 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:37.151320    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/af0302e7-8728-4e6b-a29b-308b5c155c6f-metrics-cert\") pod \"lws-controller-manager-cfb4f694f-n79qn\" (UID: \"af0302e7-8728-4e6b-a29b-308b5c155c6f\") " pod="openshift-lws-operator/lws-controller-manager-cfb4f694f-n79qn"
Jul 05 13:25:37.190390 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:37.190359    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtwht\" (UniqueName: \"kubernetes.io/projected/af0302e7-8728-4e6b-a29b-308b5c155c6f-kube-api-access-jtwht\") pod \"lws-controller-manager-cfb4f694f-n79qn\" (UID: \"af0302e7-8728-4e6b-a29b-308b5c155c6f\") " pod="openshift-lws-operator/lws-controller-manager-cfb4f694f-n79qn"
Jul 05 13:25:37.193206 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:37.193177    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-cfb4f694f-n79qn"
Jul 05 13:25:37.394142 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:25:37.394097    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf0302e7_8728_4e6b_a29b_308b5c155c6f.slice/crio-eaa1dc54fd164f7a6f0d1603c125c04bf95e1a7986f94b741c695252daa06be7 WatchSource:0}: Error finding container eaa1dc54fd164f7a6f0d1603c125c04bf95e1a7986f94b741c695252daa06be7: Status 404 returned error can't find the container with id eaa1dc54fd164f7a6f0d1603c125c04bf95e1a7986f94b741c695252daa06be7
Jul 05 13:25:37.394560 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:37.394541    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-cfb4f694f-n79qn"]
Jul 05 13:25:37.609224 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:37.609184    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-cfb4f694f-n79qn" event={"ID":"af0302e7-8728-4e6b-a29b-308b5c155c6f","Type":"ContainerStarted","Data":"eaa1dc54fd164f7a6f0d1603c125c04bf95e1a7986f94b741c695252daa06be7"}
Jul 05 13:25:39.620390 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:39.620342    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-cfb4f694f-n79qn" event={"ID":"af0302e7-8728-4e6b-a29b-308b5c155c6f","Type":"ContainerStarted","Data":"e5e57a8985d58b103da167993b366bcaeca42e1a9ce2ea995838a0cbc9c6af82"}
Jul 05 13:25:39.620844 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:39.620510    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-cfb4f694f-n79qn"
Jul 05 13:25:39.677856 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:39.677803    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-cfb4f694f-n79qn" podStartSLOduration=2.340286229 podStartE2EDuration="3.677785609s" totalImagesPullingTime="1.33749938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:25:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:25:39.675598305 +0000 UTC m=+442.493566281" watchObservedRunningTime="2026-07-05 13:25:39.677785609 +0000 UTC m=+442.495753567"
Jul 05 13:25:50.628941 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:25:50.628906    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-cfb4f694f-n79qn"
Jul 05 13:26:48.138517 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.138470    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss"]
Jul 05 13:26:48.141985 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.141957    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss"
Jul 05 13:26:48.145653 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.145605    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 05 13:26:48.146156 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.146134    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 05 13:26:48.146268 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.146137    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4crjk\""
Jul 05 13:26:48.175154 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.175119    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss"]
Jul 05 13:26:48.322483 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.322444    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bf1fef7-3d0f-4991-bab6-0aec83f6aed6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss\" (UID: \"5bf1fef7-3d0f-4991-bab6-0aec83f6aed6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss"
Jul 05 13:26:48.322711 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.322511    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54pxt\" (UniqueName: \"kubernetes.io/projected/5bf1fef7-3d0f-4991-bab6-0aec83f6aed6-kube-api-access-54pxt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss\" (UID: \"5bf1fef7-3d0f-4991-bab6-0aec83f6aed6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss"
Jul 05 13:26:48.322711 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.322589    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bf1fef7-3d0f-4991-bab6-0aec83f6aed6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss\" (UID: \"5bf1fef7-3d0f-4991-bab6-0aec83f6aed6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss"
Jul 05 13:26:48.424052 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.423960    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54pxt\" (UniqueName: \"kubernetes.io/projected/5bf1fef7-3d0f-4991-bab6-0aec83f6aed6-kube-api-access-54pxt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss\" (UID: \"5bf1fef7-3d0f-4991-bab6-0aec83f6aed6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss"
Jul 05 13:26:48.424052 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.424025    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bf1fef7-3d0f-4991-bab6-0aec83f6aed6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss\" (UID: \"5bf1fef7-3d0f-4991-bab6-0aec83f6aed6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss"
Jul 05 13:26:48.424052 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.424051    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bf1fef7-3d0f-4991-bab6-0aec83f6aed6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss\" (UID: \"5bf1fef7-3d0f-4991-bab6-0aec83f6aed6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss"
Jul 05 13:26:48.424440 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.424421    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bf1fef7-3d0f-4991-bab6-0aec83f6aed6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss\" (UID: \"5bf1fef7-3d0f-4991-bab6-0aec83f6aed6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss"
Jul 05 13:26:48.424483 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.424446    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bf1fef7-3d0f-4991-bab6-0aec83f6aed6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss\" (UID: \"5bf1fef7-3d0f-4991-bab6-0aec83f6aed6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss"
Jul 05 13:26:48.439084 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.439050    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54pxt\" (UniqueName: \"kubernetes.io/projected/5bf1fef7-3d0f-4991-bab6-0aec83f6aed6-kube-api-access-54pxt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss\" (UID: \"5bf1fef7-3d0f-4991-bab6-0aec83f6aed6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss"
Jul 05 13:26:48.451105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.451072    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss"
Jul 05 13:26:48.494719 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.494674    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq"]
Jul 05 13:26:48.498387 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.498359    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq"
Jul 05 13:26:48.513934 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.513898    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq"]
Jul 05 13:26:48.597607 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.597583    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss"]
Jul 05 13:26:48.599819 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:26:48.599786    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf1fef7_3d0f_4991_bab6_0aec83f6aed6.slice/crio-a0f4773b10c2d66ec541316f5abfdf61d5f47d9efc42f62e1583e542ec419b36 WatchSource:0}: Error finding container a0f4773b10c2d66ec541316f5abfdf61d5f47d9efc42f62e1583e542ec419b36: Status 404 returned error can't find the container with id a0f4773b10c2d66ec541316f5abfdf61d5f47d9efc42f62e1583e542ec419b36
Jul 05 13:26:48.625423 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.625391    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nd4c\" (UniqueName: \"kubernetes.io/projected/64eb7501-5af5-4646-83bb-9b436e7be1a3-kube-api-access-8nd4c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq\" (UID: \"64eb7501-5af5-4646-83bb-9b436e7be1a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq"
Jul 05 13:26:48.625584 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.625453    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64eb7501-5af5-4646-83bb-9b436e7be1a3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq\" (UID: \"64eb7501-5af5-4646-83bb-9b436e7be1a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq"
Jul 05 13:26:48.625659 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.625580    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64eb7501-5af5-4646-83bb-9b436e7be1a3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq\" (UID: \"64eb7501-5af5-4646-83bb-9b436e7be1a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq"
Jul 05 13:26:48.726447 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.726416    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64eb7501-5af5-4646-83bb-9b436e7be1a3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq\" (UID: \"64eb7501-5af5-4646-83bb-9b436e7be1a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq"
Jul 05 13:26:48.726673 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.726478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64eb7501-5af5-4646-83bb-9b436e7be1a3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq\" (UID: \"64eb7501-5af5-4646-83bb-9b436e7be1a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq"
Jul 05 13:26:48.726673 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.726515    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nd4c\" (UniqueName: \"kubernetes.io/projected/64eb7501-5af5-4646-83bb-9b436e7be1a3-kube-api-access-8nd4c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq\" (UID: \"64eb7501-5af5-4646-83bb-9b436e7be1a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq"
Jul 05 13:26:48.726938 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.726915    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64eb7501-5af5-4646-83bb-9b436e7be1a3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq\" (UID: \"64eb7501-5af5-4646-83bb-9b436e7be1a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq"
Jul 05 13:26:48.727007 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.726941    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64eb7501-5af5-4646-83bb-9b436e7be1a3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq\" (UID: \"64eb7501-5af5-4646-83bb-9b436e7be1a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq"
Jul 05 13:26:48.737094 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.737059    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nd4c\" (UniqueName: \"kubernetes.io/projected/64eb7501-5af5-4646-83bb-9b436e7be1a3-kube-api-access-8nd4c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq\" (UID: \"64eb7501-5af5-4646-83bb-9b436e7be1a3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq"
Jul 05 13:26:48.811942 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.811899    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq"
Jul 05 13:26:48.937401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.937365    2565 generic.go:356] "Generic (PLEG): container finished" podID="5bf1fef7-3d0f-4991-bab6-0aec83f6aed6" containerID="726c04ee7f0d9fdf38d64c7105f04d60af0532060d4de9aebc800e1355a155db" exitCode=0
Jul 05 13:26:48.937608 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.937449    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss" event={"ID":"5bf1fef7-3d0f-4991-bab6-0aec83f6aed6","Type":"ContainerDied","Data":"726c04ee7f0d9fdf38d64c7105f04d60af0532060d4de9aebc800e1355a155db"}
Jul 05 13:26:48.937608 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.937555    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss" event={"ID":"5bf1fef7-3d0f-4991-bab6-0aec83f6aed6","Type":"ContainerStarted","Data":"a0f4773b10c2d66ec541316f5abfdf61d5f47d9efc42f62e1583e542ec419b36"}
Jul 05 13:26:48.977404 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:48.977315    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq"]
Jul 05 13:26:48.981523 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:26:48.981487    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64eb7501_5af5_4646_83bb_9b436e7be1a3.slice/crio-01113361cfcf16f86e9c1d261823cebda6157830aa6c484e9d409eefa3ebd27f WatchSource:0}: Error finding container 01113361cfcf16f86e9c1d261823cebda6157830aa6c484e9d409eefa3ebd27f: Status 404 returned error can't find the container with id 01113361cfcf16f86e9c1d261823cebda6157830aa6c484e9d409eefa3ebd27f
Jul 05 13:26:49.123437 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.123402    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg"]
Jul 05 13:26:49.127035 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.127011    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg"
Jul 05 13:26:49.174133 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.174097    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg"]
Jul 05 13:26:49.231024 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.230931    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ba58829-beca-4aa3-92f8-716632068bb7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg\" (UID: \"5ba58829-beca-4aa3-92f8-716632068bb7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg"
Jul 05 13:26:49.231024 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.230971    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgbvs\" (UniqueName: \"kubernetes.io/projected/5ba58829-beca-4aa3-92f8-716632068bb7-kube-api-access-rgbvs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg\" (UID: \"5ba58829-beca-4aa3-92f8-716632068bb7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg"
Jul 05 13:26:49.231208 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.231026    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ba58829-beca-4aa3-92f8-716632068bb7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg\" (UID: \"5ba58829-beca-4aa3-92f8-716632068bb7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg"
Jul 05 13:26:49.331597 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.331556    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ba58829-beca-4aa3-92f8-716632068bb7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg\" (UID: \"5ba58829-beca-4aa3-92f8-716632068bb7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg"
Jul 05 13:26:49.331822 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.331605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgbvs\" (UniqueName: \"kubernetes.io/projected/5ba58829-beca-4aa3-92f8-716632068bb7-kube-api-access-rgbvs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg\" (UID: \"5ba58829-beca-4aa3-92f8-716632068bb7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg"
Jul 05 13:26:49.331822 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.331693    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ba58829-beca-4aa3-92f8-716632068bb7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg\" (UID: \"5ba58829-beca-4aa3-92f8-716632068bb7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg"
Jul 05 13:26:49.331984 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.331966    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ba58829-beca-4aa3-92f8-716632068bb7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg\" (UID: \"5ba58829-beca-4aa3-92f8-716632068bb7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg"
Jul 05 13:26:49.332034 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.332014    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ba58829-beca-4aa3-92f8-716632068bb7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg\" (UID: \"5ba58829-beca-4aa3-92f8-716632068bb7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg"
Jul 05 13:26:49.342165 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.342128    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgbvs\" (UniqueName: \"kubernetes.io/projected/5ba58829-beca-4aa3-92f8-716632068bb7-kube-api-access-rgbvs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg\" (UID: \"5ba58829-beca-4aa3-92f8-716632068bb7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg"
Jul 05 13:26:49.450590 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.450552    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg"
Jul 05 13:26:49.643582 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.643555    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg"]
Jul 05 13:26:49.645605 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:26:49.645572    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ba58829_beca_4aa3_92f8_716632068bb7.slice/crio-d8f1e0f8f4b2109dd280646ff7251d69f3e70396edb43ef58ba7b93689c17671 WatchSource:0}: Error finding container d8f1e0f8f4b2109dd280646ff7251d69f3e70396edb43ef58ba7b93689c17671: Status 404 returned error can't find the container with id d8f1e0f8f4b2109dd280646ff7251d69f3e70396edb43ef58ba7b93689c17671
Jul 05 13:26:49.713305 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.713271    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx"]
Jul 05 13:26:49.716818 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.716795    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx"
Jul 05 13:26:49.731870 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.731841    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx"]
Jul 05 13:26:49.735538 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.735459    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2cc589a-7a00-4dc8-b397-ab1c94d91888-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx\" (UID: \"e2cc589a-7a00-4dc8-b397-ab1c94d91888\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx"
Jul 05 13:26:49.735692 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.735623    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2cc589a-7a00-4dc8-b397-ab1c94d91888-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx\" (UID: \"e2cc589a-7a00-4dc8-b397-ab1c94d91888\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx"
Jul 05 13:26:49.735756 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.735707    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7x4b\" (UniqueName: \"kubernetes.io/projected/e2cc589a-7a00-4dc8-b397-ab1c94d91888-kube-api-access-j7x4b\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx\" (UID: \"e2cc589a-7a00-4dc8-b397-ab1c94d91888\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx"
Jul 05 13:26:49.836480 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.836437    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2cc589a-7a00-4dc8-b397-ab1c94d91888-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx\" (UID: \"e2cc589a-7a00-4dc8-b397-ab1c94d91888\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx"
Jul 05 13:26:49.836705 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.836491    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7x4b\" (UniqueName: \"kubernetes.io/projected/e2cc589a-7a00-4dc8-b397-ab1c94d91888-kube-api-access-j7x4b\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx\" (UID: \"e2cc589a-7a00-4dc8-b397-ab1c94d91888\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx"
Jul 05 13:26:49.836705 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.836521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2cc589a-7a00-4dc8-b397-ab1c94d91888-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx\" (UID: \"e2cc589a-7a00-4dc8-b397-ab1c94d91888\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx"
Jul 05 13:26:49.836881 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.836860    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2cc589a-7a00-4dc8-b397-ab1c94d91888-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx\" (UID: \"e2cc589a-7a00-4dc8-b397-ab1c94d91888\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx"
Jul 05 13:26:49.836959 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.836938    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2cc589a-7a00-4dc8-b397-ab1c94d91888-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx\" (UID: \"e2cc589a-7a00-4dc8-b397-ab1c94d91888\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx"
Jul 05 13:26:49.852650 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.852595    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7x4b\" (UniqueName: \"kubernetes.io/projected/e2cc589a-7a00-4dc8-b397-ab1c94d91888-kube-api-access-j7x4b\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx\" (UID: \"e2cc589a-7a00-4dc8-b397-ab1c94d91888\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx"
Jul 05 13:26:49.943122 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.943080    2565 generic.go:356] "Generic (PLEG): container finished" podID="5ba58829-beca-4aa3-92f8-716632068bb7" containerID="6342d7da2186af0af8a3f2ba762a9ea2cd2836d394243fb2c2391b43b89623ac" exitCode=0
Jul 05 13:26:49.943314 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.943173    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg" event={"ID":"5ba58829-beca-4aa3-92f8-716632068bb7","Type":"ContainerDied","Data":"6342d7da2186af0af8a3f2ba762a9ea2cd2836d394243fb2c2391b43b89623ac"}
Jul 05 13:26:49.943314 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.943232    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg" event={"ID":"5ba58829-beca-4aa3-92f8-716632068bb7","Type":"ContainerStarted","Data":"d8f1e0f8f4b2109dd280646ff7251d69f3e70396edb43ef58ba7b93689c17671"}
Jul 05 13:26:49.945177 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.945140    2565 generic.go:356] "Generic (PLEG): container finished" podID="5bf1fef7-3d0f-4991-bab6-0aec83f6aed6" containerID="6f6f5041ff0a46a50931d6742172d214eacc6a8dde7dc600d69a831c1cd1d21d" exitCode=0
Jul 05 13:26:49.945278 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.945202    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss" event={"ID":"5bf1fef7-3d0f-4991-bab6-0aec83f6aed6","Type":"ContainerDied","Data":"6f6f5041ff0a46a50931d6742172d214eacc6a8dde7dc600d69a831c1cd1d21d"}
Jul 05 13:26:49.946805 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.946781    2565 generic.go:356] "Generic (PLEG): container finished" podID="64eb7501-5af5-4646-83bb-9b436e7be1a3" containerID="720044191dfaee79324940ec8e5e4baa8249d3dbaca703eb77b55019777a7fe6" exitCode=0
Jul 05 13:26:49.946895 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.946826    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq" event={"ID":"64eb7501-5af5-4646-83bb-9b436e7be1a3","Type":"ContainerDied","Data":"720044191dfaee79324940ec8e5e4baa8249d3dbaca703eb77b55019777a7fe6"}
Jul 05 13:26:49.946895 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:49.946858    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq" event={"ID":"64eb7501-5af5-4646-83bb-9b436e7be1a3","Type":"ContainerStarted","Data":"01113361cfcf16f86e9c1d261823cebda6157830aa6c484e9d409eefa3ebd27f"}
Jul 05 13:26:50.026940 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:50.026757    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx"
Jul 05 13:26:50.192217 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:50.192184    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx"]
Jul 05 13:26:50.193904 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:26:50.193876    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2cc589a_7a00_4dc8_b397_ab1c94d91888.slice/crio-cedc3c10f22bd9700c8bd0610a2bc933bdf9169536fccbef4aa81cce40e005eb WatchSource:0}: Error finding container cedc3c10f22bd9700c8bd0610a2bc933bdf9169536fccbef4aa81cce40e005eb: Status 404 returned error can't find the container with id cedc3c10f22bd9700c8bd0610a2bc933bdf9169536fccbef4aa81cce40e005eb
Jul 05 13:26:50.959443 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:50.959404    2565 generic.go:356] "Generic (PLEG): container finished" podID="64eb7501-5af5-4646-83bb-9b436e7be1a3" containerID="88c5c2270fe41d5d32d7b8ed6b919002dd023856586bd1d182ecc4eea8137ef9" exitCode=0
Jul 05 13:26:50.959662 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:50.959481    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq" event={"ID":"64eb7501-5af5-4646-83bb-9b436e7be1a3","Type":"ContainerDied","Data":"88c5c2270fe41d5d32d7b8ed6b919002dd023856586bd1d182ecc4eea8137ef9"}
Jul 05 13:26:50.961111 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:50.960982    2565 generic.go:356] "Generic (PLEG): container finished" podID="e2cc589a-7a00-4dc8-b397-ab1c94d91888" containerID="62b779ff7e278f1eac1a70bdf53ff8e47f9bd220ef480cbfd695e0e343f4e507" exitCode=0
Jul 05 13:26:50.961111 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:50.961081    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx" event={"ID":"e2cc589a-7a00-4dc8-b397-ab1c94d91888","Type":"ContainerDied","Data":"62b779ff7e278f1eac1a70bdf53ff8e47f9bd220ef480cbfd695e0e343f4e507"}
Jul 05 13:26:50.961111 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:50.961110    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx" event={"ID":"e2cc589a-7a00-4dc8-b397-ab1c94d91888","Type":"ContainerStarted","Data":"cedc3c10f22bd9700c8bd0610a2bc933bdf9169536fccbef4aa81cce40e005eb"}
Jul 05 13:26:50.963040 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:50.963016    2565 generic.go:356] "Generic (PLEG): container finished" podID="5ba58829-beca-4aa3-92f8-716632068bb7" containerID="7f5dab0efa2e75646b6ef1ac24b5a6369ecea9294ccee636a4ec49c5fd934dfd" exitCode=0
Jul 05 13:26:50.963139 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:50.963118    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg" event={"ID":"5ba58829-beca-4aa3-92f8-716632068bb7","Type":"ContainerDied","Data":"7f5dab0efa2e75646b6ef1ac24b5a6369ecea9294ccee636a4ec49c5fd934dfd"}
Jul 05 13:26:50.965449 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:50.965427    2565 generic.go:356] "Generic (PLEG): container finished" podID="5bf1fef7-3d0f-4991-bab6-0aec83f6aed6" containerID="e13df817941646d714deca06cbea1ad3d465d3ae6e898e6ec0b0be6fa5cd6c64" exitCode=0
Jul 05 13:26:50.965556 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:50.965461    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss" event={"ID":"5bf1fef7-3d0f-4991-bab6-0aec83f6aed6","Type":"ContainerDied","Data":"e13df817941646d714deca06cbea1ad3d465d3ae6e898e6ec0b0be6fa5cd6c64"}
Jul 05 13:26:51.981863 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:51.981815    2565 generic.go:356] "Generic (PLEG): container finished" podID="5ba58829-beca-4aa3-92f8-716632068bb7" containerID="c7ec3dbfa0c01073ebbf1133b65941f2d2c4acfe0f1566c48d8448a7b4a91a7e" exitCode=0
Jul 05 13:26:51.982326 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:51.981933    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg" event={"ID":"5ba58829-beca-4aa3-92f8-716632068bb7","Type":"ContainerDied","Data":"c7ec3dbfa0c01073ebbf1133b65941f2d2c4acfe0f1566c48d8448a7b4a91a7e"}
Jul 05 13:26:51.984699 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:51.984667    2565 generic.go:356] "Generic (PLEG): container finished" podID="64eb7501-5af5-4646-83bb-9b436e7be1a3" containerID="d4849558de851043301ec123cd9e37b8d69f5cc27c2a879db33aa607b283eab7" exitCode=0
Jul 05 13:26:51.984871 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:51.984742    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq" event={"ID":"64eb7501-5af5-4646-83bb-9b436e7be1a3","Type":"ContainerDied","Data":"d4849558de851043301ec123cd9e37b8d69f5cc27c2a879db33aa607b283eab7"}
Jul 05 13:26:51.986734 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:51.986701    2565 generic.go:356] "Generic (PLEG): container finished" podID="e2cc589a-7a00-4dc8-b397-ab1c94d91888" containerID="37bcb5cc3c0d77cdc65d87d33fc85fcf387efb0ccfeb9ccc7c82ceb88f483448" exitCode=0
Jul 05 13:26:51.986863 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:51.986773    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx" event={"ID":"e2cc589a-7a00-4dc8-b397-ab1c94d91888","Type":"ContainerDied","Data":"37bcb5cc3c0d77cdc65d87d33fc85fcf387efb0ccfeb9ccc7c82ceb88f483448"}
Jul 05 13:26:52.132731 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:52.132694    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss"
Jul 05 13:26:52.154894 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:52.154836    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bf1fef7-3d0f-4991-bab6-0aec83f6aed6-util\") pod \"5bf1fef7-3d0f-4991-bab6-0aec83f6aed6\" (UID: \"5bf1fef7-3d0f-4991-bab6-0aec83f6aed6\") "
Jul 05 13:26:52.155024 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:52.154913    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bf1fef7-3d0f-4991-bab6-0aec83f6aed6-bundle\") pod \"5bf1fef7-3d0f-4991-bab6-0aec83f6aed6\" (UID: \"5bf1fef7-3d0f-4991-bab6-0aec83f6aed6\") "
Jul 05 13:26:52.155024 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:52.154941    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54pxt\" (UniqueName: \"kubernetes.io/projected/5bf1fef7-3d0f-4991-bab6-0aec83f6aed6-kube-api-access-54pxt\") pod \"5bf1fef7-3d0f-4991-bab6-0aec83f6aed6\" (UID: \"5bf1fef7-3d0f-4991-bab6-0aec83f6aed6\") "
Jul 05 13:26:52.155572 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:52.155521    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bf1fef7-3d0f-4991-bab6-0aec83f6aed6-bundle" (OuterVolumeSpecName: "bundle") pod "5bf1fef7-3d0f-4991-bab6-0aec83f6aed6" (UID: "5bf1fef7-3d0f-4991-bab6-0aec83f6aed6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:26:52.157289 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:52.157256    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bf1fef7-3d0f-4991-bab6-0aec83f6aed6-kube-api-access-54pxt" (OuterVolumeSpecName: "kube-api-access-54pxt") pod "5bf1fef7-3d0f-4991-bab6-0aec83f6aed6" (UID: "5bf1fef7-3d0f-4991-bab6-0aec83f6aed6"). InnerVolumeSpecName "kube-api-access-54pxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:26:52.161310 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:52.161281    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bf1fef7-3d0f-4991-bab6-0aec83f6aed6-util" (OuterVolumeSpecName: "util") pod "5bf1fef7-3d0f-4991-bab6-0aec83f6aed6" (UID: "5bf1fef7-3d0f-4991-bab6-0aec83f6aed6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:26:52.255814 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:52.255713    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bf1fef7-3d0f-4991-bab6-0aec83f6aed6-util\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:26:52.255814 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:52.255749    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bf1fef7-3d0f-4991-bab6-0aec83f6aed6-bundle\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:26:52.255814 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:52.255759    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54pxt\" (UniqueName: \"kubernetes.io/projected/5bf1fef7-3d0f-4991-bab6-0aec83f6aed6-kube-api-access-54pxt\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:26:52.993905 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:52.993872    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss"
Jul 05 13:26:52.994379 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:52.993878    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss" event={"ID":"5bf1fef7-3d0f-4991-bab6-0aec83f6aed6","Type":"ContainerDied","Data":"a0f4773b10c2d66ec541316f5abfdf61d5f47d9efc42f62e1583e542ec419b36"}
Jul 05 13:26:52.994379 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:52.994017    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0f4773b10c2d66ec541316f5abfdf61d5f47d9efc42f62e1583e542ec419b36"
Jul 05 13:26:52.996061 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:52.996029    2565 generic.go:356] "Generic (PLEG): container finished" podID="e2cc589a-7a00-4dc8-b397-ab1c94d91888" containerID="df07b1e0a4b9a45d19eafebfa75d0dc3af6884554a323f465251fef5681292ec" exitCode=0
Jul 05 13:26:52.996223 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:52.996111    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx" event={"ID":"e2cc589a-7a00-4dc8-b397-ab1c94d91888","Type":"ContainerDied","Data":"df07b1e0a4b9a45d19eafebfa75d0dc3af6884554a323f465251fef5681292ec"}
Jul 05 13:26:53.150804 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:53.150767    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg"
Jul 05 13:26:53.153664 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:53.153619    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq"
Jul 05 13:26:53.161983 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:53.161953    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgbvs\" (UniqueName: \"kubernetes.io/projected/5ba58829-beca-4aa3-92f8-716632068bb7-kube-api-access-rgbvs\") pod \"5ba58829-beca-4aa3-92f8-716632068bb7\" (UID: \"5ba58829-beca-4aa3-92f8-716632068bb7\") "
Jul 05 13:26:53.162164 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:53.162017    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nd4c\" (UniqueName: \"kubernetes.io/projected/64eb7501-5af5-4646-83bb-9b436e7be1a3-kube-api-access-8nd4c\") pod \"64eb7501-5af5-4646-83bb-9b436e7be1a3\" (UID: \"64eb7501-5af5-4646-83bb-9b436e7be1a3\") "
Jul 05 13:26:53.162164 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:53.162057    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ba58829-beca-4aa3-92f8-716632068bb7-util\") pod \"5ba58829-beca-4aa3-92f8-716632068bb7\" (UID: \"5ba58829-beca-4aa3-92f8-716632068bb7\") "
Jul 05 13:26:53.162164 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:53.162081    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64eb7501-5af5-4646-83bb-9b436e7be1a3-util\") pod \"64eb7501-5af5-4646-83bb-9b436e7be1a3\" (UID: \"64eb7501-5af5-4646-83bb-9b436e7be1a3\") "
Jul 05 13:26:53.162164 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:53.162108    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64eb7501-5af5-4646-83bb-9b436e7be1a3-bundle\") pod \"64eb7501-5af5-4646-83bb-9b436e7be1a3\" (UID: \"64eb7501-5af5-4646-83bb-9b436e7be1a3\") "
Jul 05 13:26:53.162164 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:53.162135    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ba58829-beca-4aa3-92f8-716632068bb7-bundle\") pod \"5ba58829-beca-4aa3-92f8-716632068bb7\" (UID: \"5ba58829-beca-4aa3-92f8-716632068bb7\") "
Jul 05 13:26:53.162814 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:53.162759    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64eb7501-5af5-4646-83bb-9b436e7be1a3-bundle" (OuterVolumeSpecName: "bundle") pod "64eb7501-5af5-4646-83bb-9b436e7be1a3" (UID: "64eb7501-5af5-4646-83bb-9b436e7be1a3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:26:53.162931 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:53.162843    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ba58829-beca-4aa3-92f8-716632068bb7-bundle" (OuterVolumeSpecName: "bundle") pod "5ba58829-beca-4aa3-92f8-716632068bb7" (UID: "5ba58829-beca-4aa3-92f8-716632068bb7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:26:53.164747 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:53.164714    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64eb7501-5af5-4646-83bb-9b436e7be1a3-kube-api-access-8nd4c" (OuterVolumeSpecName: "kube-api-access-8nd4c") pod "64eb7501-5af5-4646-83bb-9b436e7be1a3" (UID: "64eb7501-5af5-4646-83bb-9b436e7be1a3"). InnerVolumeSpecName "kube-api-access-8nd4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:26:53.164848 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:53.164811    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ba58829-beca-4aa3-92f8-716632068bb7-kube-api-access-rgbvs" (OuterVolumeSpecName: "kube-api-access-rgbvs") pod "5ba58829-beca-4aa3-92f8-716632068bb7" (UID: "5ba58829-beca-4aa3-92f8-716632068bb7"). InnerVolumeSpecName "kube-api-access-rgbvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:26:53.167955 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:53.167930    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ba58829-beca-4aa3-92f8-716632068bb7-util" (OuterVolumeSpecName: "util") pod "5ba58829-beca-4aa3-92f8-716632068bb7" (UID: "5ba58829-beca-4aa3-92f8-716632068bb7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:26:53.168827 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:53.168799    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64eb7501-5af5-4646-83bb-9b436e7be1a3-util" (OuterVolumeSpecName: "util") pod "64eb7501-5af5-4646-83bb-9b436e7be1a3" (UID: "64eb7501-5af5-4646-83bb-9b436e7be1a3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:26:53.262813 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:53.262730    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ba58829-beca-4aa3-92f8-716632068bb7-util\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:26:53.262813 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:53.262757    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64eb7501-5af5-4646-83bb-9b436e7be1a3-util\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:26:53.262813 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:53.262768    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64eb7501-5af5-4646-83bb-9b436e7be1a3-bundle\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:26:53.262813 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:53.262775    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ba58829-beca-4aa3-92f8-716632068bb7-bundle\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:26:53.262813 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:53.262785    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgbvs\" (UniqueName: \"kubernetes.io/projected/5ba58829-beca-4aa3-92f8-716632068bb7-kube-api-access-rgbvs\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:26:53.262813 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:53.262795    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nd4c\" (UniqueName: \"kubernetes.io/projected/64eb7501-5af5-4646-83bb-9b436e7be1a3-kube-api-access-8nd4c\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:26:54.002278 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:54.002191    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg"
Jul 05 13:26:54.002278 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:54.002219    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg" event={"ID":"5ba58829-beca-4aa3-92f8-716632068bb7","Type":"ContainerDied","Data":"d8f1e0f8f4b2109dd280646ff7251d69f3e70396edb43ef58ba7b93689c17671"}
Jul 05 13:26:54.002278 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:54.002274    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8f1e0f8f4b2109dd280646ff7251d69f3e70396edb43ef58ba7b93689c17671"
Jul 05 13:26:54.004195 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:54.004166    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq" event={"ID":"64eb7501-5af5-4646-83bb-9b436e7be1a3","Type":"ContainerDied","Data":"01113361cfcf16f86e9c1d261823cebda6157830aa6c484e9d409eefa3ebd27f"}
Jul 05 13:26:54.004418 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:54.004393    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01113361cfcf16f86e9c1d261823cebda6157830aa6c484e9d409eefa3ebd27f"
Jul 05 13:26:54.004418 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:54.004197    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq"
Jul 05 13:26:54.133246 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:54.133217    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx"
Jul 05 13:26:54.177481 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:54.177321    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2cc589a-7a00-4dc8-b397-ab1c94d91888-util\") pod \"e2cc589a-7a00-4dc8-b397-ab1c94d91888\" (UID: \"e2cc589a-7a00-4dc8-b397-ab1c94d91888\") "
Jul 05 13:26:54.177678 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:54.177500    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7x4b\" (UniqueName: \"kubernetes.io/projected/e2cc589a-7a00-4dc8-b397-ab1c94d91888-kube-api-access-j7x4b\") pod \"e2cc589a-7a00-4dc8-b397-ab1c94d91888\" (UID: \"e2cc589a-7a00-4dc8-b397-ab1c94d91888\") "
Jul 05 13:26:54.177678 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:54.177557    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2cc589a-7a00-4dc8-b397-ab1c94d91888-bundle\") pod \"e2cc589a-7a00-4dc8-b397-ab1c94d91888\" (UID: \"e2cc589a-7a00-4dc8-b397-ab1c94d91888\") "
Jul 05 13:26:54.178080 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:54.178047    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2cc589a-7a00-4dc8-b397-ab1c94d91888-bundle" (OuterVolumeSpecName: "bundle") pod "e2cc589a-7a00-4dc8-b397-ab1c94d91888" (UID: "e2cc589a-7a00-4dc8-b397-ab1c94d91888"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:26:54.180163 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:54.180130    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2cc589a-7a00-4dc8-b397-ab1c94d91888-kube-api-access-j7x4b" (OuterVolumeSpecName: "kube-api-access-j7x4b") pod "e2cc589a-7a00-4dc8-b397-ab1c94d91888" (UID: "e2cc589a-7a00-4dc8-b397-ab1c94d91888"). InnerVolumeSpecName "kube-api-access-j7x4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:26:54.185858 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:54.185817    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2cc589a-7a00-4dc8-b397-ab1c94d91888-util" (OuterVolumeSpecName: "util") pod "e2cc589a-7a00-4dc8-b397-ab1c94d91888" (UID: "e2cc589a-7a00-4dc8-b397-ab1c94d91888"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:26:54.279198 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:54.279111    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2cc589a-7a00-4dc8-b397-ab1c94d91888-util\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:26:54.279198 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:54.279146    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7x4b\" (UniqueName: \"kubernetes.io/projected/e2cc589a-7a00-4dc8-b397-ab1c94d91888-kube-api-access-j7x4b\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:26:54.279198 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:54.279161    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2cc589a-7a00-4dc8-b397-ab1c94d91888-bundle\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:26:55.010534 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:55.010494    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx" event={"ID":"e2cc589a-7a00-4dc8-b397-ab1c94d91888","Type":"ContainerDied","Data":"cedc3c10f22bd9700c8bd0610a2bc933bdf9169536fccbef4aa81cce40e005eb"}
Jul 05 13:26:55.010534 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:55.010542    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cedc3c10f22bd9700c8bd0610a2bc933bdf9169536fccbef4aa81cce40e005eb"
Jul 05 13:26:55.011006 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:26:55.010510    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx"
Jul 05 13:28:06.841486 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841445    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841761    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2cc589a-7a00-4dc8-b397-ab1c94d91888" containerName="util"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841776    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2cc589a-7a00-4dc8-b397-ab1c94d91888" containerName="util"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841789    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64eb7501-5af5-4646-83bb-9b436e7be1a3" containerName="util"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841794    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="64eb7501-5af5-4646-83bb-9b436e7be1a3" containerName="util"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841803    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64eb7501-5af5-4646-83bb-9b436e7be1a3" containerName="pull"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841808    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="64eb7501-5af5-4646-83bb-9b436e7be1a3" containerName="pull"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841818    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64eb7501-5af5-4646-83bb-9b436e7be1a3" containerName="extract"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841823    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="64eb7501-5af5-4646-83bb-9b436e7be1a3" containerName="extract"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841829    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2cc589a-7a00-4dc8-b397-ab1c94d91888" containerName="pull"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841833    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2cc589a-7a00-4dc8-b397-ab1c94d91888" containerName="pull"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841840    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ba58829-beca-4aa3-92f8-716632068bb7" containerName="util"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841845    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ba58829-beca-4aa3-92f8-716632068bb7" containerName="util"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841854    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bf1fef7-3d0f-4991-bab6-0aec83f6aed6" containerName="util"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841862    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bf1fef7-3d0f-4991-bab6-0aec83f6aed6" containerName="util"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841869    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bf1fef7-3d0f-4991-bab6-0aec83f6aed6" containerName="pull"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841873    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bf1fef7-3d0f-4991-bab6-0aec83f6aed6" containerName="pull"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841878    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2cc589a-7a00-4dc8-b397-ab1c94d91888" containerName="extract"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841883    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2cc589a-7a00-4dc8-b397-ab1c94d91888" containerName="extract"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841891    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ba58829-beca-4aa3-92f8-716632068bb7" containerName="pull"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841896    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ba58829-beca-4aa3-92f8-716632068bb7" containerName="pull"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841906    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ba58829-beca-4aa3-92f8-716632068bb7" containerName="extract"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841912    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ba58829-beca-4aa3-92f8-716632068bb7" containerName="extract"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841918    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bf1fef7-3d0f-4991-bab6-0aec83f6aed6" containerName="extract"
Jul 05 13:28:06.841928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841922    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bf1fef7-3d0f-4991-bab6-0aec83f6aed6" containerName="extract"
Jul 05 13:28:06.842720 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841972    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="64eb7501-5af5-4646-83bb-9b436e7be1a3" containerName="extract"
Jul 05 13:28:06.842720 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841980    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2cc589a-7a00-4dc8-b397-ab1c94d91888" containerName="extract"
Jul 05 13:28:06.842720 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841986    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ba58829-beca-4aa3-92f8-716632068bb7" containerName="extract"
Jul 05 13:28:06.842720 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.841991    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bf1fef7-3d0f-4991-bab6-0aec83f6aed6" containerName="extract"
Jul 05 13:28:06.849028 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.849000    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"
Jul 05 13:28:06.850462 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.850436    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/11aac4b6-00c7-4789-b8cc-c3a328b7f984-config-file\") pod \"limitador-limitador-54d6d988d5-dfgzw\" (UID: \"11aac4b6-00c7-4789-b8cc-c3a328b7f984\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"
Jul 05 13:28:06.850568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.850499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvrxc\" (UniqueName: \"kubernetes.io/projected/11aac4b6-00c7-4789-b8cc-c3a328b7f984-kube-api-access-vvrxc\") pod \"limitador-limitador-54d6d988d5-dfgzw\" (UID: \"11aac4b6-00c7-4789-b8cc-c3a328b7f984\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"
Jul 05 13:28:06.851733 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.851704    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 05 13:28:06.851887 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.851705    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 05 13:28:06.852344 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.852308    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 05 13:28:06.852438 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.852386    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4crjk\""
Jul 05 13:28:06.855189 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.855163    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:28:06.886598 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.886554    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:28:06.951009 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.950966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvrxc\" (UniqueName: \"kubernetes.io/projected/11aac4b6-00c7-4789-b8cc-c3a328b7f984-kube-api-access-vvrxc\") pod \"limitador-limitador-54d6d988d5-dfgzw\" (UID: \"11aac4b6-00c7-4789-b8cc-c3a328b7f984\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"
Jul 05 13:28:06.951220 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.951016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/11aac4b6-00c7-4789-b8cc-c3a328b7f984-config-file\") pod \"limitador-limitador-54d6d988d5-dfgzw\" (UID: \"11aac4b6-00c7-4789-b8cc-c3a328b7f984\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"
Jul 05 13:28:06.951725 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.951703    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/11aac4b6-00c7-4789-b8cc-c3a328b7f984-config-file\") pod \"limitador-limitador-54d6d988d5-dfgzw\" (UID: \"11aac4b6-00c7-4789-b8cc-c3a328b7f984\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"
Jul 05 13:28:06.959498 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:06.959469    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvrxc\" (UniqueName: \"kubernetes.io/projected/11aac4b6-00c7-4789-b8cc-c3a328b7f984-kube-api-access-vvrxc\") pod \"limitador-limitador-54d6d988d5-dfgzw\" (UID: \"11aac4b6-00c7-4789-b8cc-c3a328b7f984\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"
Jul 05 13:28:07.161135 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:07.161089    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"
Jul 05 13:28:07.179950 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:07.179918    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-s86nm"]
Jul 05 13:28:07.183226 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:07.183199    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-s86nm"
Jul 05 13:28:07.185943 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:07.185913    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7fvpx\""
Jul 05 13:28:07.192754 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:07.192725    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-s86nm"]
Jul 05 13:28:07.253257 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:07.253228    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s89gs\" (UniqueName: \"kubernetes.io/projected/e77abb76-7070-4377-8902-77160e6755d9-kube-api-access-s89gs\") pod \"authorino-58cd955675-s86nm\" (UID: \"e77abb76-7070-4377-8902-77160e6755d9\") " pod="kuadrant-system/authorino-58cd955675-s86nm"
Jul 05 13:28:07.305431 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:07.305402    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:28:07.308001 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:28:07.307973    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11aac4b6_00c7_4789_b8cc_c3a328b7f984.slice/crio-2e6dc5b5563b40a3e9c1a57f459bfa757dd9de4e75330bacd861ac3c80057325 WatchSource:0}: Error finding container 2e6dc5b5563b40a3e9c1a57f459bfa757dd9de4e75330bacd861ac3c80057325: Status 404 returned error can't find the container with id 2e6dc5b5563b40a3e9c1a57f459bfa757dd9de4e75330bacd861ac3c80057325
Jul 05 13:28:07.353902 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:07.353857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s89gs\" (UniqueName: \"kubernetes.io/projected/e77abb76-7070-4377-8902-77160e6755d9-kube-api-access-s89gs\") pod \"authorino-58cd955675-s86nm\" (UID: \"e77abb76-7070-4377-8902-77160e6755d9\") " pod="kuadrant-system/authorino-58cd955675-s86nm"
Jul 05 13:28:07.362934 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:07.362903    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s89gs\" (UniqueName: \"kubernetes.io/projected/e77abb76-7070-4377-8902-77160e6755d9-kube-api-access-s89gs\") pod \"authorino-58cd955675-s86nm\" (UID: \"e77abb76-7070-4377-8902-77160e6755d9\") " pod="kuadrant-system/authorino-58cd955675-s86nm"
Jul 05 13:28:07.365185 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:07.365154    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dfgzw" event={"ID":"11aac4b6-00c7-4789-b8cc-c3a328b7f984","Type":"ContainerStarted","Data":"2e6dc5b5563b40a3e9c1a57f459bfa757dd9de4e75330bacd861ac3c80057325"}
Jul 05 13:28:07.494906 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:07.494820    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-s86nm"
Jul 05 13:28:07.630863 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:07.630831    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-s86nm"]
Jul 05 13:28:07.632774 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:28:07.632737    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode77abb76_7070_4377_8902_77160e6755d9.slice/crio-47fb506d2390723b47c16b84f66d778b871c77e4b88f06661e178d07df1d64d6 WatchSource:0}: Error finding container 47fb506d2390723b47c16b84f66d778b871c77e4b88f06661e178d07df1d64d6: Status 404 returned error can't find the container with id 47fb506d2390723b47c16b84f66d778b871c77e4b88f06661e178d07df1d64d6
Jul 05 13:28:08.378613 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:08.378571    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-s86nm" event={"ID":"e77abb76-7070-4377-8902-77160e6755d9","Type":"ContainerStarted","Data":"47fb506d2390723b47c16b84f66d778b871c77e4b88f06661e178d07df1d64d6"}
Jul 05 13:28:12.006595 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:12.006508    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-s86nm"]
Jul 05 13:28:12.405101 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:12.405063    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-s86nm" event={"ID":"e77abb76-7070-4377-8902-77160e6755d9","Type":"ContainerStarted","Data":"fbd0efecafa073ae1338a7d801df49973507c776defbaa9ef2ac8be0937226b7"}
Jul 05 13:28:12.406627 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:12.406594    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dfgzw" event={"ID":"11aac4b6-00c7-4789-b8cc-c3a328b7f984","Type":"ContainerStarted","Data":"7d701bfb77feb6aba85363e807d090685cdc1bab45348e1fed27741d89f40bab"}
Jul 05 13:28:12.406783 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:12.406697    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"
Jul 05 13:28:12.420776 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:12.420725    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-s86nm" podStartSLOduration=1.3670482339999999 podStartE2EDuration="5.420708169s" totalImagesPullingTime="4.053659935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:28:12.419476157 +0000 UTC m=+595.237444096" watchObservedRunningTime="2026-07-05 13:28:12.420708169 +0000 UTC m=+595.238676143"
Jul 05 13:28:12.436078 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:12.436020    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-dfgzw" podStartSLOduration=2.017865627 podStartE2EDuration="6.436002455s" totalImagesPullingTime="4.418136828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:28:12.434198271 +0000 UTC m=+595.252166247" watchObservedRunningTime="2026-07-05 13:28:12.436002455 +0000 UTC m=+595.253970453"
Jul 05 13:28:13.411958 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:13.411909    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-s86nm" podUID="e77abb76-7070-4377-8902-77160e6755d9" containerName="authorino" containerID="cri-o://fbd0efecafa073ae1338a7d801df49973507c776defbaa9ef2ac8be0937226b7" gracePeriod=30
Jul 05 13:28:13.667526 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:13.667453    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-s86nm"
Jul 05 13:28:13.700650 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:13.700600    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s89gs\" (UniqueName: \"kubernetes.io/projected/e77abb76-7070-4377-8902-77160e6755d9-kube-api-access-s89gs\") pod \"e77abb76-7070-4377-8902-77160e6755d9\" (UID: \"e77abb76-7070-4377-8902-77160e6755d9\") "
Jul 05 13:28:13.702841 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:13.702800    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e77abb76-7070-4377-8902-77160e6755d9-kube-api-access-s89gs" (OuterVolumeSpecName: "kube-api-access-s89gs") pod "e77abb76-7070-4377-8902-77160e6755d9" (UID: "e77abb76-7070-4377-8902-77160e6755d9"). InnerVolumeSpecName "kube-api-access-s89gs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:28:13.801575 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:13.801538    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s89gs\" (UniqueName: \"kubernetes.io/projected/e77abb76-7070-4377-8902-77160e6755d9-kube-api-access-s89gs\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:28:14.417568 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:14.417532    2565 generic.go:356] "Generic (PLEG): container finished" podID="e77abb76-7070-4377-8902-77160e6755d9" containerID="fbd0efecafa073ae1338a7d801df49973507c776defbaa9ef2ac8be0937226b7" exitCode=0
Jul 05 13:28:14.418074 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:14.417576    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-s86nm"
Jul 05 13:28:14.418074 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:14.417625    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-s86nm" event={"ID":"e77abb76-7070-4377-8902-77160e6755d9","Type":"ContainerDied","Data":"fbd0efecafa073ae1338a7d801df49973507c776defbaa9ef2ac8be0937226b7"}
Jul 05 13:28:14.418074 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:14.417699    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-s86nm" event={"ID":"e77abb76-7070-4377-8902-77160e6755d9","Type":"ContainerDied","Data":"47fb506d2390723b47c16b84f66d778b871c77e4b88f06661e178d07df1d64d6"}
Jul 05 13:28:14.418074 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:14.417723    2565 scope.go:117] "RemoveContainer" containerID="fbd0efecafa073ae1338a7d801df49973507c776defbaa9ef2ac8be0937226b7"
Jul 05 13:28:14.426914 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:14.426894    2565 scope.go:117] "RemoveContainer" containerID="fbd0efecafa073ae1338a7d801df49973507c776defbaa9ef2ac8be0937226b7"
Jul 05 13:28:14.427255 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:28:14.427234    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbd0efecafa073ae1338a7d801df49973507c776defbaa9ef2ac8be0937226b7\": container with ID starting with fbd0efecafa073ae1338a7d801df49973507c776defbaa9ef2ac8be0937226b7 not found: ID does not exist" containerID="fbd0efecafa073ae1338a7d801df49973507c776defbaa9ef2ac8be0937226b7"
Jul 05 13:28:14.427319 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:14.427268    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbd0efecafa073ae1338a7d801df49973507c776defbaa9ef2ac8be0937226b7"} err="failed to get container status \"fbd0efecafa073ae1338a7d801df49973507c776defbaa9ef2ac8be0937226b7\": rpc error: code = NotFound desc = could not find container \"fbd0efecafa073ae1338a7d801df49973507c776defbaa9ef2ac8be0937226b7\": container with ID starting with fbd0efecafa073ae1338a7d801df49973507c776defbaa9ef2ac8be0937226b7 not found: ID does not exist"
Jul 05 13:28:14.438088 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:14.438051    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-s86nm"]
Jul 05 13:28:14.439918 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:14.439891    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-s86nm"]
Jul 05 13:28:15.740844 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:15.740812    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e77abb76-7070-4377-8902-77160e6755d9" path="/var/lib/kubelet/pods/e77abb76-7070-4377-8902-77160e6755d9/volumes"
Jul 05 13:28:17.592030 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:17.592000    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/1.log"
Jul 05 13:28:17.592474 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:17.592003    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/1.log"
Jul 05 13:28:17.596242 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:17.596216    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xj7gc_6c7ce124-8975-400e-9f0b-2527ee19af46/ovn-acl-logging/0.log"
Jul 05 13:28:17.596438 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:17.596345    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xj7gc_6c7ce124-8975-400e-9f0b-2527ee19af46/ovn-acl-logging/0.log"
Jul 05 13:28:23.412938 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:23.412907    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"
Jul 05 13:28:40.108915 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.108829    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zw9h8"]
Jul 05 13:28:40.109359 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.109120    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e77abb76-7070-4377-8902-77160e6755d9" containerName="authorino"
Jul 05 13:28:40.109359 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.109133    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e77abb76-7070-4377-8902-77160e6755d9" containerName="authorino"
Jul 05 13:28:40.109359 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.109189    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e77abb76-7070-4377-8902-77160e6755d9" containerName="authorino"
Jul 05 13:28:40.119492 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.119462    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zw9h8"
Jul 05 13:28:40.122065 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.122029    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zw9h8"]
Jul 05 13:28:40.122215 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.122108    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7fvpx\""
Jul 05 13:28:40.200706 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.200663    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p76k\" (UniqueName: \"kubernetes.io/projected/43e3120d-e9ee-4877-b5df-07ec52b9b9ee-kube-api-access-9p76k\") pod \"authorino-5d4b67c446-zw9h8\" (UID: \"43e3120d-e9ee-4877-b5df-07ec52b9b9ee\") " pod="kuadrant-system/authorino-5d4b67c446-zw9h8"
Jul 05 13:28:40.290726 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.290688    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zw9h8"]
Jul 05 13:28:40.290958 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:28:40.290936    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-9p76k], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-zw9h8" podUID="43e3120d-e9ee-4877-b5df-07ec52b9b9ee"
Jul 05 13:28:40.302060 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.302020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p76k\" (UniqueName: \"kubernetes.io/projected/43e3120d-e9ee-4877-b5df-07ec52b9b9ee-kube-api-access-9p76k\") pod \"authorino-5d4b67c446-zw9h8\" (UID: \"43e3120d-e9ee-4877-b5df-07ec52b9b9ee\") " pod="kuadrant-system/authorino-5d4b67c446-zw9h8"
Jul 05 13:28:40.310514 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.310480    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p76k\" (UniqueName: \"kubernetes.io/projected/43e3120d-e9ee-4877-b5df-07ec52b9b9ee-kube-api-access-9p76k\") pod \"authorino-5d4b67c446-zw9h8\" (UID: \"43e3120d-e9ee-4877-b5df-07ec52b9b9ee\") " pod="kuadrant-system/authorino-5d4b67c446-zw9h8"
Jul 05 13:28:40.318042 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.318011    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-ntptz"]
Jul 05 13:28:40.320183 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.320163    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-ntptz"
Jul 05 13:28:40.322536 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.322512    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 05 13:28:40.329990 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.329961    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-ntptz"]
Jul 05 13:28:40.349945 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.349911    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-ntptz"]
Jul 05 13:28:40.350163 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:28:40.350145    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-966jv tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-966jv tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-ntptz" podUID="379a5e48-d9ae-494c-b03c-a4b2878f1bca"
Jul 05 13:28:40.377760 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.377660    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bd46b684c-wz2qp"]
Jul 05 13:28:40.379785 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.379757    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bd46b684c-wz2qp"
Jul 05 13:28:40.389494 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.389453    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bd46b684c-wz2qp"]
Jul 05 13:28:40.402665 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.402614    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-966jv\" (UniqueName: \"kubernetes.io/projected/379a5e48-d9ae-494c-b03c-a4b2878f1bca-kube-api-access-966jv\") pod \"authorino-76877994-ntptz\" (UID: \"379a5e48-d9ae-494c-b03c-a4b2878f1bca\") " pod="kuadrant-system/authorino-76877994-ntptz"
Jul 05 13:28:40.402866 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.402768    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/379a5e48-d9ae-494c-b03c-a4b2878f1bca-tls-cert\") pod \"authorino-76877994-ntptz\" (UID: \"379a5e48-d9ae-494c-b03c-a4b2878f1bca\") " pod="kuadrant-system/authorino-76877994-ntptz"
Jul 05 13:28:40.503759 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.503720    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21a94125-96f7-4ea3-8b80-991b56126f30-tls-cert\") pod \"authorino-7bd46b684c-wz2qp\" (UID: \"21a94125-96f7-4ea3-8b80-991b56126f30\") " pod="kuadrant-system/authorino-7bd46b684c-wz2qp"
Jul 05 13:28:40.503759 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.503760    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8zcj\" (UniqueName: \"kubernetes.io/projected/21a94125-96f7-4ea3-8b80-991b56126f30-kube-api-access-n8zcj\") pod \"authorino-7bd46b684c-wz2qp\" (UID: \"21a94125-96f7-4ea3-8b80-991b56126f30\") " pod="kuadrant-system/authorino-7bd46b684c-wz2qp"
Jul 05 13:28:40.503982 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.503794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/379a5e48-d9ae-494c-b03c-a4b2878f1bca-tls-cert\") pod \"authorino-76877994-ntptz\" (UID: \"379a5e48-d9ae-494c-b03c-a4b2878f1bca\") " pod="kuadrant-system/authorino-76877994-ntptz"
Jul 05 13:28:40.503982 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.503846    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-966jv\" (UniqueName: \"kubernetes.io/projected/379a5e48-d9ae-494c-b03c-a4b2878f1bca-kube-api-access-966jv\") pod \"authorino-76877994-ntptz\" (UID: \"379a5e48-d9ae-494c-b03c-a4b2878f1bca\") " pod="kuadrant-system/authorino-76877994-ntptz"
Jul 05 13:28:40.506240 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.506207    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/379a5e48-d9ae-494c-b03c-a4b2878f1bca-tls-cert\") pod \"authorino-76877994-ntptz\" (UID: \"379a5e48-d9ae-494c-b03c-a4b2878f1bca\") " pod="kuadrant-system/authorino-76877994-ntptz"
Jul 05 13:28:40.513661 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.513607    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-966jv\" (UniqueName: \"kubernetes.io/projected/379a5e48-d9ae-494c-b03c-a4b2878f1bca-kube-api-access-966jv\") pod \"authorino-76877994-ntptz\" (UID: \"379a5e48-d9ae-494c-b03c-a4b2878f1bca\") " pod="kuadrant-system/authorino-76877994-ntptz"
Jul 05 13:28:40.545624 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.545592    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-ntptz"
Jul 05 13:28:40.545793 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.545592    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zw9h8"
Jul 05 13:28:40.552035 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.552005    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-ntptz"
Jul 05 13:28:40.555019 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.554995    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zw9h8"
Jul 05 13:28:40.604163 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.604127    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/379a5e48-d9ae-494c-b03c-a4b2878f1bca-tls-cert\") pod \"379a5e48-d9ae-494c-b03c-a4b2878f1bca\" (UID: \"379a5e48-d9ae-494c-b03c-a4b2878f1bca\") "
Jul 05 13:28:40.604360 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.604182    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-966jv\" (UniqueName: \"kubernetes.io/projected/379a5e48-d9ae-494c-b03c-a4b2878f1bca-kube-api-access-966jv\") pod \"379a5e48-d9ae-494c-b03c-a4b2878f1bca\" (UID: \"379a5e48-d9ae-494c-b03c-a4b2878f1bca\") "
Jul 05 13:28:40.604360 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.604227    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9p76k\" (UniqueName: \"kubernetes.io/projected/43e3120d-e9ee-4877-b5df-07ec52b9b9ee-kube-api-access-9p76k\") pod \"43e3120d-e9ee-4877-b5df-07ec52b9b9ee\" (UID: \"43e3120d-e9ee-4877-b5df-07ec52b9b9ee\") "
Jul 05 13:28:40.604360 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.604318    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21a94125-96f7-4ea3-8b80-991b56126f30-tls-cert\") pod \"authorino-7bd46b684c-wz2qp\" (UID: \"21a94125-96f7-4ea3-8b80-991b56126f30\") " pod="kuadrant-system/authorino-7bd46b684c-wz2qp"
Jul 05 13:28:40.604360 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.604344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8zcj\" (UniqueName: \"kubernetes.io/projected/21a94125-96f7-4ea3-8b80-991b56126f30-kube-api-access-n8zcj\") pod \"authorino-7bd46b684c-wz2qp\" (UID: \"21a94125-96f7-4ea3-8b80-991b56126f30\") " pod="kuadrant-system/authorino-7bd46b684c-wz2qp"
Jul 05 13:28:40.606515 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.606480    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/379a5e48-d9ae-494c-b03c-a4b2878f1bca-kube-api-access-966jv" (OuterVolumeSpecName: "kube-api-access-966jv") pod "379a5e48-d9ae-494c-b03c-a4b2878f1bca" (UID: "379a5e48-d9ae-494c-b03c-a4b2878f1bca"). InnerVolumeSpecName "kube-api-access-966jv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:28:40.606515 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.606500    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/379a5e48-d9ae-494c-b03c-a4b2878f1bca-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "379a5e48-d9ae-494c-b03c-a4b2878f1bca" (UID: "379a5e48-d9ae-494c-b03c-a4b2878f1bca"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:28:40.606673 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.606490    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43e3120d-e9ee-4877-b5df-07ec52b9b9ee-kube-api-access-9p76k" (OuterVolumeSpecName: "kube-api-access-9p76k") pod "43e3120d-e9ee-4877-b5df-07ec52b9b9ee" (UID: "43e3120d-e9ee-4877-b5df-07ec52b9b9ee"). InnerVolumeSpecName "kube-api-access-9p76k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:28:40.606827 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.606810    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21a94125-96f7-4ea3-8b80-991b56126f30-tls-cert\") pod \"authorino-7bd46b684c-wz2qp\" (UID: \"21a94125-96f7-4ea3-8b80-991b56126f30\") " pod="kuadrant-system/authorino-7bd46b684c-wz2qp"
Jul 05 13:28:40.615105 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.615082    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8zcj\" (UniqueName: \"kubernetes.io/projected/21a94125-96f7-4ea3-8b80-991b56126f30-kube-api-access-n8zcj\") pod \"authorino-7bd46b684c-wz2qp\" (UID: \"21a94125-96f7-4ea3-8b80-991b56126f30\") " pod="kuadrant-system/authorino-7bd46b684c-wz2qp"
Jul 05 13:28:40.689689 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.689552    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bd46b684c-wz2qp"
Jul 05 13:28:40.704990 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.704961    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-966jv\" (UniqueName: \"kubernetes.io/projected/379a5e48-d9ae-494c-b03c-a4b2878f1bca-kube-api-access-966jv\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:28:40.704990 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.704991    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9p76k\" (UniqueName: \"kubernetes.io/projected/43e3120d-e9ee-4877-b5df-07ec52b9b9ee-kube-api-access-9p76k\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:28:40.705129 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.705001    2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/379a5e48-d9ae-494c-b03c-a4b2878f1bca-tls-cert\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:28:40.820125 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:40.820100    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bd46b684c-wz2qp"]
Jul 05 13:28:40.822051 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:28:40.822023    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21a94125_96f7_4ea3_8b80_991b56126f30.slice/crio-5e897a087f38483a33761da37ff4116d5197892e5238416bffcb9bd9a2c09a74 WatchSource:0}: Error finding container 5e897a087f38483a33761da37ff4116d5197892e5238416bffcb9bd9a2c09a74: Status 404 returned error can't find the container with id 5e897a087f38483a33761da37ff4116d5197892e5238416bffcb9bd9a2c09a74
Jul 05 13:28:41.552233 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:41.552143    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zw9h8"
Jul 05 13:28:41.552233 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:41.552175    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bd46b684c-wz2qp" event={"ID":"21a94125-96f7-4ea3-8b80-991b56126f30","Type":"ContainerStarted","Data":"6c997af31175cfe25898f9e585cbebff9327813bb7565e6e6e735d9b66303908"}
Jul 05 13:28:41.552233 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:41.552219    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bd46b684c-wz2qp" event={"ID":"21a94125-96f7-4ea3-8b80-991b56126f30","Type":"ContainerStarted","Data":"5e897a087f38483a33761da37ff4116d5197892e5238416bffcb9bd9a2c09a74"}
Jul 05 13:28:41.552895 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:41.552397    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-ntptz"
Jul 05 13:28:41.575302 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:41.575247    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bd46b684c-wz2qp" podStartSLOduration=1.278857108 podStartE2EDuration="1.5752288s" totalImagesPullingTime="296.371692ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:28:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:28:41.573661727 +0000 UTC m=+624.391629685" watchObservedRunningTime="2026-07-05 13:28:41.5752288 +0000 UTC m=+624.393196767"
Jul 05 13:28:41.608904 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:41.608860    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-ntptz"]
Jul 05 13:28:41.616489 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:41.616452    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-ntptz"]
Jul 05 13:28:41.650580 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:41.650544    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zw9h8"]
Jul 05 13:28:41.653404 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:41.653376    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zw9h8"]
Jul 05 13:28:41.743701 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:41.743669    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="379a5e48-d9ae-494c-b03c-a4b2878f1bca" path="/var/lib/kubelet/pods/379a5e48-d9ae-494c-b03c-a4b2878f1bca/volumes"
Jul 05 13:28:41.743929 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:28:41.743917    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43e3120d-e9ee-4877-b5df-07ec52b9b9ee" path="/var/lib/kubelet/pods/43e3120d-e9ee-4877-b5df-07ec52b9b9ee/volumes"
Jul 05 13:29:25.493188 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:29:25.493151    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:30:05.728846 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:05.728806    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:30:20.401143 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:20.401053    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:30:30.113475 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:30.113430    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:30:33.908368 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:33.908306    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:30:55.900614 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:55.900568    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:30:59.694454 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.694405    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"]
Jul 05 13:30:59.697749 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.697724    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:30:59.701191 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.701157    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 05 13:30:59.701191 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.701157    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 05 13:30:59.701191 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.701193    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 05 13:30:59.701429 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.701158    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bmbgn\""
Jul 05 13:30:59.709066 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.709037    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"]
Jul 05 13:30:59.746043 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.745997    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69f9eb6d-1584-42d5-b30e-30e2795e9809-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4\" (UID: \"69f9eb6d-1584-42d5-b30e-30e2795e9809\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:30:59.746043 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.746047    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69f9eb6d-1584-42d5-b30e-30e2795e9809-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4\" (UID: \"69f9eb6d-1584-42d5-b30e-30e2795e9809\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:30:59.746269 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.746065    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69f9eb6d-1584-42d5-b30e-30e2795e9809-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4\" (UID: \"69f9eb6d-1584-42d5-b30e-30e2795e9809\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:30:59.746269 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.746141    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwrjp\" (UniqueName: \"kubernetes.io/projected/69f9eb6d-1584-42d5-b30e-30e2795e9809-kube-api-access-bwrjp\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4\" (UID: \"69f9eb6d-1584-42d5-b30e-30e2795e9809\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:30:59.746269 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.746185    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69f9eb6d-1584-42d5-b30e-30e2795e9809-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4\" (UID: \"69f9eb6d-1584-42d5-b30e-30e2795e9809\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:30:59.746269 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.746208    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69f9eb6d-1584-42d5-b30e-30e2795e9809-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4\" (UID: \"69f9eb6d-1584-42d5-b30e-30e2795e9809\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:30:59.847053 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.847011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69f9eb6d-1584-42d5-b30e-30e2795e9809-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4\" (UID: \"69f9eb6d-1584-42d5-b30e-30e2795e9809\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:30:59.847218 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.847068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69f9eb6d-1584-42d5-b30e-30e2795e9809-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4\" (UID: \"69f9eb6d-1584-42d5-b30e-30e2795e9809\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:30:59.847218 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.847092    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69f9eb6d-1584-42d5-b30e-30e2795e9809-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4\" (UID: \"69f9eb6d-1584-42d5-b30e-30e2795e9809\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:30:59.847218 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.847119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69f9eb6d-1584-42d5-b30e-30e2795e9809-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4\" (UID: \"69f9eb6d-1584-42d5-b30e-30e2795e9809\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:30:59.847218 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.847149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwrjp\" (UniqueName: \"kubernetes.io/projected/69f9eb6d-1584-42d5-b30e-30e2795e9809-kube-api-access-bwrjp\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4\" (UID: \"69f9eb6d-1584-42d5-b30e-30e2795e9809\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:30:59.847218 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.847177    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69f9eb6d-1584-42d5-b30e-30e2795e9809-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4\" (UID: \"69f9eb6d-1584-42d5-b30e-30e2795e9809\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:30:59.847497 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.847474    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69f9eb6d-1584-42d5-b30e-30e2795e9809-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4\" (UID: \"69f9eb6d-1584-42d5-b30e-30e2795e9809\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:30:59.847553 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.847532    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69f9eb6d-1584-42d5-b30e-30e2795e9809-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4\" (UID: \"69f9eb6d-1584-42d5-b30e-30e2795e9809\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:30:59.847651 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.847615    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69f9eb6d-1584-42d5-b30e-30e2795e9809-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4\" (UID: \"69f9eb6d-1584-42d5-b30e-30e2795e9809\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:30:59.849685 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.849663    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69f9eb6d-1584-42d5-b30e-30e2795e9809-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4\" (UID: \"69f9eb6d-1584-42d5-b30e-30e2795e9809\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:30:59.849826 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.849737    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69f9eb6d-1584-42d5-b30e-30e2795e9809-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4\" (UID: \"69f9eb6d-1584-42d5-b30e-30e2795e9809\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:30:59.858402 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:30:59.858371    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwrjp\" (UniqueName: \"kubernetes.io/projected/69f9eb6d-1584-42d5-b30e-30e2795e9809-kube-api-access-bwrjp\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4\" (UID: \"69f9eb6d-1584-42d5-b30e-30e2795e9809\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:31:00.006622 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:31:00.006531    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:31:00.141386 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:31:00.141353    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"]
Jul 05 13:31:00.142928 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:31:00.142902    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69f9eb6d_1584_42d5_b30e_30e2795e9809.slice/crio-b9c4748ebb2d686dbb5a23ac13b7565fdab2f6bec8ca394cadbb0fa70df11d4e WatchSource:0}: Error finding container b9c4748ebb2d686dbb5a23ac13b7565fdab2f6bec8ca394cadbb0fa70df11d4e: Status 404 returned error can't find the container with id b9c4748ebb2d686dbb5a23ac13b7565fdab2f6bec8ca394cadbb0fa70df11d4e
Jul 05 13:31:00.144175 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:31:00.144155    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 13:31:00.224721 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:31:00.224686    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4" event={"ID":"69f9eb6d-1584-42d5-b30e-30e2795e9809","Type":"ContainerStarted","Data":"b9c4748ebb2d686dbb5a23ac13b7565fdab2f6bec8ca394cadbb0fa70df11d4e"}
Jul 05 13:31:02.235264 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:31:02.235226    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4" event={"ID":"69f9eb6d-1584-42d5-b30e-30e2795e9809","Type":"ContainerStarted","Data":"949094d07b66ba21c10fe5494e1025792f17c9a8f4bba66f632cc6c99ae877b8"}
Jul 05 13:31:02.256082 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:31:02.256024    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4" podStartSLOduration=2.221417183 podStartE2EDuration="3.256006495s" totalImagesPullingTime="1.034589312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:30:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:31:02.254712205 +0000 UTC m=+765.072680164" watchObservedRunningTime="2026-07-05 13:31:02.256006495 +0000 UTC m=+765.073974440"
Jul 05 13:31:03.999730 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:31:03.999680    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:31:10.007213 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:31:10.007171    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:31:10.007627 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:31:10.007236    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:31:10.019949 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:31:10.019909    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:31:10.286324 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:31:10.286233    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4"
Jul 05 13:32:38.386116 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:38.386074    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-848d544854-grk7f"]
Jul 05 13:32:38.389232 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:38.389209    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-848d544854-grk7f"
Jul 05 13:32:38.398457 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:38.398423    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-848d544854-grk7f"]
Jul 05 13:32:38.496206 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:38.496154    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5a8a418e-70a1-4d06-9ef6-39e77901fe0b-tls-cert\") pod \"authorino-848d544854-grk7f\" (UID: \"5a8a418e-70a1-4d06-9ef6-39e77901fe0b\") " pod="kuadrant-system/authorino-848d544854-grk7f"
Jul 05 13:32:38.496412 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:38.496263    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fst59\" (UniqueName: \"kubernetes.io/projected/5a8a418e-70a1-4d06-9ef6-39e77901fe0b-kube-api-access-fst59\") pod \"authorino-848d544854-grk7f\" (UID: \"5a8a418e-70a1-4d06-9ef6-39e77901fe0b\") " pod="kuadrant-system/authorino-848d544854-grk7f"
Jul 05 13:32:38.597608 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:38.597572    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5a8a418e-70a1-4d06-9ef6-39e77901fe0b-tls-cert\") pod \"authorino-848d544854-grk7f\" (UID: \"5a8a418e-70a1-4d06-9ef6-39e77901fe0b\") " pod="kuadrant-system/authorino-848d544854-grk7f"
Jul 05 13:32:38.597786 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:38.597672    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fst59\" (UniqueName: \"kubernetes.io/projected/5a8a418e-70a1-4d06-9ef6-39e77901fe0b-kube-api-access-fst59\") pod \"authorino-848d544854-grk7f\" (UID: \"5a8a418e-70a1-4d06-9ef6-39e77901fe0b\") " pod="kuadrant-system/authorino-848d544854-grk7f"
Jul 05 13:32:38.600104 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:38.600082    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5a8a418e-70a1-4d06-9ef6-39e77901fe0b-tls-cert\") pod \"authorino-848d544854-grk7f\" (UID: \"5a8a418e-70a1-4d06-9ef6-39e77901fe0b\") " pod="kuadrant-system/authorino-848d544854-grk7f"
Jul 05 13:32:38.607423 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:38.607396    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fst59\" (UniqueName: \"kubernetes.io/projected/5a8a418e-70a1-4d06-9ef6-39e77901fe0b-kube-api-access-fst59\") pod \"authorino-848d544854-grk7f\" (UID: \"5a8a418e-70a1-4d06-9ef6-39e77901fe0b\") " pod="kuadrant-system/authorino-848d544854-grk7f"
Jul 05 13:32:38.699195 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:38.699100    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-848d544854-grk7f"
Jul 05 13:32:38.846291 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:38.846262    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-848d544854-grk7f"]
Jul 05 13:32:38.848649 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:32:38.848609    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a8a418e_70a1_4d06_9ef6_39e77901fe0b.slice/crio-62628a023493accf6d2c87d717ec3a16682bb6a9e5030f3c37ee071eca33f24b WatchSource:0}: Error finding container 62628a023493accf6d2c87d717ec3a16682bb6a9e5030f3c37ee071eca33f24b: Status 404 returned error can't find the container with id 62628a023493accf6d2c87d717ec3a16682bb6a9e5030f3c37ee071eca33f24b
Jul 05 13:32:39.727064 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:39.727026    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-848d544854-grk7f" event={"ID":"5a8a418e-70a1-4d06-9ef6-39e77901fe0b","Type":"ContainerStarted","Data":"95958103406a3fb8b5a784645da87ccc0d278e4aced205b6ee7f1acd3cdcd858"}
Jul 05 13:32:39.727064 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:39.727070    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-848d544854-grk7f" event={"ID":"5a8a418e-70a1-4d06-9ef6-39e77901fe0b","Type":"ContainerStarted","Data":"62628a023493accf6d2c87d717ec3a16682bb6a9e5030f3c37ee071eca33f24b"}
Jul 05 13:32:39.754646 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:39.754547    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-848d544854-grk7f" podStartSLOduration=1.365254717 podStartE2EDuration="1.754529842s" totalImagesPullingTime="389.275125ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:32:39.752403721 +0000 UTC m=+862.570371727" watchObservedRunningTime="2026-07-05 13:32:39.754529842 +0000 UTC m=+862.572497798"
Jul 05 13:32:39.814264 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:39.814230    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bd46b684c-wz2qp"]
Jul 05 13:32:39.814438 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:39.814402    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7bd46b684c-wz2qp" podUID="21a94125-96f7-4ea3-8b80-991b56126f30" containerName="authorino" containerID="cri-o://6c997af31175cfe25898f9e585cbebff9327813bb7565e6e6e735d9b66303908" gracePeriod=30
Jul 05 13:32:40.082844 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:40.082813    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bd46b684c-wz2qp"
Jul 05 13:32:40.110878 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:40.110839    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21a94125-96f7-4ea3-8b80-991b56126f30-tls-cert\") pod \"21a94125-96f7-4ea3-8b80-991b56126f30\" (UID: \"21a94125-96f7-4ea3-8b80-991b56126f30\") "
Jul 05 13:32:40.122282 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:40.122247    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21a94125-96f7-4ea3-8b80-991b56126f30-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "21a94125-96f7-4ea3-8b80-991b56126f30" (UID: "21a94125-96f7-4ea3-8b80-991b56126f30"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:32:40.212118 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:40.212079    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8zcj\" (UniqueName: \"kubernetes.io/projected/21a94125-96f7-4ea3-8b80-991b56126f30-kube-api-access-n8zcj\") pod \"21a94125-96f7-4ea3-8b80-991b56126f30\" (UID: \"21a94125-96f7-4ea3-8b80-991b56126f30\") "
Jul 05 13:32:40.212331 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:40.212314    2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21a94125-96f7-4ea3-8b80-991b56126f30-tls-cert\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:32:40.214319 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:40.214278    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21a94125-96f7-4ea3-8b80-991b56126f30-kube-api-access-n8zcj" (OuterVolumeSpecName: "kube-api-access-n8zcj") pod "21a94125-96f7-4ea3-8b80-991b56126f30" (UID: "21a94125-96f7-4ea3-8b80-991b56126f30"). InnerVolumeSpecName "kube-api-access-n8zcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:32:40.313576 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:40.313474    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8zcj\" (UniqueName: \"kubernetes.io/projected/21a94125-96f7-4ea3-8b80-991b56126f30-kube-api-access-n8zcj\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:32:40.733731 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:40.733694    2565 generic.go:356] "Generic (PLEG): container finished" podID="21a94125-96f7-4ea3-8b80-991b56126f30" containerID="6c997af31175cfe25898f9e585cbebff9327813bb7565e6e6e735d9b66303908" exitCode=0
Jul 05 13:32:40.733731 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:40.733732    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bd46b684c-wz2qp"
Jul 05 13:32:40.734270 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:40.733778    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bd46b684c-wz2qp" event={"ID":"21a94125-96f7-4ea3-8b80-991b56126f30","Type":"ContainerDied","Data":"6c997af31175cfe25898f9e585cbebff9327813bb7565e6e6e735d9b66303908"}
Jul 05 13:32:40.734270 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:40.733832    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bd46b684c-wz2qp" event={"ID":"21a94125-96f7-4ea3-8b80-991b56126f30","Type":"ContainerDied","Data":"5e897a087f38483a33761da37ff4116d5197892e5238416bffcb9bd9a2c09a74"}
Jul 05 13:32:40.734270 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:40.733856    2565 scope.go:117] "RemoveContainer" containerID="6c997af31175cfe25898f9e585cbebff9327813bb7565e6e6e735d9b66303908"
Jul 05 13:32:40.743610 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:40.743587    2565 scope.go:117] "RemoveContainer" containerID="6c997af31175cfe25898f9e585cbebff9327813bb7565e6e6e735d9b66303908"
Jul 05 13:32:40.743987 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:32:40.743964    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c997af31175cfe25898f9e585cbebff9327813bb7565e6e6e735d9b66303908\": container with ID starting with 6c997af31175cfe25898f9e585cbebff9327813bb7565e6e6e735d9b66303908 not found: ID does not exist" containerID="6c997af31175cfe25898f9e585cbebff9327813bb7565e6e6e735d9b66303908"
Jul 05 13:32:40.744076 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:40.743997    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c997af31175cfe25898f9e585cbebff9327813bb7565e6e6e735d9b66303908"} err="failed to get container status \"6c997af31175cfe25898f9e585cbebff9327813bb7565e6e6e735d9b66303908\": rpc error: code = NotFound desc = could not find container \"6c997af31175cfe25898f9e585cbebff9327813bb7565e6e6e735d9b66303908\": container with ID starting with 6c997af31175cfe25898f9e585cbebff9327813bb7565e6e6e735d9b66303908 not found: ID does not exist"
Jul 05 13:32:40.755210 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:40.755169    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bd46b684c-wz2qp"]
Jul 05 13:32:40.761576 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:40.761544    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bd46b684c-wz2qp"]
Jul 05 13:32:41.741257 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:32:41.741224    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21a94125-96f7-4ea3-8b80-991b56126f30" path="/var/lib/kubelet/pods/21a94125-96f7-4ea3-8b80-991b56126f30/volumes"
Jul 05 13:33:07.101331 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:33:07.101290    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:33:17.623203 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:33:17.623124    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/1.log"
Jul 05 13:33:17.624802 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:33:17.624778    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/1.log"
Jul 05 13:33:17.627574 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:33:17.627556    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xj7gc_6c7ce124-8975-400e-9f0b-2527ee19af46/ovn-acl-logging/0.log"
Jul 05 13:33:17.628882 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:33:17.628861    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xj7gc_6c7ce124-8975-400e-9f0b-2527ee19af46/ovn-acl-logging/0.log"
Jul 05 13:33:19.970377 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:33:19.970336    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:33:28.801722 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:33:28.801684    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:33:37.401083 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:33:37.401037    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:33:48.396188 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:33:48.396152    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:34:15.301177 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:34:15.301129    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:34:26.199336 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:34:26.199293    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:34:59.691885 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:34:59.691796    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:35:07.896499 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:35:07.896465    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:35:17.413904 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:35:17.413865    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:35:23.100867 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:35:23.100830    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:35:34.306844 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:35:34.306798    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:35:45.001890 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:35:45.001853    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:35:56.703700 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:35:56.703658    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:36:05.608625 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:36:05.608585    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:36:29.108388 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:36:29.108348    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:36:37.903222 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:36:37.903184    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:37:00.902424 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:37:00.902381    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:37:10.197966 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:37:10.197918    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:37:28.402291 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:37:28.402250    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:37:37.602390 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:37:37.602351    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:37:47.001347 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:37:47.001235    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:37:56.296960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:37:56.296924    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:38:05.204752 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:38:05.204713    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:38:17.654814 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:38:17.654783    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/1.log"
Jul 05 13:38:17.656322 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:38:17.656303    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/1.log"
Jul 05 13:38:17.658821 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:38:17.658800    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xj7gc_6c7ce124-8975-400e-9f0b-2527ee19af46/ovn-acl-logging/0.log"
Jul 05 13:38:17.660539 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:38:17.660520    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xj7gc_6c7ce124-8975-400e-9f0b-2527ee19af46/ovn-acl-logging/0.log"
Jul 05 13:39:56.300662 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:39:56.300593    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:40:06.411145 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:40:06.411101    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:40:16.309767 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:40:16.309726    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:40:28.360838 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:40:28.359165    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:40:39.195052 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:40:39.194964    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:40:49.924718 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:40:49.924675    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:40:58.193913 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:40:58.193873    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:41:08.803874 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:41:08.803833    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:41:20.504374 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:41:20.504329    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:41:30.197321 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:41:30.197285    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:41:40.302609 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:41:40.302567    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:42:02.198317 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:42:02.198272    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:42:11.100854 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:42:11.100764    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:42:22.103699 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:42:22.103663    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:42:32.588249 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:42:32.588204    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:42:49.569506 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:42:49.569460    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:43:00.592694 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:43:00.592646    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:43:09.438357 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:43:09.438321    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:43:17.689182 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:43:17.689153    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/1.log"
Jul 05 13:43:17.689740 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:43:17.689720    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/1.log"
Jul 05 13:43:17.693331 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:43:17.693309    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xj7gc_6c7ce124-8975-400e-9f0b-2527ee19af46/ovn-acl-logging/0.log"
Jul 05 13:43:17.693780 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:43:17.693761    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xj7gc_6c7ce124-8975-400e-9f0b-2527ee19af46/ovn-acl-logging/0.log"
Jul 05 13:43:20.705928 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:43:20.705887    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:43:29.115862 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:43:29.115823    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:43:38.304415 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:43:38.304371    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:43:51.641045 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:43:51.640965    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:44:00.413334 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:44:00.413286    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:44:12.006156 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:44:12.006116    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:44:21.105885 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:44:21.105851    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:44:34.100132 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:44:34.100083    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:44:42.628606 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:44:42.628571    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:44:54.014679 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:44:54.014626    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:45:06.101624 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:45:06.101575    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:45:18.799212 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:45:18.799168    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:45:27.397623 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:45:27.397577    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:45:36.810990 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:45:36.810945    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:45:45.300756 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:45:45.300716    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:45:54.701854 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:45:54.701814    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:46:10.263839 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:10.263802    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc"]
Jul 05 13:46:10.264240 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:10.264128    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21a94125-96f7-4ea3-8b80-991b56126f30" containerName="authorino"
Jul 05 13:46:10.264240 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:10.264143    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="21a94125-96f7-4ea3-8b80-991b56126f30" containerName="authorino"
Jul 05 13:46:10.264240 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:10.264225    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="21a94125-96f7-4ea3-8b80-991b56126f30" containerName="authorino"
Jul 05 13:46:10.267262 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:10.267242    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc"
Jul 05 13:46:10.271748 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:10.271722    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-cfdb1b35-serving-cert\""
Jul 05 13:46:10.271902 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:10.271770    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9bvwj\""
Jul 05 13:46:10.292758 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:10.292715    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc"]
Jul 05 13:46:10.323212 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:10.323175    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bfa2328-c6b8-4499-b969-a3df38b52086-maas-api-tls\") pod \"maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc\" (UID: \"6bfa2328-c6b8-4499-b969-a3df38b52086\") " pod="opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc"
Jul 05 13:46:10.323411 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:10.323288    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fpdn\" (UniqueName: \"kubernetes.io/projected/6bfa2328-c6b8-4499-b969-a3df38b52086-kube-api-access-9fpdn\") pod \"maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc\" (UID: \"6bfa2328-c6b8-4499-b969-a3df38b52086\") " pod="opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc"
Jul 05 13:46:10.323411 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:10.323331    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bfa2328-c6b8-4499-b969-a3df38b52086-openshift-service-ca\") pod \"maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc\" (UID: \"6bfa2328-c6b8-4499-b969-a3df38b52086\") " pod="opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc"
Jul 05 13:46:10.424825 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:10.424724    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bfa2328-c6b8-4499-b969-a3df38b52086-maas-api-tls\") pod \"maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc\" (UID: \"6bfa2328-c6b8-4499-b969-a3df38b52086\") " pod="opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc"
Jul 05 13:46:10.424825 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:10.424784    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fpdn\" (UniqueName: \"kubernetes.io/projected/6bfa2328-c6b8-4499-b969-a3df38b52086-kube-api-access-9fpdn\") pod \"maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc\" (UID: \"6bfa2328-c6b8-4499-b969-a3df38b52086\") " pod="opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc"
Jul 05 13:46:10.424825 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:10.424812    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bfa2328-c6b8-4499-b969-a3df38b52086-openshift-service-ca\") pod \"maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc\" (UID: \"6bfa2328-c6b8-4499-b969-a3df38b52086\") " pod="opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc"
Jul 05 13:46:10.425119 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:46:10.424888    2565 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-cfdb1b35-serving-cert: secret "maas-api-e2e-ait-cfdb1b35-serving-cert" not found
Jul 05 13:46:10.425119 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:46:10.424965    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bfa2328-c6b8-4499-b969-a3df38b52086-maas-api-tls podName:6bfa2328-c6b8-4499-b969-a3df38b52086 nodeName:}" failed. No retries permitted until 2026-07-05 13:46:10.924946055 +0000 UTC m=+1673.742914012 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6bfa2328-c6b8-4499-b969-a3df38b52086-maas-api-tls") pod "maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc" (UID: "6bfa2328-c6b8-4499-b969-a3df38b52086") : secret "maas-api-e2e-ait-cfdb1b35-serving-cert" not found
Jul 05 13:46:10.425509 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:10.425485    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bfa2328-c6b8-4499-b969-a3df38b52086-openshift-service-ca\") pod \"maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc\" (UID: \"6bfa2328-c6b8-4499-b969-a3df38b52086\") " pod="opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc"
Jul 05 13:46:10.447038 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:10.447003    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fpdn\" (UniqueName: \"kubernetes.io/projected/6bfa2328-c6b8-4499-b969-a3df38b52086-kube-api-access-9fpdn\") pod \"maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc\" (UID: \"6bfa2328-c6b8-4499-b969-a3df38b52086\") " pod="opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc"
Jul 05 13:46:10.930559 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:10.930514    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bfa2328-c6b8-4499-b969-a3df38b52086-maas-api-tls\") pod \"maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc\" (UID: \"6bfa2328-c6b8-4499-b969-a3df38b52086\") " pod="opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc"
Jul 05 13:46:10.933144 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:10.933115    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bfa2328-c6b8-4499-b969-a3df38b52086-maas-api-tls\") pod \"maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc\" (UID: \"6bfa2328-c6b8-4499-b969-a3df38b52086\") " pod="opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc"
Jul 05 13:46:11.178351 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:11.178311    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc"
Jul 05 13:46:11.355210 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:11.355180    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc"]
Jul 05 13:46:11.357805 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:46:11.357772    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bfa2328_c6b8_4499_b969_a3df38b52086.slice/crio-49d445315f0ba7cac3241d82de075b263edbf2df6f1430a98391cd667091b4fe WatchSource:0}: Error finding container 49d445315f0ba7cac3241d82de075b263edbf2df6f1430a98391cd667091b4fe: Status 404 returned error can't find the container with id 49d445315f0ba7cac3241d82de075b263edbf2df6f1430a98391cd667091b4fe
Jul 05 13:46:11.359474 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:11.359455    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 13:46:11.750087 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:11.750049    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc" event={"ID":"6bfa2328-c6b8-4499-b969-a3df38b52086","Type":"ContainerStarted","Data":"49d445315f0ba7cac3241d82de075b263edbf2df6f1430a98391cd667091b4fe"}
Jul 05 13:46:13.761779 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:13.761741    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc" event={"ID":"6bfa2328-c6b8-4499-b969-a3df38b52086","Type":"ContainerStarted","Data":"f9b0783a6d92217fcd37d58d06e7e7f166bc1a062236a1bfe347a7a70140834c"}
Jul 05 13:46:13.762171 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:13.761882    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc"
Jul 05 13:46:13.803668 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:13.803592    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc" podStartSLOduration=2.388526817 podStartE2EDuration="3.803575278s" totalImagesPullingTime="1.415048461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:46:13.801771002 +0000 UTC m=+1676.619738985" watchObservedRunningTime="2026-07-05 13:46:13.803575278 +0000 UTC m=+1676.621543234"
Jul 05 13:46:15.581945 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:15.581899    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc"]
Jul 05 13:46:15.771886 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:15.771833    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc" podUID="6bfa2328-c6b8-4499-b969-a3df38b52086" containerName="maas-api" containerID="cri-o://f9b0783a6d92217fcd37d58d06e7e7f166bc1a062236a1bfe347a7a70140834c" gracePeriod=30
Jul 05 13:46:16.022385 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:16.022346    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc"
Jul 05 13:46:16.080875 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:16.080838    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bfa2328-c6b8-4499-b969-a3df38b52086-openshift-service-ca\") pod \"6bfa2328-c6b8-4499-b969-a3df38b52086\" (UID: \"6bfa2328-c6b8-4499-b969-a3df38b52086\") "
Jul 05 13:46:16.080875 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:16.080879    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fpdn\" (UniqueName: \"kubernetes.io/projected/6bfa2328-c6b8-4499-b969-a3df38b52086-kube-api-access-9fpdn\") pod \"6bfa2328-c6b8-4499-b969-a3df38b52086\" (UID: \"6bfa2328-c6b8-4499-b969-a3df38b52086\") "
Jul 05 13:46:16.081139 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:16.080914    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bfa2328-c6b8-4499-b969-a3df38b52086-maas-api-tls\") pod \"6bfa2328-c6b8-4499-b969-a3df38b52086\" (UID: \"6bfa2328-c6b8-4499-b969-a3df38b52086\") "
Jul 05 13:46:16.081287 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:16.081264    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bfa2328-c6b8-4499-b969-a3df38b52086-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6bfa2328-c6b8-4499-b969-a3df38b52086" (UID: "6bfa2328-c6b8-4499-b969-a3df38b52086"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:46:16.083311 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:16.083268    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bfa2328-c6b8-4499-b969-a3df38b52086-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6bfa2328-c6b8-4499-b969-a3df38b52086" (UID: "6bfa2328-c6b8-4499-b969-a3df38b52086"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:46:16.083311 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:16.083292    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bfa2328-c6b8-4499-b969-a3df38b52086-kube-api-access-9fpdn" (OuterVolumeSpecName: "kube-api-access-9fpdn") pod "6bfa2328-c6b8-4499-b969-a3df38b52086" (UID: "6bfa2328-c6b8-4499-b969-a3df38b52086"). InnerVolumeSpecName "kube-api-access-9fpdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:46:16.181960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:16.181863    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bfa2328-c6b8-4499-b969-a3df38b52086-openshift-service-ca\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:46:16.181960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:16.181899    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fpdn\" (UniqueName: \"kubernetes.io/projected/6bfa2328-c6b8-4499-b969-a3df38b52086-kube-api-access-9fpdn\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:46:16.181960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:16.181909    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bfa2328-c6b8-4499-b969-a3df38b52086-maas-api-tls\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:46:16.778586 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:16.778547    2565 generic.go:356] "Generic (PLEG): container finished" podID="6bfa2328-c6b8-4499-b969-a3df38b52086" containerID="f9b0783a6d92217fcd37d58d06e7e7f166bc1a062236a1bfe347a7a70140834c" exitCode=0
Jul 05 13:46:16.779005 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:16.778592    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc"
Jul 05 13:46:16.779005 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:16.778598    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc" event={"ID":"6bfa2328-c6b8-4499-b969-a3df38b52086","Type":"ContainerDied","Data":"f9b0783a6d92217fcd37d58d06e7e7f166bc1a062236a1bfe347a7a70140834c"}
Jul 05 13:46:16.779005 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:16.778664    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc" event={"ID":"6bfa2328-c6b8-4499-b969-a3df38b52086","Type":"ContainerDied","Data":"49d445315f0ba7cac3241d82de075b263edbf2df6f1430a98391cd667091b4fe"}
Jul 05 13:46:16.779005 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:16.778690    2565 scope.go:117] "RemoveContainer" containerID="f9b0783a6d92217fcd37d58d06e7e7f166bc1a062236a1bfe347a7a70140834c"
Jul 05 13:46:16.788411 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:16.788389    2565 scope.go:117] "RemoveContainer" containerID="f9b0783a6d92217fcd37d58d06e7e7f166bc1a062236a1bfe347a7a70140834c"
Jul 05 13:46:16.788729 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:46:16.788705    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9b0783a6d92217fcd37d58d06e7e7f166bc1a062236a1bfe347a7a70140834c\": container with ID starting with f9b0783a6d92217fcd37d58d06e7e7f166bc1a062236a1bfe347a7a70140834c not found: ID does not exist" containerID="f9b0783a6d92217fcd37d58d06e7e7f166bc1a062236a1bfe347a7a70140834c"
Jul 05 13:46:16.788825 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:16.788737    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9b0783a6d92217fcd37d58d06e7e7f166bc1a062236a1bfe347a7a70140834c"} err="failed to get container status \"f9b0783a6d92217fcd37d58d06e7e7f166bc1a062236a1bfe347a7a70140834c\": rpc error: code = NotFound desc = could not find container \"f9b0783a6d92217fcd37d58d06e7e7f166bc1a062236a1bfe347a7a70140834c\": container with ID starting with f9b0783a6d92217fcd37d58d06e7e7f166bc1a062236a1bfe347a7a70140834c not found: ID does not exist"
Jul 05 13:46:16.800983 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:16.800945    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc"]
Jul 05 13:46:16.808365 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:16.808335    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-cfdb1b35-6b5c44b78-blsxc"]
Jul 05 13:46:17.740263 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:17.740230    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bfa2328-c6b8-4499-b969-a3df38b52086" path="/var/lib/kubelet/pods/6bfa2328-c6b8-4499-b969-a3df38b52086/volumes"
Jul 05 13:46:29.159257 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:29.159218    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps"]
Jul 05 13:46:29.159615 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:29.159520    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bfa2328-c6b8-4499-b969-a3df38b52086" containerName="maas-api"
Jul 05 13:46:29.159615 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:29.159531    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bfa2328-c6b8-4499-b969-a3df38b52086" containerName="maas-api"
Jul 05 13:46:29.159615 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:29.159582    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bfa2328-c6b8-4499-b969-a3df38b52086" containerName="maas-api"
Jul 05 13:46:29.162415 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:29.162399    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps"
Jul 05 13:46:29.174853 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:29.174830    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-5d6488dd-serving-cert\""
Jul 05 13:46:29.174999 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:29.174830    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9bvwj\""
Jul 05 13:46:29.194725 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:29.194696    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps"]
Jul 05 13:46:29.301814 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:29.301773    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ca8a535-f1c0-4234-8112-e3719b8c4c52-maas-api-tls\") pod \"maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps\" (UID: \"7ca8a535-f1c0-4234-8112-e3719b8c4c52\") " pod="opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps"
Jul 05 13:46:29.301814 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:29.301818    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ca8a535-f1c0-4234-8112-e3719b8c4c52-openshift-service-ca\") pod \"maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps\" (UID: \"7ca8a535-f1c0-4234-8112-e3719b8c4c52\") " pod="opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps"
Jul 05 13:46:29.302033 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:29.301871    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m42m\" (UniqueName: \"kubernetes.io/projected/7ca8a535-f1c0-4234-8112-e3719b8c4c52-kube-api-access-4m42m\") pod \"maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps\" (UID: \"7ca8a535-f1c0-4234-8112-e3719b8c4c52\") " pod="opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps"
Jul 05 13:46:29.402376 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:29.402329    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ca8a535-f1c0-4234-8112-e3719b8c4c52-openshift-service-ca\") pod \"maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps\" (UID: \"7ca8a535-f1c0-4234-8112-e3719b8c4c52\") " pod="opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps"
Jul 05 13:46:29.402555 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:29.402396    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m42m\" (UniqueName: \"kubernetes.io/projected/7ca8a535-f1c0-4234-8112-e3719b8c4c52-kube-api-access-4m42m\") pod \"maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps\" (UID: \"7ca8a535-f1c0-4234-8112-e3719b8c4c52\") " pod="opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps"
Jul 05 13:46:29.402555 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:29.402491    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ca8a535-f1c0-4234-8112-e3719b8c4c52-maas-api-tls\") pod \"maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps\" (UID: \"7ca8a535-f1c0-4234-8112-e3719b8c4c52\") " pod="opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps"
Jul 05 13:46:29.403032 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:29.403011    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ca8a535-f1c0-4234-8112-e3719b8c4c52-openshift-service-ca\") pod \"maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps\" (UID: \"7ca8a535-f1c0-4234-8112-e3719b8c4c52\") " pod="opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps"
Jul 05 13:46:29.405039 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:29.405014    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ca8a535-f1c0-4234-8112-e3719b8c4c52-maas-api-tls\") pod \"maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps\" (UID: \"7ca8a535-f1c0-4234-8112-e3719b8c4c52\") " pod="opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps"
Jul 05 13:46:29.417755 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:29.417689    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m42m\" (UniqueName: \"kubernetes.io/projected/7ca8a535-f1c0-4234-8112-e3719b8c4c52-kube-api-access-4m42m\") pod \"maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps\" (UID: \"7ca8a535-f1c0-4234-8112-e3719b8c4c52\") " pod="opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps"
Jul 05 13:46:29.472784 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:29.472747    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps"
Jul 05 13:46:29.622132 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:29.622095    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps"]
Jul 05 13:46:29.625492 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:46:29.625467    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ca8a535_f1c0_4234_8112_e3719b8c4c52.slice/crio-80ab3fa520ae36a114f5f4d472cb42f980e052b7b4f645d7bdbac2b1bf1af40d WatchSource:0}: Error finding container 80ab3fa520ae36a114f5f4d472cb42f980e052b7b4f645d7bdbac2b1bf1af40d: Status 404 returned error can't find the container with id 80ab3fa520ae36a114f5f4d472cb42f980e052b7b4f645d7bdbac2b1bf1af40d
Jul 05 13:46:29.840478 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:29.840390    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps" event={"ID":"7ca8a535-f1c0-4234-8112-e3719b8c4c52","Type":"ContainerStarted","Data":"80ab3fa520ae36a114f5f4d472cb42f980e052b7b4f645d7bdbac2b1bf1af40d"}
Jul 05 13:46:30.847480 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:30.847448    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps" event={"ID":"7ca8a535-f1c0-4234-8112-e3719b8c4c52","Type":"ContainerStarted","Data":"48196c464600ed7be5823207e45bd544392f70fc1a6f4d46130e97852c92447f"}
Jul 05 13:46:30.847889 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:30.847508    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps"
Jul 05 13:46:30.875051 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:30.874993    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps" podStartSLOduration=1.446778554 podStartE2EDuration="1.874976541s" totalImagesPullingTime="428.197987ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:46:30.874044256 +0000 UTC m=+1693.692012232" watchObservedRunningTime="2026-07-05 13:46:30.874976541 +0000 UTC m=+1693.692944510"
Jul 05 13:46:33.798411 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:33.798372    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps"]
Jul 05 13:46:33.798896 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:33.798624    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps" podUID="7ca8a535-f1c0-4234-8112-e3719b8c4c52" containerName="maas-api" containerID="cri-o://48196c464600ed7be5823207e45bd544392f70fc1a6f4d46130e97852c92447f" gracePeriod=30
Jul 05 13:46:34.048181 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:34.048149    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps"
Jul 05 13:46:34.146043 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:34.145996    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ca8a535-f1c0-4234-8112-e3719b8c4c52-openshift-service-ca\") pod \"7ca8a535-f1c0-4234-8112-e3719b8c4c52\" (UID: \"7ca8a535-f1c0-4234-8112-e3719b8c4c52\") "
Jul 05 13:46:34.146263 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:34.146089    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ca8a535-f1c0-4234-8112-e3719b8c4c52-maas-api-tls\") pod \"7ca8a535-f1c0-4234-8112-e3719b8c4c52\" (UID: \"7ca8a535-f1c0-4234-8112-e3719b8c4c52\") "
Jul 05 13:46:34.146263 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:34.146166    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4m42m\" (UniqueName: \"kubernetes.io/projected/7ca8a535-f1c0-4234-8112-e3719b8c4c52-kube-api-access-4m42m\") pod \"7ca8a535-f1c0-4234-8112-e3719b8c4c52\" (UID: \"7ca8a535-f1c0-4234-8112-e3719b8c4c52\") "
Jul 05 13:46:34.146452 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:34.146425    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ca8a535-f1c0-4234-8112-e3719b8c4c52-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7ca8a535-f1c0-4234-8112-e3719b8c4c52" (UID: "7ca8a535-f1c0-4234-8112-e3719b8c4c52"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:46:34.148393 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:34.148351    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ca8a535-f1c0-4234-8112-e3719b8c4c52-kube-api-access-4m42m" (OuterVolumeSpecName: "kube-api-access-4m42m") pod "7ca8a535-f1c0-4234-8112-e3719b8c4c52" (UID: "7ca8a535-f1c0-4234-8112-e3719b8c4c52"). InnerVolumeSpecName "kube-api-access-4m42m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:46:34.148393 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:34.148380    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ca8a535-f1c0-4234-8112-e3719b8c4c52-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7ca8a535-f1c0-4234-8112-e3719b8c4c52" (UID: "7ca8a535-f1c0-4234-8112-e3719b8c4c52"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:46:34.247437 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:34.247397    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ca8a535-f1c0-4234-8112-e3719b8c4c52-maas-api-tls\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:46:34.247437 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:34.247430    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m42m\" (UniqueName: \"kubernetes.io/projected/7ca8a535-f1c0-4234-8112-e3719b8c4c52-kube-api-access-4m42m\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:46:34.247437 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:34.247441    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ca8a535-f1c0-4234-8112-e3719b8c4c52-openshift-service-ca\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:46:34.867386 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:34.867352    2565 generic.go:356] "Generic (PLEG): container finished" podID="7ca8a535-f1c0-4234-8112-e3719b8c4c52" containerID="48196c464600ed7be5823207e45bd544392f70fc1a6f4d46130e97852c92447f" exitCode=0
Jul 05 13:46:34.867895 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:34.867399    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps"
Jul 05 13:46:34.867895 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:34.867446    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps" event={"ID":"7ca8a535-f1c0-4234-8112-e3719b8c4c52","Type":"ContainerDied","Data":"48196c464600ed7be5823207e45bd544392f70fc1a6f4d46130e97852c92447f"}
Jul 05 13:46:34.867895 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:34.867508    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps" event={"ID":"7ca8a535-f1c0-4234-8112-e3719b8c4c52","Type":"ContainerDied","Data":"80ab3fa520ae36a114f5f4d472cb42f980e052b7b4f645d7bdbac2b1bf1af40d"}
Jul 05 13:46:34.867895 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:34.867542    2565 scope.go:117] "RemoveContainer" containerID="48196c464600ed7be5823207e45bd544392f70fc1a6f4d46130e97852c92447f"
Jul 05 13:46:34.877075 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:34.877055    2565 scope.go:117] "RemoveContainer" containerID="48196c464600ed7be5823207e45bd544392f70fc1a6f4d46130e97852c92447f"
Jul 05 13:46:34.877414 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:46:34.877392    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48196c464600ed7be5823207e45bd544392f70fc1a6f4d46130e97852c92447f\": container with ID starting with 48196c464600ed7be5823207e45bd544392f70fc1a6f4d46130e97852c92447f not found: ID does not exist" containerID="48196c464600ed7be5823207e45bd544392f70fc1a6f4d46130e97852c92447f"
Jul 05 13:46:34.877473 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:34.877424    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48196c464600ed7be5823207e45bd544392f70fc1a6f4d46130e97852c92447f"} err="failed to get container status \"48196c464600ed7be5823207e45bd544392f70fc1a6f4d46130e97852c92447f\": rpc error: code = NotFound desc = could not find container \"48196c464600ed7be5823207e45bd544392f70fc1a6f4d46130e97852c92447f\": container with ID starting with 48196c464600ed7be5823207e45bd544392f70fc1a6f4d46130e97852c92447f not found: ID does not exist"
Jul 05 13:46:34.889919 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:34.889885    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps"]
Jul 05 13:46:34.894922 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:34.894891    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-5d6488dd-6ddbc985b8-5g7ps"]
Jul 05 13:46:35.741018 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:46:35.740983    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ca8a535-f1c0-4234-8112-e3719b8c4c52" path="/var/lib/kubelet/pods/7ca8a535-f1c0-4234-8112-e3719b8c4c52/volumes"
Jul 05 13:48:04.307087 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:04.307039    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:48:11.818481 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:11.818396    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:48:17.721755 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:17.721713    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/1.log"
Jul 05 13:48:17.723700 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:17.723674    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/1.log"
Jul 05 13:48:17.725438 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:17.725414    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xj7gc_6c7ce124-8975-400e-9f0b-2527ee19af46/ovn-acl-logging/0.log"
Jul 05 13:48:17.727750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:17.727728    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xj7gc_6c7ce124-8975-400e-9f0b-2527ee19af46/ovn-acl-logging/0.log"
Jul 05 13:48:19.090881 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:19.090845    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:48:22.330823 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:22.330787    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k"]
Jul 05 13:48:22.331180 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:22.331092    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ca8a535-f1c0-4234-8112-e3719b8c4c52" containerName="maas-api"
Jul 05 13:48:22.331180 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:22.331105    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ca8a535-f1c0-4234-8112-e3719b8c4c52" containerName="maas-api"
Jul 05 13:48:22.331180 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:22.331180    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ca8a535-f1c0-4234-8112-e3719b8c4c52" containerName="maas-api"
Jul 05 13:48:22.334207 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:22.334180    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k"
Jul 05 13:48:22.339723 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:22.339698    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-fcfb85dc-serving-cert\""
Jul 05 13:48:22.340177 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:22.340160    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9bvwj\""
Jul 05 13:48:22.366502 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:22.366458    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k"]
Jul 05 13:48:22.424559 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:22.424512    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7zfm\" (UniqueName: \"kubernetes.io/projected/ef0406ce-a9d2-4291-8bec-954b21079c66-kube-api-access-f7zfm\") pod \"maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k\" (UID: \"ef0406ce-a9d2-4291-8bec-954b21079c66\") " pod="opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k"
Jul 05 13:48:22.424794 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:22.424618    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef0406ce-a9d2-4291-8bec-954b21079c66-openshift-service-ca\") pod \"maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k\" (UID: \"ef0406ce-a9d2-4291-8bec-954b21079c66\") " pod="opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k"
Jul 05 13:48:22.424794 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:22.424688    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef0406ce-a9d2-4291-8bec-954b21079c66-maas-api-tls\") pod \"maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k\" (UID: \"ef0406ce-a9d2-4291-8bec-954b21079c66\") " pod="opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k"
Jul 05 13:48:22.525472 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:22.525428    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7zfm\" (UniqueName: \"kubernetes.io/projected/ef0406ce-a9d2-4291-8bec-954b21079c66-kube-api-access-f7zfm\") pod \"maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k\" (UID: \"ef0406ce-a9d2-4291-8bec-954b21079c66\") " pod="opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k"
Jul 05 13:48:22.525681 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:22.525525    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef0406ce-a9d2-4291-8bec-954b21079c66-openshift-service-ca\") pod \"maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k\" (UID: \"ef0406ce-a9d2-4291-8bec-954b21079c66\") " pod="opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k"
Jul 05 13:48:22.525681 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:22.525556    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef0406ce-a9d2-4291-8bec-954b21079c66-maas-api-tls\") pod \"maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k\" (UID: \"ef0406ce-a9d2-4291-8bec-954b21079c66\") " pod="opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k"
Jul 05 13:48:22.525766 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:48:22.525694    2565 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-fcfb85dc-serving-cert: secret "maas-api-e2e-mt-fcfb85dc-serving-cert" not found
Jul 05 13:48:22.525812 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:48:22.525785    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef0406ce-a9d2-4291-8bec-954b21079c66-maas-api-tls podName:ef0406ce-a9d2-4291-8bec-954b21079c66 nodeName:}" failed. No retries permitted until 2026-07-05 13:48:23.025760976 +0000 UTC m=+1805.843728915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ef0406ce-a9d2-4291-8bec-954b21079c66-maas-api-tls") pod "maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k" (UID: "ef0406ce-a9d2-4291-8bec-954b21079c66") : secret "maas-api-e2e-mt-fcfb85dc-serving-cert" not found
Jul 05 13:48:22.526262 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:22.526239    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef0406ce-a9d2-4291-8bec-954b21079c66-openshift-service-ca\") pod \"maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k\" (UID: \"ef0406ce-a9d2-4291-8bec-954b21079c66\") " pod="opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k"
Jul 05 13:48:22.542677 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:22.542616    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7zfm\" (UniqueName: \"kubernetes.io/projected/ef0406ce-a9d2-4291-8bec-954b21079c66-kube-api-access-f7zfm\") pod \"maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k\" (UID: \"ef0406ce-a9d2-4291-8bec-954b21079c66\") " pod="opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k"
Jul 05 13:48:23.029901 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:23.029856    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef0406ce-a9d2-4291-8bec-954b21079c66-maas-api-tls\") pod \"maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k\" (UID: \"ef0406ce-a9d2-4291-8bec-954b21079c66\") " pod="opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k"
Jul 05 13:48:23.032420 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:23.032399    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef0406ce-a9d2-4291-8bec-954b21079c66-maas-api-tls\") pod \"maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k\" (UID: \"ef0406ce-a9d2-4291-8bec-954b21079c66\") " pod="opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k"
Jul 05 13:48:23.246642 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:23.246604    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k"
Jul 05 13:48:23.402340 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:23.402300    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k"]
Jul 05 13:48:23.405519 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:48:23.405485    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef0406ce_a9d2_4291_8bec_954b21079c66.slice/crio-ee3f63a7cc4a0a5c4f6ee63b41e35d998f1bdabd34e34ebb74bfc054a1695557 WatchSource:0}: Error finding container ee3f63a7cc4a0a5c4f6ee63b41e35d998f1bdabd34e34ebb74bfc054a1695557: Status 404 returned error can't find the container with id ee3f63a7cc4a0a5c4f6ee63b41e35d998f1bdabd34e34ebb74bfc054a1695557
Jul 05 13:48:24.416391 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:24.416348    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k" event={"ID":"ef0406ce-a9d2-4291-8bec-954b21079c66","Type":"ContainerStarted","Data":"56dea76eb7af8c599d4111a8152732658cf58a00d71a42eaa482ec2e2824fd10"}
Jul 05 13:48:24.416822 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:24.416410    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k" event={"ID":"ef0406ce-a9d2-4291-8bec-954b21079c66","Type":"ContainerStarted","Data":"ee3f63a7cc4a0a5c4f6ee63b41e35d998f1bdabd34e34ebb74bfc054a1695557"}
Jul 05 13:48:24.416822 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:24.416433    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k"
Jul 05 13:48:24.442927 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:24.442871    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k" podStartSLOduration=2.005532828 podStartE2EDuration="2.442852024s" totalImagesPullingTime="437.319196ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:48:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:48:24.440807194 +0000 UTC m=+1807.258775169" watchObservedRunningTime="2026-07-05 13:48:24.442852024 +0000 UTC m=+1807.260819981"
Jul 05 13:48:26.821688 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:26.821646    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:48:30.430623 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:30.430589    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k"
Jul 05 13:48:34.813168 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:34.813131    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k"]
Jul 05 13:48:34.813604 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:34.813341    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k" podUID="ef0406ce-a9d2-4291-8bec-954b21079c66" containerName="maas-api" containerID="cri-o://56dea76eb7af8c599d4111a8152732658cf58a00d71a42eaa482ec2e2824fd10" gracePeriod=30
Jul 05 13:48:35.067816 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:35.067756    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k"
Jul 05 13:48:35.239605 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:35.239563    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7zfm\" (UniqueName: \"kubernetes.io/projected/ef0406ce-a9d2-4291-8bec-954b21079c66-kube-api-access-f7zfm\") pod \"ef0406ce-a9d2-4291-8bec-954b21079c66\" (UID: \"ef0406ce-a9d2-4291-8bec-954b21079c66\") "
Jul 05 13:48:35.239796 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:35.239625    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef0406ce-a9d2-4291-8bec-954b21079c66-openshift-service-ca\") pod \"ef0406ce-a9d2-4291-8bec-954b21079c66\" (UID: \"ef0406ce-a9d2-4291-8bec-954b21079c66\") "
Jul 05 13:48:35.239796 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:35.239682    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef0406ce-a9d2-4291-8bec-954b21079c66-maas-api-tls\") pod \"ef0406ce-a9d2-4291-8bec-954b21079c66\" (UID: \"ef0406ce-a9d2-4291-8bec-954b21079c66\") "
Jul 05 13:48:35.240032 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:35.239999    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef0406ce-a9d2-4291-8bec-954b21079c66-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ef0406ce-a9d2-4291-8bec-954b21079c66" (UID: "ef0406ce-a9d2-4291-8bec-954b21079c66"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:48:35.241818 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:35.241788    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef0406ce-a9d2-4291-8bec-954b21079c66-kube-api-access-f7zfm" (OuterVolumeSpecName: "kube-api-access-f7zfm") pod "ef0406ce-a9d2-4291-8bec-954b21079c66" (UID: "ef0406ce-a9d2-4291-8bec-954b21079c66"). InnerVolumeSpecName "kube-api-access-f7zfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:48:35.241921 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:35.241826    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef0406ce-a9d2-4291-8bec-954b21079c66-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ef0406ce-a9d2-4291-8bec-954b21079c66" (UID: "ef0406ce-a9d2-4291-8bec-954b21079c66"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:48:35.341060 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:35.340970    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7zfm\" (UniqueName: \"kubernetes.io/projected/ef0406ce-a9d2-4291-8bec-954b21079c66-kube-api-access-f7zfm\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:48:35.341060 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:35.340999    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef0406ce-a9d2-4291-8bec-954b21079c66-openshift-service-ca\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:48:35.341060 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:35.341010    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef0406ce-a9d2-4291-8bec-954b21079c66-maas-api-tls\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:48:35.474352 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:35.474314    2565 generic.go:356] "Generic (PLEG): container finished" podID="ef0406ce-a9d2-4291-8bec-954b21079c66" containerID="56dea76eb7af8c599d4111a8152732658cf58a00d71a42eaa482ec2e2824fd10" exitCode=0
Jul 05 13:48:35.474527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:35.474362    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k"
Jul 05 13:48:35.474527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:35.474402    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k" event={"ID":"ef0406ce-a9d2-4291-8bec-954b21079c66","Type":"ContainerDied","Data":"56dea76eb7af8c599d4111a8152732658cf58a00d71a42eaa482ec2e2824fd10"}
Jul 05 13:48:35.474527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:35.474462    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k" event={"ID":"ef0406ce-a9d2-4291-8bec-954b21079c66","Type":"ContainerDied","Data":"ee3f63a7cc4a0a5c4f6ee63b41e35d998f1bdabd34e34ebb74bfc054a1695557"}
Jul 05 13:48:35.474527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:35.474491    2565 scope.go:117] "RemoveContainer" containerID="56dea76eb7af8c599d4111a8152732658cf58a00d71a42eaa482ec2e2824fd10"
Jul 05 13:48:35.484239 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:35.484210    2565 scope.go:117] "RemoveContainer" containerID="56dea76eb7af8c599d4111a8152732658cf58a00d71a42eaa482ec2e2824fd10"
Jul 05 13:48:35.484590 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:48:35.484569    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56dea76eb7af8c599d4111a8152732658cf58a00d71a42eaa482ec2e2824fd10\": container with ID starting with 56dea76eb7af8c599d4111a8152732658cf58a00d71a42eaa482ec2e2824fd10 not found: ID does not exist" containerID="56dea76eb7af8c599d4111a8152732658cf58a00d71a42eaa482ec2e2824fd10"
Jul 05 13:48:35.484685 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:35.484598    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56dea76eb7af8c599d4111a8152732658cf58a00d71a42eaa482ec2e2824fd10"} err="failed to get container status \"56dea76eb7af8c599d4111a8152732658cf58a00d71a42eaa482ec2e2824fd10\": rpc error: code = NotFound desc = could not find container \"56dea76eb7af8c599d4111a8152732658cf58a00d71a42eaa482ec2e2824fd10\": container with ID starting with 56dea76eb7af8c599d4111a8152732658cf58a00d71a42eaa482ec2e2824fd10 not found: ID does not exist"
Jul 05 13:48:35.501655 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:35.501599    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k"]
Jul 05 13:48:35.507061 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:35.507029    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-fcfb85dc-698bdc4f5b-9qh9k"]
Jul 05 13:48:35.741590 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:35.741554    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef0406ce-a9d2-4291-8bec-954b21079c66" path="/var/lib/kubelet/pods/ef0406ce-a9d2-4291-8bec-954b21079c66/volumes"
Jul 05 13:48:37.729855 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:48:37.729819    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:49:06.329045 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:06.329003    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp"]
Jul 05 13:49:06.329545 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:06.329329    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef0406ce-a9d2-4291-8bec-954b21079c66" containerName="maas-api"
Jul 05 13:49:06.329545 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:06.329340    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef0406ce-a9d2-4291-8bec-954b21079c66" containerName="maas-api"
Jul 05 13:49:06.329545 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:06.329399    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef0406ce-a9d2-4291-8bec-954b21079c66" containerName="maas-api"
Jul 05 13:49:06.332251 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:06.332231    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp"
Jul 05 13:49:06.334699 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:06.334668    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-6a0254a3-serving-cert\""
Jul 05 13:49:06.334805 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:06.334679    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9bvwj\""
Jul 05 13:49:06.345290 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:06.345259    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp"]
Jul 05 13:49:06.401054 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:06.401010    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3da9679b-05b6-440b-8270-d551bed8bb0e-maas-api-tls\") pod \"maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp\" (UID: \"3da9679b-05b6-440b-8270-d551bed8bb0e\") " pod="opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp"
Jul 05 13:49:06.401054 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:06.401049    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmtj2\" (UniqueName: \"kubernetes.io/projected/3da9679b-05b6-440b-8270-d551bed8bb0e-kube-api-access-xmtj2\") pod \"maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp\" (UID: \"3da9679b-05b6-440b-8270-d551bed8bb0e\") " pod="opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp"
Jul 05 13:49:06.401307 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:06.401190    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3da9679b-05b6-440b-8270-d551bed8bb0e-openshift-service-ca\") pod \"maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp\" (UID: \"3da9679b-05b6-440b-8270-d551bed8bb0e\") " pod="opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp"
Jul 05 13:49:06.501978 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:06.501941    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3da9679b-05b6-440b-8270-d551bed8bb0e-openshift-service-ca\") pod \"maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp\" (UID: \"3da9679b-05b6-440b-8270-d551bed8bb0e\") " pod="opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp"
Jul 05 13:49:06.501978 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:06.501988    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3da9679b-05b6-440b-8270-d551bed8bb0e-maas-api-tls\") pod \"maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp\" (UID: \"3da9679b-05b6-440b-8270-d551bed8bb0e\") " pod="opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp"
Jul 05 13:49:06.502267 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:06.502005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmtj2\" (UniqueName: \"kubernetes.io/projected/3da9679b-05b6-440b-8270-d551bed8bb0e-kube-api-access-xmtj2\") pod \"maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp\" (UID: \"3da9679b-05b6-440b-8270-d551bed8bb0e\") " pod="opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp"
Jul 05 13:49:06.502805 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:06.502782    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3da9679b-05b6-440b-8270-d551bed8bb0e-openshift-service-ca\") pod \"maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp\" (UID: \"3da9679b-05b6-440b-8270-d551bed8bb0e\") " pod="opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp"
Jul 05 13:49:06.504504 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:06.504481    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3da9679b-05b6-440b-8270-d551bed8bb0e-maas-api-tls\") pod \"maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp\" (UID: \"3da9679b-05b6-440b-8270-d551bed8bb0e\") " pod="opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp"
Jul 05 13:49:06.512564 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:06.512536    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmtj2\" (UniqueName: \"kubernetes.io/projected/3da9679b-05b6-440b-8270-d551bed8bb0e-kube-api-access-xmtj2\") pod \"maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp\" (UID: \"3da9679b-05b6-440b-8270-d551bed8bb0e\") " pod="opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp"
Jul 05 13:49:06.643511 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:06.643462    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp"
Jul 05 13:49:06.793335 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:06.793309    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp"]
Jul 05 13:49:06.793985 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:49:06.793956    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3da9679b_05b6_440b_8270_d551bed8bb0e.slice/crio-0707afad6838d8aca596d0045238f08e86511098b991c77c8b8c123f3e37a93d WatchSource:0}: Error finding container 0707afad6838d8aca596d0045238f08e86511098b991c77c8b8c123f3e37a93d: Status 404 returned error can't find the container with id 0707afad6838d8aca596d0045238f08e86511098b991c77c8b8c123f3e37a93d
Jul 05 13:49:07.635706 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:07.635665    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp" event={"ID":"3da9679b-05b6-440b-8270-d551bed8bb0e","Type":"ContainerStarted","Data":"84381d3e2f01adab2e4aae74f75d7f731140f5340b8a7bcdee4721d0804a177f"}
Jul 05 13:49:07.636207 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:07.635720    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp" event={"ID":"3da9679b-05b6-440b-8270-d551bed8bb0e","Type":"ContainerStarted","Data":"0707afad6838d8aca596d0045238f08e86511098b991c77c8b8c123f3e37a93d"}
Jul 05 13:49:07.636207 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:07.635751    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp"
Jul 05 13:49:07.653291 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:07.653213    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp" podStartSLOduration=1.326788977 podStartE2EDuration="1.653194543s" totalImagesPullingTime="326.405566ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:49:07.652271595 +0000 UTC m=+1850.470239588" watchObservedRunningTime="2026-07-05 13:49:07.653194543 +0000 UTC m=+1850.471162533"
Jul 05 13:49:12.341467 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:12.341431    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:49:13.646793 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:13.646761    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp"
Jul 05 13:49:24.306123 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.306086    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"]
Jul 05 13:49:24.309298 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.309275    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:24.312488 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.312462    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-6a0254a3\"/\"default-dockercfg-lrtng\""
Jul 05 13:49:24.313363 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.313336    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-6a0254a3\"/\"kube-root-ca.crt\""
Jul 05 13:49:24.313487 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.313343    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-6a0254a3\"/\"e2e-lifecycle-model-6a0254a3-kserve-self-signed-certs\""
Jul 05 13:49:24.313487 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.313344    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-6a0254a3\"/\"openshift-service-ca.crt\""
Jul 05 13:49:24.321356 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.321301    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"]
Jul 05 13:49:24.465618 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.465580    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-model-cache\") pod \"e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") " pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:24.465834 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.465622    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-home\") pod \"e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") " pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:24.465834 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.465676    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-dshm\") pod \"e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") " pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:24.465834 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.465740    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c6805d1-2940-4313-87d7-a99413923b83-tls-certs\") pod \"e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") " pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:24.465834 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.465787    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68n82\" (UniqueName: \"kubernetes.io/projected/4c6805d1-2940-4313-87d7-a99413923b83-kube-api-access-68n82\") pod \"e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") " pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:24.466008 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.465859    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-tmp-dir\") pod \"e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") " pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:24.566715 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.566583    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c6805d1-2940-4313-87d7-a99413923b83-tls-certs\") pod \"e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") " pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:24.566715 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.566674    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68n82\" (UniqueName: \"kubernetes.io/projected/4c6805d1-2940-4313-87d7-a99413923b83-kube-api-access-68n82\") pod \"e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") " pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:24.566715 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.566714    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-tmp-dir\") pod \"e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") " pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:24.566993 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.566777    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-model-cache\") pod \"e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") " pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:24.566993 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.566810    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-home\") pod \"e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") " pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:24.566993 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.566833    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-dshm\") pod \"e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") " pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:24.567201 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.567176    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-tmp-dir\") pod \"e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") " pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:24.567267 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.567209    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-model-cache\") pod \"e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") " pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:24.567267 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.567243    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-home\") pod \"e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") " pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:24.569021 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.568998    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-dshm\") pod \"e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") " pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:24.569223 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.569203    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c6805d1-2940-4313-87d7-a99413923b83-tls-certs\") pod \"e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") " pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:24.578473 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.578439    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68n82\" (UniqueName: \"kubernetes.io/projected/4c6805d1-2940-4313-87d7-a99413923b83-kube-api-access-68n82\") pod \"e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") " pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:24.619144 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.619107    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:24.765885 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:24.765852    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"]
Jul 05 13:49:24.766949 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:49:24.766921    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c6805d1_2940_4313_87d7_a99413923b83.slice/crio-ad0a8c1591062e2081ec262b006444afae58a8382425fe7359abcc07f22af902 WatchSource:0}: Error finding container ad0a8c1591062e2081ec262b006444afae58a8382425fe7359abcc07f22af902: Status 404 returned error can't find the container with id ad0a8c1591062e2081ec262b006444afae58a8382425fe7359abcc07f22af902
Jul 05 13:49:25.739755 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:25.739719    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz" event={"ID":"4c6805d1-2940-4313-87d7-a99413923b83","Type":"ContainerStarted","Data":"f2dbb8bf467b4559956b8f3314ceceb567ea95d8606d68dcefa78d53cda8ffea"}
Jul 05 13:49:25.740148 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:25.739766    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz" event={"ID":"4c6805d1-2940-4313-87d7-a99413923b83","Type":"ContainerStarted","Data":"ad0a8c1591062e2081ec262b006444afae58a8382425fe7359abcc07f22af902"}
Jul 05 13:49:27.651252 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:27.651187    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz" podStartSLOduration=3.651166637 podStartE2EDuration="3.651166637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:49:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:49:25.767028853 +0000 UTC m=+1868.584996810" watchObservedRunningTime="2026-07-05 13:49:27.651166637 +0000 UTC m=+1870.469134593"
Jul 05 13:49:27.653142 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:27.653117    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:49:34.619621 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:34.619579    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:34.620046 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:34.619662    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:34.632735 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:34.632705    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:34.789927 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:34.789897    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:49:40.599864 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:40.599754    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:49:43.746985 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:43.746956    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp"]
Jul 05 13:49:43.747487 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:43.747181    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp" podUID="3da9679b-05b6-440b-8270-d551bed8bb0e" containerName="maas-api" containerID="cri-o://84381d3e2f01adab2e4aae74f75d7f731140f5340b8a7bcdee4721d0804a177f" gracePeriod=30
Jul 05 13:49:43.993953 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:43.993915    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp"
Jul 05 13:49:44.037554 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:44.037462    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3da9679b-05b6-440b-8270-d551bed8bb0e-maas-api-tls\") pod \"3da9679b-05b6-440b-8270-d551bed8bb0e\" (UID: \"3da9679b-05b6-440b-8270-d551bed8bb0e\") "
Jul 05 13:49:44.037554 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:44.037515    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmtj2\" (UniqueName: \"kubernetes.io/projected/3da9679b-05b6-440b-8270-d551bed8bb0e-kube-api-access-xmtj2\") pod \"3da9679b-05b6-440b-8270-d551bed8bb0e\" (UID: \"3da9679b-05b6-440b-8270-d551bed8bb0e\") "
Jul 05 13:49:44.037554 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:44.037541    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3da9679b-05b6-440b-8270-d551bed8bb0e-openshift-service-ca\") pod \"3da9679b-05b6-440b-8270-d551bed8bb0e\" (UID: \"3da9679b-05b6-440b-8270-d551bed8bb0e\") "
Jul 05 13:49:44.037925 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:44.037897    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3da9679b-05b6-440b-8270-d551bed8bb0e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3da9679b-05b6-440b-8270-d551bed8bb0e" (UID: "3da9679b-05b6-440b-8270-d551bed8bb0e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:49:44.039662 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:44.039600    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3da9679b-05b6-440b-8270-d551bed8bb0e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3da9679b-05b6-440b-8270-d551bed8bb0e" (UID: "3da9679b-05b6-440b-8270-d551bed8bb0e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:49:44.039787 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:44.039705    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3da9679b-05b6-440b-8270-d551bed8bb0e-kube-api-access-xmtj2" (OuterVolumeSpecName: "kube-api-access-xmtj2") pod "3da9679b-05b6-440b-8270-d551bed8bb0e" (UID: "3da9679b-05b6-440b-8270-d551bed8bb0e"). InnerVolumeSpecName "kube-api-access-xmtj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:49:44.138130 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:44.138086    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3da9679b-05b6-440b-8270-d551bed8bb0e-maas-api-tls\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:49:44.138130 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:44.138122    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmtj2\" (UniqueName: \"kubernetes.io/projected/3da9679b-05b6-440b-8270-d551bed8bb0e-kube-api-access-xmtj2\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:49:44.138130 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:44.138135    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3da9679b-05b6-440b-8270-d551bed8bb0e-openshift-service-ca\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:49:44.833002 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:44.832962    2565 generic.go:356] "Generic (PLEG): container finished" podID="3da9679b-05b6-440b-8270-d551bed8bb0e" containerID="84381d3e2f01adab2e4aae74f75d7f731140f5340b8a7bcdee4721d0804a177f" exitCode=0
Jul 05 13:49:44.833474 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:44.833011    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp"
Jul 05 13:49:44.833474 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:44.833046    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp" event={"ID":"3da9679b-05b6-440b-8270-d551bed8bb0e","Type":"ContainerDied","Data":"84381d3e2f01adab2e4aae74f75d7f731140f5340b8a7bcdee4721d0804a177f"}
Jul 05 13:49:44.833474 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:44.833111    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp" event={"ID":"3da9679b-05b6-440b-8270-d551bed8bb0e","Type":"ContainerDied","Data":"0707afad6838d8aca596d0045238f08e86511098b991c77c8b8c123f3e37a93d"}
Jul 05 13:49:44.833474 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:44.833142    2565 scope.go:117] "RemoveContainer" containerID="84381d3e2f01adab2e4aae74f75d7f731140f5340b8a7bcdee4721d0804a177f"
Jul 05 13:49:44.843069 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:44.843047    2565 scope.go:117] "RemoveContainer" containerID="84381d3e2f01adab2e4aae74f75d7f731140f5340b8a7bcdee4721d0804a177f"
Jul 05 13:49:44.843395 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:49:44.843377    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84381d3e2f01adab2e4aae74f75d7f731140f5340b8a7bcdee4721d0804a177f\": container with ID starting with 84381d3e2f01adab2e4aae74f75d7f731140f5340b8a7bcdee4721d0804a177f not found: ID does not exist" containerID="84381d3e2f01adab2e4aae74f75d7f731140f5340b8a7bcdee4721d0804a177f"
Jul 05 13:49:44.843450 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:44.843406    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84381d3e2f01adab2e4aae74f75d7f731140f5340b8a7bcdee4721d0804a177f"} err="failed to get container status \"84381d3e2f01adab2e4aae74f75d7f731140f5340b8a7bcdee4721d0804a177f\": rpc error: code = NotFound desc = could not find container \"84381d3e2f01adab2e4aae74f75d7f731140f5340b8a7bcdee4721d0804a177f\": container with ID starting with 84381d3e2f01adab2e4aae74f75d7f731140f5340b8a7bcdee4721d0804a177f not found: ID does not exist"
Jul 05 13:49:44.860809 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:44.860765    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp"]
Jul 05 13:49:44.867174 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:44.867137    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-6a0254a3-786c85bb57-rqptp"]
Jul 05 13:49:45.740401 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:45.740369    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3da9679b-05b6-440b-8270-d551bed8bb0e" path="/var/lib/kubelet/pods/3da9679b-05b6-440b-8270-d551bed8bb0e/volumes"
Jul 05 13:49:54.205613 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:54.205574    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:49:54.299486 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:49:54.299450    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"]
Jul 05 13:50:09.319811 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.319747    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz" podUID="4c6805d1-2940-4313-87d7-a99413923b83" containerName="main" containerID="cri-o://f2dbb8bf467b4559956b8f3314ceceb567ea95d8606d68dcefa78d53cda8ffea" gracePeriod=45
Jul 05 13:50:09.574073 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.574002    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:50:09.651309 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.651276    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-tmp-dir\") pod \"4c6805d1-2940-4313-87d7-a99413923b83\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") "
Jul 05 13:50:09.651488 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.651366    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-dshm\") pod \"4c6805d1-2940-4313-87d7-a99413923b83\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") "
Jul 05 13:50:09.651488 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.651391    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-model-cache\") pod \"4c6805d1-2940-4313-87d7-a99413923b83\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") "
Jul 05 13:50:09.651488 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.651413    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68n82\" (UniqueName: \"kubernetes.io/projected/4c6805d1-2940-4313-87d7-a99413923b83-kube-api-access-68n82\") pod \"4c6805d1-2940-4313-87d7-a99413923b83\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") "
Jul 05 13:50:09.651488 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.651430    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c6805d1-2940-4313-87d7-a99413923b83-tls-certs\") pod \"4c6805d1-2940-4313-87d7-a99413923b83\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") "
Jul 05 13:50:09.651488 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.651454    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-home\") pod \"4c6805d1-2940-4313-87d7-a99413923b83\" (UID: \"4c6805d1-2940-4313-87d7-a99413923b83\") "
Jul 05 13:50:09.651776 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.651656    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4c6805d1-2940-4313-87d7-a99413923b83" (UID: "4c6805d1-2940-4313-87d7-a99413923b83"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:50:09.651776 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.651686    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-model-cache" (OuterVolumeSpecName: "model-cache") pod "4c6805d1-2940-4313-87d7-a99413923b83" (UID: "4c6805d1-2940-4313-87d7-a99413923b83"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:50:09.651886 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.651824    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-home" (OuterVolumeSpecName: "home") pod "4c6805d1-2940-4313-87d7-a99413923b83" (UID: "4c6805d1-2940-4313-87d7-a99413923b83"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:50:09.653712 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.653682    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-dshm" (OuterVolumeSpecName: "dshm") pod "4c6805d1-2940-4313-87d7-a99413923b83" (UID: "4c6805d1-2940-4313-87d7-a99413923b83"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:50:09.653851 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.653798    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c6805d1-2940-4313-87d7-a99413923b83-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4c6805d1-2940-4313-87d7-a99413923b83" (UID: "4c6805d1-2940-4313-87d7-a99413923b83"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:50:09.653851 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.653805    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c6805d1-2940-4313-87d7-a99413923b83-kube-api-access-68n82" (OuterVolumeSpecName: "kube-api-access-68n82") pod "4c6805d1-2940-4313-87d7-a99413923b83" (UID: "4c6805d1-2940-4313-87d7-a99413923b83"). InnerVolumeSpecName "kube-api-access-68n82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:50:09.752340 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.752307    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-dshm\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:50:09.752340 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.752337    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-model-cache\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:50:09.752532 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.752348    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68n82\" (UniqueName: \"kubernetes.io/projected/4c6805d1-2940-4313-87d7-a99413923b83-kube-api-access-68n82\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:50:09.752532 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.752370    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c6805d1-2940-4313-87d7-a99413923b83-tls-certs\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:50:09.752532 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.752378    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-home\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:50:09.752532 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.752386    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c6805d1-2940-4313-87d7-a99413923b83-tmp-dir\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:50:09.956068 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.956031    2565 generic.go:356] "Generic (PLEG): container finished" podID="4c6805d1-2940-4313-87d7-a99413923b83" containerID="f2dbb8bf467b4559956b8f3314ceceb567ea95d8606d68dcefa78d53cda8ffea" exitCode=0
Jul 05 13:50:09.956247 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.956075    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"
Jul 05 13:50:09.956247 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.956110    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz" event={"ID":"4c6805d1-2940-4313-87d7-a99413923b83","Type":"ContainerDied","Data":"f2dbb8bf467b4559956b8f3314ceceb567ea95d8606d68dcefa78d53cda8ffea"}
Jul 05 13:50:09.956247 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.956157    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz" event={"ID":"4c6805d1-2940-4313-87d7-a99413923b83","Type":"ContainerDied","Data":"ad0a8c1591062e2081ec262b006444afae58a8382425fe7359abcc07f22af902"}
Jul 05 13:50:09.956247 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.956178    2565 scope.go:117] "RemoveContainer" containerID="f2dbb8bf467b4559956b8f3314ceceb567ea95d8606d68dcefa78d53cda8ffea"
Jul 05 13:50:09.965215 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.965191    2565 scope.go:117] "RemoveContainer" containerID="f2dbb8bf467b4559956b8f3314ceceb567ea95d8606d68dcefa78d53cda8ffea"
Jul 05 13:50:09.965521 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:50:09.965500    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2dbb8bf467b4559956b8f3314ceceb567ea95d8606d68dcefa78d53cda8ffea\": container with ID starting with f2dbb8bf467b4559956b8f3314ceceb567ea95d8606d68dcefa78d53cda8ffea not found: ID does not exist" containerID="f2dbb8bf467b4559956b8f3314ceceb567ea95d8606d68dcefa78d53cda8ffea"
Jul 05 13:50:09.965594 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.965528    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2dbb8bf467b4559956b8f3314ceceb567ea95d8606d68dcefa78d53cda8ffea"} err="failed to get container status \"f2dbb8bf467b4559956b8f3314ceceb567ea95d8606d68dcefa78d53cda8ffea\": rpc error: code = NotFound desc = could not find container \"f2dbb8bf467b4559956b8f3314ceceb567ea95d8606d68dcefa78d53cda8ffea\": container with ID starting with f2dbb8bf467b4559956b8f3314ceceb567ea95d8606d68dcefa78d53cda8ffea not found: ID does not exist"
Jul 05 13:50:09.980078 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.980047    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"]
Jul 05 13:50:09.984741 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:09.984713    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-6a0254a3/e2e-lifecycle-model-6a0254a3-kserve-7c7d5ddfc9-xrdsz"]
Jul 05 13:50:11.740683 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:11.740647    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c6805d1-2940-4313-87d7-a99413923b83" path="/var/lib/kubelet/pods/4c6805d1-2940-4313-87d7-a99413923b83/volumes"
Jul 05 13:50:33.909186 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:33.909146    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:50:43.023886 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:43.023842    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:50:56.903176 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:50:56.903138    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:51:37.941510 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:37.941466    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm"]
Jul 05 13:51:37.942063 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:37.941814    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c6805d1-2940-4313-87d7-a99413923b83" containerName="main"
Jul 05 13:51:37.942063 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:37.941828    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c6805d1-2940-4313-87d7-a99413923b83" containerName="main"
Jul 05 13:51:37.942063 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:37.941837    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da9679b-05b6-440b-8270-d551bed8bb0e" containerName="maas-api"
Jul 05 13:51:37.942063 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:37.941843    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da9679b-05b6-440b-8270-d551bed8bb0e" containerName="maas-api"
Jul 05 13:51:37.942063 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:37.941899    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c6805d1-2940-4313-87d7-a99413923b83" containerName="main"
Jul 05 13:51:37.942063 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:37.941910    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3da9679b-05b6-440b-8270-d551bed8bb0e" containerName="maas-api"
Jul 05 13:51:37.944902 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:37.944883    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm"
Jul 05 13:51:37.947602 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:37.947578    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9bvwj\""
Jul 05 13:51:37.947712 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:37.947606    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-3c48d7-serving-cert\""
Jul 05 13:51:37.959563 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:37.959530    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm"]
Jul 05 13:51:37.999080 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:37.999027    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfwds\" (UniqueName: \"kubernetes.io/projected/33d9a1d7-912d-4a20-abe0-5a1811bd11c3-kube-api-access-mfwds\") pod \"maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm\" (UID: \"33d9a1d7-912d-4a20-abe0-5a1811bd11c3\") " pod="opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm"
Jul 05 13:51:37.999265 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:37.999136    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33d9a1d7-912d-4a20-abe0-5a1811bd11c3-maas-api-tls\") pod \"maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm\" (UID: \"33d9a1d7-912d-4a20-abe0-5a1811bd11c3\") " pod="opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm"
Jul 05 13:51:37.999265 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:37.999172    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33d9a1d7-912d-4a20-abe0-5a1811bd11c3-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm\" (UID: \"33d9a1d7-912d-4a20-abe0-5a1811bd11c3\") " pod="opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm"
Jul 05 13:51:38.100562 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:38.100524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33d9a1d7-912d-4a20-abe0-5a1811bd11c3-maas-api-tls\") pod \"maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm\" (UID: \"33d9a1d7-912d-4a20-abe0-5a1811bd11c3\") " pod="opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm"
Jul 05 13:51:38.100562 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:38.100560    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33d9a1d7-912d-4a20-abe0-5a1811bd11c3-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm\" (UID: \"33d9a1d7-912d-4a20-abe0-5a1811bd11c3\") " pod="opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm"
Jul 05 13:51:38.100820 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:38.100621    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfwds\" (UniqueName: \"kubernetes.io/projected/33d9a1d7-912d-4a20-abe0-5a1811bd11c3-kube-api-access-mfwds\") pod \"maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm\" (UID: \"33d9a1d7-912d-4a20-abe0-5a1811bd11c3\") " pod="opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm"
Jul 05 13:51:38.101375 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:38.101354    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33d9a1d7-912d-4a20-abe0-5a1811bd11c3-openshift-service-ca\") pod \"maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm\" (UID: \"33d9a1d7-912d-4a20-abe0-5a1811bd11c3\") " pod="opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm"
Jul 05 13:51:38.103195 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:38.103173    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33d9a1d7-912d-4a20-abe0-5a1811bd11c3-maas-api-tls\") pod \"maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm\" (UID: \"33d9a1d7-912d-4a20-abe0-5a1811bd11c3\") " pod="opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm"
Jul 05 13:51:38.113054 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:38.113028    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfwds\" (UniqueName: \"kubernetes.io/projected/33d9a1d7-912d-4a20-abe0-5a1811bd11c3-kube-api-access-mfwds\") pod \"maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm\" (UID: \"33d9a1d7-912d-4a20-abe0-5a1811bd11c3\") " pod="opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm"
Jul 05 13:51:38.255130 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:38.255044    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm"
Jul 05 13:51:38.426219 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:38.426189    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm"]
Jul 05 13:51:38.428864 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:51:38.428835    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33d9a1d7_912d_4a20_abe0_5a1811bd11c3.slice/crio-e283ed941dae87c0a299b88c5f946c5af079434c96db8c081262670ab72202ce WatchSource:0}: Error finding container e283ed941dae87c0a299b88c5f946c5af079434c96db8c081262670ab72202ce: Status 404 returned error can't find the container with id e283ed941dae87c0a299b88c5f946c5af079434c96db8c081262670ab72202ce
Jul 05 13:51:38.430408 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:38.430378    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 13:51:39.406010 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:39.405973    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm" event={"ID":"33d9a1d7-912d-4a20-abe0-5a1811bd11c3","Type":"ContainerStarted","Data":"c4c5939dbb00ed2900097f0b76d50e38902df6ee6f3af0adf8a495b0f0f46d10"}
Jul 05 13:51:39.406441 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:39.406032    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm" event={"ID":"33d9a1d7-912d-4a20-abe0-5a1811bd11c3","Type":"ContainerStarted","Data":"e283ed941dae87c0a299b88c5f946c5af079434c96db8c081262670ab72202ce"}
Jul 05 13:51:39.406441 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:39.406061    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm"
Jul 05 13:51:39.426226 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:39.426165    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm" podStartSLOduration=2.053186806 podStartE2EDuration="2.42614833s" totalImagesPullingTime="372.961524ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:51:39.424230716 +0000 UTC m=+2002.242198692" watchObservedRunningTime="2026-07-05 13:51:39.42614833 +0000 UTC m=+2002.244116298"
Jul 05 13:51:45.131786 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:45.131750    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:51:45.417479 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:45.417395    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm"
Jul 05 13:51:46.141147 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:46.141104    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb"]
Jul 05 13:51:46.144772 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:46.144750    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb"
Jul 05 13:51:46.148572 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:46.148547    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-114a16-serving-cert\""
Jul 05 13:51:46.155534 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:46.155505    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z44vl\" (UniqueName: \"kubernetes.io/projected/28c93a7e-1100-464f-a110-23dc47b366f7-kube-api-access-z44vl\") pod \"maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb\" (UID: \"28c93a7e-1100-464f-a110-23dc47b366f7\") " pod="opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb"
Jul 05 13:51:46.155680 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:46.155575    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28c93a7e-1100-464f-a110-23dc47b366f7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb\" (UID: \"28c93a7e-1100-464f-a110-23dc47b366f7\") " pod="opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb"
Jul 05 13:51:46.155680 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:46.155613    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28c93a7e-1100-464f-a110-23dc47b366f7-maas-api-tls\") pod \"maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb\" (UID: \"28c93a7e-1100-464f-a110-23dc47b366f7\") " pod="opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb"
Jul 05 13:51:46.251036 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:46.250992    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb"]
Jul 05 13:51:46.256444 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:46.256409    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28c93a7e-1100-464f-a110-23dc47b366f7-maas-api-tls\") pod \"maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb\" (UID: \"28c93a7e-1100-464f-a110-23dc47b366f7\") " pod="opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb"
Jul 05 13:51:46.256658 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:46.256464    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z44vl\" (UniqueName: \"kubernetes.io/projected/28c93a7e-1100-464f-a110-23dc47b366f7-kube-api-access-z44vl\") pod \"maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb\" (UID: \"28c93a7e-1100-464f-a110-23dc47b366f7\") " pod="opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb"
Jul 05 13:51:46.256658 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:46.256522    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28c93a7e-1100-464f-a110-23dc47b366f7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb\" (UID: \"28c93a7e-1100-464f-a110-23dc47b366f7\") " pod="opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb"
Jul 05 13:51:46.256658 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:51:46.256562    2565 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-114a16-serving-cert: secret "maas-api-e2e-inf-b-114a16-serving-cert" not found
Jul 05 13:51:46.256833 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:51:46.256670    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28c93a7e-1100-464f-a110-23dc47b366f7-maas-api-tls podName:28c93a7e-1100-464f-a110-23dc47b366f7 nodeName:}" failed. No retries permitted until 2026-07-05 13:51:46.756647774 +0000 UTC m=+2009.574615723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/28c93a7e-1100-464f-a110-23dc47b366f7-maas-api-tls") pod "maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb" (UID: "28c93a7e-1100-464f-a110-23dc47b366f7") : secret "maas-api-e2e-inf-b-114a16-serving-cert" not found
Jul 05 13:51:46.257227 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:46.257201    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28c93a7e-1100-464f-a110-23dc47b366f7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb\" (UID: \"28c93a7e-1100-464f-a110-23dc47b366f7\") " pod="opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb"
Jul 05 13:51:46.277043 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:46.277014    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z44vl\" (UniqueName: \"kubernetes.io/projected/28c93a7e-1100-464f-a110-23dc47b366f7-kube-api-access-z44vl\") pod \"maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb\" (UID: \"28c93a7e-1100-464f-a110-23dc47b366f7\") " pod="opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb"
Jul 05 13:51:46.758467 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:46.758433    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28c93a7e-1100-464f-a110-23dc47b366f7-maas-api-tls\") pod \"maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb\" (UID: \"28c93a7e-1100-464f-a110-23dc47b366f7\") " pod="opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb"
Jul 05 13:51:46.761042 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:46.761013    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28c93a7e-1100-464f-a110-23dc47b366f7-maas-api-tls\") pod \"maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb\" (UID: \"28c93a7e-1100-464f-a110-23dc47b366f7\") " pod="opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb"
Jul 05 13:51:47.056482 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:47.056371    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb"
Jul 05 13:51:47.219700 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:47.219657    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb"]
Jul 05 13:51:47.222228 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:51:47.222193    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28c93a7e_1100_464f_a110_23dc47b366f7.slice/crio-39abfb6a5a9ce613cbfdf1b139e0afe0619c4ef159680e2ac57d7179669a9969 WatchSource:0}: Error finding container 39abfb6a5a9ce613cbfdf1b139e0afe0619c4ef159680e2ac57d7179669a9969: Status 404 returned error can't find the container with id 39abfb6a5a9ce613cbfdf1b139e0afe0619c4ef159680e2ac57d7179669a9969
Jul 05 13:51:47.448573 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:47.448536    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb" event={"ID":"28c93a7e-1100-464f-a110-23dc47b366f7","Type":"ContainerStarted","Data":"39abfb6a5a9ce613cbfdf1b139e0afe0619c4ef159680e2ac57d7179669a9969"}
Jul 05 13:51:48.454814 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:48.454772    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb" event={"ID":"28c93a7e-1100-464f-a110-23dc47b366f7","Type":"ContainerStarted","Data":"bcd3e7383a88cec8915d530754ffaacb38b6f43d602de594cc49d29fc3a58d9b"}
Jul 05 13:51:48.455200 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:48.454945    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb"
Jul 05 13:51:48.477004 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:48.476948    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb" podStartSLOduration=2.142131445 podStartE2EDuration="2.476929941s" totalImagesPullingTime="334.798496ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:51:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:51:48.474994983 +0000 UTC m=+2011.292962958" watchObservedRunningTime="2026-07-05 13:51:48.476929941 +0000 UTC m=+2011.294897898"
Jul 05 13:51:54.465438 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:54.465405    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb"
Jul 05 13:51:55.755966 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:51:55.755926    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:52:19.731502 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.731458    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"]
Jul 05 13:52:19.735126 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.735102    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:19.738007 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.737977    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-3c48d7\"/\"kube-root-ca.crt\""
Jul 05 13:52:19.739055 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.739028    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-3c48d7\"/\"test-model-3c48d7-kserve-self-signed-certs\""
Jul 05 13:52:19.739190 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.739029    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-3c48d7\"/\"openshift-service-ca.crt\""
Jul 05 13:52:19.739190 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.739078    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-3c48d7\"/\"default-dockercfg-wd45n\""
Jul 05 13:52:19.756713 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.756665    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"]
Jul 05 13:52:19.831230 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.831193    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-home\") pod \"test-model-3c48d7-kserve-6cc8487859-768jp\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") " pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:19.831230 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.831235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b6b8989-dc50-4291-b973-d67dc2c0e370-tls-certs\") pod \"test-model-3c48d7-kserve-6cc8487859-768jp\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") " pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:19.831471 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.831267    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-model-cache\") pod \"test-model-3c48d7-kserve-6cc8487859-768jp\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") " pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:19.831471 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.831358    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-dshm\") pod \"test-model-3c48d7-kserve-6cc8487859-768jp\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") " pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:19.831471 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.831397    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv68p\" (UniqueName: \"kubernetes.io/projected/5b6b8989-dc50-4291-b973-d67dc2c0e370-kube-api-access-gv68p\") pod \"test-model-3c48d7-kserve-6cc8487859-768jp\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") " pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:19.831471 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.831421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-tmp-dir\") pod \"test-model-3c48d7-kserve-6cc8487859-768jp\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") " pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:19.932225 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.932175    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-dshm\") pod \"test-model-3c48d7-kserve-6cc8487859-768jp\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") " pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:19.932225 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.932225    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv68p\" (UniqueName: \"kubernetes.io/projected/5b6b8989-dc50-4291-b973-d67dc2c0e370-kube-api-access-gv68p\") pod \"test-model-3c48d7-kserve-6cc8487859-768jp\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") " pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:19.932466 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.932254    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-tmp-dir\") pod \"test-model-3c48d7-kserve-6cc8487859-768jp\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") " pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:19.932466 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.932320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-home\") pod \"test-model-3c48d7-kserve-6cc8487859-768jp\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") " pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:19.932466 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.932343    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b6b8989-dc50-4291-b973-d67dc2c0e370-tls-certs\") pod \"test-model-3c48d7-kserve-6cc8487859-768jp\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") " pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:19.932466 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.932382    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-model-cache\") pod \"test-model-3c48d7-kserve-6cc8487859-768jp\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") " pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:19.933012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.932795    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-tmp-dir\") pod \"test-model-3c48d7-kserve-6cc8487859-768jp\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") " pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:19.933012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.932834    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-home\") pod \"test-model-3c48d7-kserve-6cc8487859-768jp\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") " pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:19.933012 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.932861    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-model-cache\") pod \"test-model-3c48d7-kserve-6cc8487859-768jp\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") " pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:19.934606 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.934581    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-dshm\") pod \"test-model-3c48d7-kserve-6cc8487859-768jp\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") " pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:19.934779 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.934763    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b6b8989-dc50-4291-b973-d67dc2c0e370-tls-certs\") pod \"test-model-3c48d7-kserve-6cc8487859-768jp\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") " pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:19.942811 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:19.942782    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv68p\" (UniqueName: \"kubernetes.io/projected/5b6b8989-dc50-4291-b973-d67dc2c0e370-kube-api-access-gv68p\") pod \"test-model-3c48d7-kserve-6cc8487859-768jp\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") " pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:20.046712 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:20.046574    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:20.190511 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:20.190484    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"]
Jul 05 13:52:20.192354 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:52:20.192328    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b6b8989_dc50_4291_b973_d67dc2c0e370.slice/crio-7b4256a8198f6b7f9aaa04bcc078111663e447c42e3b543c976b9196d22e9ff4 WatchSource:0}: Error finding container 7b4256a8198f6b7f9aaa04bcc078111663e447c42e3b543c976b9196d22e9ff4: Status 404 returned error can't find the container with id 7b4256a8198f6b7f9aaa04bcc078111663e447c42e3b543c976b9196d22e9ff4
Jul 05 13:52:20.629098 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:20.629060    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp" event={"ID":"5b6b8989-dc50-4291-b973-d67dc2c0e370","Type":"ContainerStarted","Data":"88ee82c70ca965c3362a74b4163371fc22de78c4fff800306cf6b579273dd53f"}
Jul 05 13:52:20.629290 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:20.629107    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp" event={"ID":"5b6b8989-dc50-4291-b973-d67dc2c0e370","Type":"ContainerStarted","Data":"7b4256a8198f6b7f9aaa04bcc078111663e447c42e3b543c976b9196d22e9ff4"}
Jul 05 13:52:20.669342 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:20.669285    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp" podStartSLOduration=1.669266283 podStartE2EDuration="1.669266283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:52:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:52:20.667669626 +0000 UTC m=+2043.485637586" watchObservedRunningTime="2026-07-05 13:52:20.669266283 +0000 UTC m=+2043.487234239"
Jul 05 13:52:22.897966 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:22.897924    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:52:30.047052 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:30.047012    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:30.047561 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:30.047074    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:30.060357 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:30.060323    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:30.692539 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:30.692505    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:52:33.415251 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:33.415211    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:52:39.313712 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.313553    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"]
Jul 05 13:52:39.317152 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.317132    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:39.320313 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.320278    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-114a16\"/\"default-dockercfg-kvmkg\""
Jul 05 13:52:39.321295 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.321276    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-114a16\"/\"kube-root-ca.crt\""
Jul 05 13:52:39.321368 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.321299    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-114a16\"/\"openshift-service-ca.crt\""
Jul 05 13:52:39.323393 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.323367    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-114a16\"/\"test-model-114a16-kserve-self-signed-certs\""
Jul 05 13:52:39.329339 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.329308    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"]
Jul 05 13:52:39.401353 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.401311    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-home\") pod \"test-model-114a16-kserve-679c44bf49-hkp8m\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") " pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:39.401556 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.401383    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-model-cache\") pod \"test-model-114a16-kserve-679c44bf49-hkp8m\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") " pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:39.401556 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.401422    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-tls-certs\") pod \"test-model-114a16-kserve-679c44bf49-hkp8m\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") " pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:39.401556 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.401446    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6s2w\" (UniqueName: \"kubernetes.io/projected/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-kube-api-access-j6s2w\") pod \"test-model-114a16-kserve-679c44bf49-hkp8m\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") " pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:39.401556 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.401512    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-tmp-dir\") pod \"test-model-114a16-kserve-679c44bf49-hkp8m\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") " pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:39.401556 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.401548    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-dshm\") pod \"test-model-114a16-kserve-679c44bf49-hkp8m\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") " pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:39.502075 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.502034    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-home\") pod \"test-model-114a16-kserve-679c44bf49-hkp8m\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") " pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:39.502280 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.502092    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-model-cache\") pod \"test-model-114a16-kserve-679c44bf49-hkp8m\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") " pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:39.502280 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.502119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-tls-certs\") pod \"test-model-114a16-kserve-679c44bf49-hkp8m\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") " pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:39.502280 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.502136    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6s2w\" (UniqueName: \"kubernetes.io/projected/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-kube-api-access-j6s2w\") pod \"test-model-114a16-kserve-679c44bf49-hkp8m\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") " pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:39.502280 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.502156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-tmp-dir\") pod \"test-model-114a16-kserve-679c44bf49-hkp8m\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") " pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:39.502280 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.502177    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-dshm\") pod \"test-model-114a16-kserve-679c44bf49-hkp8m\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") " pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:39.502550 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.502523    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-home\") pod \"test-model-114a16-kserve-679c44bf49-hkp8m\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") " pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:39.502611 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.502553    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-model-cache\") pod \"test-model-114a16-kserve-679c44bf49-hkp8m\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") " pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:39.502611 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.502600    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-tmp-dir\") pod \"test-model-114a16-kserve-679c44bf49-hkp8m\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") " pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:39.504603 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.504580    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-dshm\") pod \"test-model-114a16-kserve-679c44bf49-hkp8m\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") " pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:39.504894 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.504875    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-tls-certs\") pod \"test-model-114a16-kserve-679c44bf49-hkp8m\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") " pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:39.511089 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.511058    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6s2w\" (UniqueName: \"kubernetes.io/projected/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-kube-api-access-j6s2w\") pod \"test-model-114a16-kserve-679c44bf49-hkp8m\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") " pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:39.627155 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.627116    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:39.772509 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:39.772383    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"]
Jul 05 13:52:39.775401 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:52:39.775368    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0f9c1d3_5c8f_43dd_8fe4_e289a325ab4c.slice/crio-19bf10f599db3df1f1611c683080b0a28c606cdc03bb47640af77ef99210b7a7 WatchSource:0}: Error finding container 19bf10f599db3df1f1611c683080b0a28c606cdc03bb47640af77ef99210b7a7: Status 404 returned error can't find the container with id 19bf10f599db3df1f1611c683080b0a28c606cdc03bb47640af77ef99210b7a7
Jul 05 13:52:40.732665 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:40.732611    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m" event={"ID":"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c","Type":"ContainerStarted","Data":"03f5979a767a3c55043b1bd7a66d8c7f7a28229f2fd46eb814717a565840315d"}
Jul 05 13:52:40.732665 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:40.732671    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m" event={"ID":"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c","Type":"ContainerStarted","Data":"19bf10f599db3df1f1611c683080b0a28c606cdc03bb47640af77ef99210b7a7"}
Jul 05 13:52:40.750913 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:40.750560    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m" podStartSLOduration=1.750538946 podStartE2EDuration="1.750538946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:52:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:52:40.750335588 +0000 UTC m=+2063.568303544" watchObservedRunningTime="2026-07-05 13:52:40.750538946 +0000 UTC m=+2063.568506900"
Jul 05 13:52:42.698287 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:42.698244    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:52:49.627560 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:49.627521    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:49.627560 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:49.627566    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:49.640047 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:49.640017    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:49.786994 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:49.786965    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:52:58.397920 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:58.397877    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:52:59.709516 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:52:59.709479    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"]
Jul 05 13:53:00.697084 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:00.697047    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"]
Jul 05 13:53:01.624896 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:01.624859    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm"]
Jul 05 13:53:01.625359 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:01.625072    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm" podUID="33d9a1d7-912d-4a20-abe0-5a1811bd11c3" containerName="maas-api" containerID="cri-o://c4c5939dbb00ed2900097f0b76d50e38902df6ee6f3af0adf8a495b0f0f46d10" gracePeriod=30
Jul 05 13:53:01.835534 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:01.835498    2565 generic.go:356] "Generic (PLEG): container finished" podID="33d9a1d7-912d-4a20-abe0-5a1811bd11c3" containerID="c4c5939dbb00ed2900097f0b76d50e38902df6ee6f3af0adf8a495b0f0f46d10" exitCode=0
Jul 05 13:53:01.835707 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:01.835559    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm" event={"ID":"33d9a1d7-912d-4a20-abe0-5a1811bd11c3","Type":"ContainerDied","Data":"c4c5939dbb00ed2900097f0b76d50e38902df6ee6f3af0adf8a495b0f0f46d10"}
Jul 05 13:53:01.883572 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:01.880473    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm"
Jul 05 13:53:01.893687 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:01.893623    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33d9a1d7-912d-4a20-abe0-5a1811bd11c3-maas-api-tls\") pod \"33d9a1d7-912d-4a20-abe0-5a1811bd11c3\" (UID: \"33d9a1d7-912d-4a20-abe0-5a1811bd11c3\") "
Jul 05 13:53:01.893898 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:01.893780    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfwds\" (UniqueName: \"kubernetes.io/projected/33d9a1d7-912d-4a20-abe0-5a1811bd11c3-kube-api-access-mfwds\") pod \"33d9a1d7-912d-4a20-abe0-5a1811bd11c3\" (UID: \"33d9a1d7-912d-4a20-abe0-5a1811bd11c3\") "
Jul 05 13:53:01.893898 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:01.893866    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33d9a1d7-912d-4a20-abe0-5a1811bd11c3-openshift-service-ca\") pod \"33d9a1d7-912d-4a20-abe0-5a1811bd11c3\" (UID: \"33d9a1d7-912d-4a20-abe0-5a1811bd11c3\") "
Jul 05 13:53:01.894267 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:01.894239    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33d9a1d7-912d-4a20-abe0-5a1811bd11c3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "33d9a1d7-912d-4a20-abe0-5a1811bd11c3" (UID: "33d9a1d7-912d-4a20-abe0-5a1811bd11c3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:53:01.896022 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:01.895993    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33d9a1d7-912d-4a20-abe0-5a1811bd11c3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "33d9a1d7-912d-4a20-abe0-5a1811bd11c3" (UID: "33d9a1d7-912d-4a20-abe0-5a1811bd11c3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:53:01.896126 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:01.896015    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33d9a1d7-912d-4a20-abe0-5a1811bd11c3-kube-api-access-mfwds" (OuterVolumeSpecName: "kube-api-access-mfwds") pod "33d9a1d7-912d-4a20-abe0-5a1811bd11c3" (UID: "33d9a1d7-912d-4a20-abe0-5a1811bd11c3"). InnerVolumeSpecName "kube-api-access-mfwds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:53:01.994447 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:01.994409    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfwds\" (UniqueName: \"kubernetes.io/projected/33d9a1d7-912d-4a20-abe0-5a1811bd11c3-kube-api-access-mfwds\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:53:01.994447 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:01.994438    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33d9a1d7-912d-4a20-abe0-5a1811bd11c3-openshift-service-ca\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:53:01.994447 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:01.994448    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33d9a1d7-912d-4a20-abe0-5a1811bd11c3-maas-api-tls\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:53:02.842089 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:02.842059    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm"
Jul 05 13:53:02.842574 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:02.842059    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm" event={"ID":"33d9a1d7-912d-4a20-abe0-5a1811bd11c3","Type":"ContainerDied","Data":"e283ed941dae87c0a299b88c5f946c5af079434c96db8c081262670ab72202ce"}
Jul 05 13:53:02.842574 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:02.842189    2565 scope.go:117] "RemoveContainer" containerID="c4c5939dbb00ed2900097f0b76d50e38902df6ee6f3af0adf8a495b0f0f46d10"
Jul 05 13:53:02.864188 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:02.864148    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm"]
Jul 05 13:53:02.868121 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:02.868086    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-3c48d7-5557f8db8d-9bxkm"]
Jul 05 13:53:03.741286 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:03.741247    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33d9a1d7-912d-4a20-abe0-5a1811bd11c3" path="/var/lib/kubelet/pods/33d9a1d7-912d-4a20-abe0-5a1811bd11c3/volumes"
Jul 05 13:53:13.099056 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:13.099016    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:53:14.730367 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:14.730323    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp" podUID="5b6b8989-dc50-4291-b973-d67dc2c0e370" containerName="main" containerID="cri-o://88ee82c70ca965c3362a74b4163371fc22de78c4fff800306cf6b579273dd53f" gracePeriod=45
Jul 05 13:53:14.904541 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:14.904508    2565 generic.go:356] "Generic (PLEG): container finished" podID="5b6b8989-dc50-4291-b973-d67dc2c0e370" containerID="88ee82c70ca965c3362a74b4163371fc22de78c4fff800306cf6b579273dd53f" exitCode=0
Jul 05 13:53:14.904710 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:14.904586    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp" event={"ID":"5b6b8989-dc50-4291-b973-d67dc2c0e370","Type":"ContainerDied","Data":"88ee82c70ca965c3362a74b4163371fc22de78c4fff800306cf6b579273dd53f"}
Jul 05 13:53:14.983533 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:14.983458    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:53:15.009191 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.009154    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b6b8989-dc50-4291-b973-d67dc2c0e370-tls-certs\") pod \"5b6b8989-dc50-4291-b973-d67dc2c0e370\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") "
Jul 05 13:53:15.009386 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.009213    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-dshm\") pod \"5b6b8989-dc50-4291-b973-d67dc2c0e370\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") "
Jul 05 13:53:15.009386 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.009239    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-model-cache\") pod \"5b6b8989-dc50-4291-b973-d67dc2c0e370\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") "
Jul 05 13:53:15.009386 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.009300    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gv68p\" (UniqueName: \"kubernetes.io/projected/5b6b8989-dc50-4291-b973-d67dc2c0e370-kube-api-access-gv68p\") pod \"5b6b8989-dc50-4291-b973-d67dc2c0e370\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") "
Jul 05 13:53:15.009386 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.009335    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-home\") pod \"5b6b8989-dc50-4291-b973-d67dc2c0e370\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") "
Jul 05 13:53:15.009386 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.009383    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-tmp-dir\") pod \"5b6b8989-dc50-4291-b973-d67dc2c0e370\" (UID: \"5b6b8989-dc50-4291-b973-d67dc2c0e370\") "
Jul 05 13:53:15.009660 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.009532    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-model-cache" (OuterVolumeSpecName: "model-cache") pod "5b6b8989-dc50-4291-b973-d67dc2c0e370" (UID: "5b6b8989-dc50-4291-b973-d67dc2c0e370"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:53:15.009735 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.009648    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-home" (OuterVolumeSpecName: "home") pod "5b6b8989-dc50-4291-b973-d67dc2c0e370" (UID: "5b6b8989-dc50-4291-b973-d67dc2c0e370"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:53:15.009794 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.009735    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-model-cache\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:53:15.009846 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.009807    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5b6b8989-dc50-4291-b973-d67dc2c0e370" (UID: "5b6b8989-dc50-4291-b973-d67dc2c0e370"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:53:15.011572 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.011533    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b6b8989-dc50-4291-b973-d67dc2c0e370-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5b6b8989-dc50-4291-b973-d67dc2c0e370" (UID: "5b6b8989-dc50-4291-b973-d67dc2c0e370"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:53:15.011890 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.011866    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-dshm" (OuterVolumeSpecName: "dshm") pod "5b6b8989-dc50-4291-b973-d67dc2c0e370" (UID: "5b6b8989-dc50-4291-b973-d67dc2c0e370"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:53:15.011980 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.011958    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b6b8989-dc50-4291-b973-d67dc2c0e370-kube-api-access-gv68p" (OuterVolumeSpecName: "kube-api-access-gv68p") pod "5b6b8989-dc50-4291-b973-d67dc2c0e370" (UID: "5b6b8989-dc50-4291-b973-d67dc2c0e370"). InnerVolumeSpecName "kube-api-access-gv68p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:53:15.110661 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.110593    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b6b8989-dc50-4291-b973-d67dc2c0e370-tls-certs\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:53:15.110661 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.110628    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-dshm\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:53:15.110661 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.110664    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gv68p\" (UniqueName: \"kubernetes.io/projected/5b6b8989-dc50-4291-b973-d67dc2c0e370-kube-api-access-gv68p\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:53:15.110897 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.110674    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-home\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:53:15.110897 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.110683    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b6b8989-dc50-4291-b973-d67dc2c0e370-tmp-dir\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:53:15.717736 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.717692    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m" podUID="d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c" containerName="main" containerID="cri-o://03f5979a767a3c55043b1bd7a66d8c7f7a28229f2fd46eb814717a565840315d" gracePeriod=45
Jul 05 13:53:15.912278 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.912250    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"
Jul 05 13:53:15.912278 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.912268    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp" event={"ID":"5b6b8989-dc50-4291-b973-d67dc2c0e370","Type":"ContainerDied","Data":"7b4256a8198f6b7f9aaa04bcc078111663e447c42e3b543c976b9196d22e9ff4"}
Jul 05 13:53:15.912846 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.912331    2565 scope.go:117] "RemoveContainer" containerID="88ee82c70ca965c3362a74b4163371fc22de78c4fff800306cf6b579273dd53f"
Jul 05 13:53:15.914205 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.914093    2565 generic.go:356] "Generic (PLEG): container finished" podID="d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c" containerID="03f5979a767a3c55043b1bd7a66d8c7f7a28229f2fd46eb814717a565840315d" exitCode=0
Jul 05 13:53:15.914205 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.914137    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m" event={"ID":"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c","Type":"ContainerDied","Data":"03f5979a767a3c55043b1bd7a66d8c7f7a28229f2fd46eb814717a565840315d"}
Jul 05 13:53:15.929792 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.929753    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"]
Jul 05 13:53:15.935525 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.935492    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-3c48d7/test-model-3c48d7-kserve-6cc8487859-768jp"]
Jul 05 13:53:15.977444 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:15.977363    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:53:16.016573 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.016541    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-tls-certs\") pod \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") "
Jul 05 13:53:16.016798 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.016589    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6s2w\" (UniqueName: \"kubernetes.io/projected/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-kube-api-access-j6s2w\") pod \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") "
Jul 05 13:53:16.016798 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.016665    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-tmp-dir\") pod \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") "
Jul 05 13:53:16.016798 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.016695    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-dshm\") pod \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") "
Jul 05 13:53:16.016798 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.016742    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-home\") pod \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") "
Jul 05 13:53:16.017015 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.016801    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-model-cache\") pod \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\" (UID: \"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c\") "
Jul 05 13:53:16.017015 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.016958    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c" (UID: "d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:53:16.017135 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.017057    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-tmp-dir\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:53:16.017214 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.017190    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-model-cache" (OuterVolumeSpecName: "model-cache") pod "d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c" (UID: "d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:53:16.017349 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.017311    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-home" (OuterVolumeSpecName: "home") pod "d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c" (UID: "d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:53:16.018960 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.018930    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-kube-api-access-j6s2w" (OuterVolumeSpecName: "kube-api-access-j6s2w") pod "d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c" (UID: "d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c"). InnerVolumeSpecName "kube-api-access-j6s2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:53:16.019472 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.019445    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c" (UID: "d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:53:16.019547 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.019475    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-dshm" (OuterVolumeSpecName: "dshm") pod "d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c" (UID: "d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:53:16.118081 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.118039    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-tls-certs\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:53:16.118081 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.118078    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6s2w\" (UniqueName: \"kubernetes.io/projected/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-kube-api-access-j6s2w\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:53:16.118306 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.118106    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-dshm\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:53:16.118306 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.118118    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-home\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:53:16.118306 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.118128    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c-model-cache\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:53:16.922418 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.922374    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m" event={"ID":"d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c","Type":"ContainerDied","Data":"19bf10f599db3df1f1611c683080b0a28c606cdc03bb47640af77ef99210b7a7"}
Jul 05 13:53:16.922418 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.922397    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"
Jul 05 13:53:16.922418 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.922426    2565 scope.go:117] "RemoveContainer" containerID="03f5979a767a3c55043b1bd7a66d8c7f7a28229f2fd46eb814717a565840315d"
Jul 05 13:53:16.946447 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.946410    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"]
Jul 05 13:53:16.954291 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:16.954257    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-114a16/test-model-114a16-kserve-679c44bf49-hkp8m"]
Jul 05 13:53:17.741283 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:17.741244    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b6b8989-dc50-4291-b973-d67dc2c0e370" path="/var/lib/kubelet/pods/5b6b8989-dc50-4291-b973-d67dc2c0e370/volumes"
Jul 05 13:53:17.741909 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:17.741880    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c" path="/var/lib/kubelet/pods/d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c/volumes"
Jul 05 13:53:17.763352 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:17.763321    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/1.log"
Jul 05 13:53:17.766680 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:17.766652    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/1.log"
Jul 05 13:53:17.767656 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:17.767618    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xj7gc_6c7ce124-8975-400e-9f0b-2527ee19af46/ovn-acl-logging/0.log"
Jul 05 13:53:17.770706 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:17.770686    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xj7gc_6c7ce124-8975-400e-9f0b-2527ee19af46/ovn-acl-logging/0.log"
Jul 05 13:53:44.577615 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:44.577576    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb"]
Jul 05 13:53:44.578159 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:44.577844    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb" podUID="28c93a7e-1100-464f-a110-23dc47b366f7" containerName="maas-api" containerID="cri-o://bcd3e7383a88cec8915d530754ffaacb38b6f43d602de594cc49d29fc3a58d9b" gracePeriod=30
Jul 05 13:53:44.828924 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:44.828843    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb"
Jul 05 13:53:44.979208 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:44.979155    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z44vl\" (UniqueName: \"kubernetes.io/projected/28c93a7e-1100-464f-a110-23dc47b366f7-kube-api-access-z44vl\") pod \"28c93a7e-1100-464f-a110-23dc47b366f7\" (UID: \"28c93a7e-1100-464f-a110-23dc47b366f7\") "
Jul 05 13:53:44.979208 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:44.979221    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28c93a7e-1100-464f-a110-23dc47b366f7-openshift-service-ca\") pod \"28c93a7e-1100-464f-a110-23dc47b366f7\" (UID: \"28c93a7e-1100-464f-a110-23dc47b366f7\") "
Jul 05 13:53:44.979496 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:44.979292    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28c93a7e-1100-464f-a110-23dc47b366f7-maas-api-tls\") pod \"28c93a7e-1100-464f-a110-23dc47b366f7\" (UID: \"28c93a7e-1100-464f-a110-23dc47b366f7\") "
Jul 05 13:53:44.979692 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:44.979665    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28c93a7e-1100-464f-a110-23dc47b366f7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "28c93a7e-1100-464f-a110-23dc47b366f7" (UID: "28c93a7e-1100-464f-a110-23dc47b366f7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:53:44.981423 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:44.981395    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28c93a7e-1100-464f-a110-23dc47b366f7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "28c93a7e-1100-464f-a110-23dc47b366f7" (UID: "28c93a7e-1100-464f-a110-23dc47b366f7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:53:44.981530 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:44.981431    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28c93a7e-1100-464f-a110-23dc47b366f7-kube-api-access-z44vl" (OuterVolumeSpecName: "kube-api-access-z44vl") pod "28c93a7e-1100-464f-a110-23dc47b366f7" (UID: "28c93a7e-1100-464f-a110-23dc47b366f7"). InnerVolumeSpecName "kube-api-access-z44vl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:53:45.060938 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:45.060903    2565 generic.go:356] "Generic (PLEG): container finished" podID="28c93a7e-1100-464f-a110-23dc47b366f7" containerID="bcd3e7383a88cec8915d530754ffaacb38b6f43d602de594cc49d29fc3a58d9b" exitCode=0
Jul 05 13:53:45.061136 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:45.060953    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb"
Jul 05 13:53:45.061136 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:45.060989    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb" event={"ID":"28c93a7e-1100-464f-a110-23dc47b366f7","Type":"ContainerDied","Data":"bcd3e7383a88cec8915d530754ffaacb38b6f43d602de594cc49d29fc3a58d9b"}
Jul 05 13:53:45.061136 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:45.061050    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb" event={"ID":"28c93a7e-1100-464f-a110-23dc47b366f7","Type":"ContainerDied","Data":"39abfb6a5a9ce613cbfdf1b139e0afe0619c4ef159680e2ac57d7179669a9969"}
Jul 05 13:53:45.061136 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:45.061078    2565 scope.go:117] "RemoveContainer" containerID="bcd3e7383a88cec8915d530754ffaacb38b6f43d602de594cc49d29fc3a58d9b"
Jul 05 13:53:45.071018 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:45.070997    2565 scope.go:117] "RemoveContainer" containerID="bcd3e7383a88cec8915d530754ffaacb38b6f43d602de594cc49d29fc3a58d9b"
Jul 05 13:53:45.071373 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:53:45.071354    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcd3e7383a88cec8915d530754ffaacb38b6f43d602de594cc49d29fc3a58d9b\": container with ID starting with bcd3e7383a88cec8915d530754ffaacb38b6f43d602de594cc49d29fc3a58d9b not found: ID does not exist" containerID="bcd3e7383a88cec8915d530754ffaacb38b6f43d602de594cc49d29fc3a58d9b"
Jul 05 13:53:45.071440 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:45.071383    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcd3e7383a88cec8915d530754ffaacb38b6f43d602de594cc49d29fc3a58d9b"} err="failed to get container status \"bcd3e7383a88cec8915d530754ffaacb38b6f43d602de594cc49d29fc3a58d9b\": rpc error: code = NotFound desc = could not find container \"bcd3e7383a88cec8915d530754ffaacb38b6f43d602de594cc49d29fc3a58d9b\": container with ID starting with bcd3e7383a88cec8915d530754ffaacb38b6f43d602de594cc49d29fc3a58d9b not found: ID does not exist"
Jul 05 13:53:45.080827 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:45.080740    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28c93a7e-1100-464f-a110-23dc47b366f7-maas-api-tls\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:53:45.080827 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:45.080774    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z44vl\" (UniqueName: \"kubernetes.io/projected/28c93a7e-1100-464f-a110-23dc47b366f7-kube-api-access-z44vl\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:53:45.080827 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:45.080786    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28c93a7e-1100-464f-a110-23dc47b366f7-openshift-service-ca\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:53:45.083731 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:45.083695    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb"]
Jul 05 13:53:45.089381 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:45.089342    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-114a16-6c7c8778d6-886cb"]
Jul 05 13:53:45.741442 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:45.741408    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28c93a7e-1100-464f-a110-23dc47b366f7" path="/var/lib/kubelet/pods/28c93a7e-1100-464f-a110-23dc47b366f7/volumes"
Jul 05 13:53:47.314618 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:47.314577    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:53:54.559173 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.559127    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx"]
Jul 05 13:53:54.559545 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.559457    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28c93a7e-1100-464f-a110-23dc47b366f7" containerName="maas-api"
Jul 05 13:53:54.559545 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.559471    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="28c93a7e-1100-464f-a110-23dc47b366f7" containerName="maas-api"
Jul 05 13:53:54.559545 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.559481    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b6b8989-dc50-4291-b973-d67dc2c0e370" containerName="main"
Jul 05 13:53:54.559545 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.559492    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b6b8989-dc50-4291-b973-d67dc2c0e370" containerName="main"
Jul 05 13:53:54.559545 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.559506    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33d9a1d7-912d-4a20-abe0-5a1811bd11c3" containerName="maas-api"
Jul 05 13:53:54.559545 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.559511    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="33d9a1d7-912d-4a20-abe0-5a1811bd11c3" containerName="maas-api"
Jul 05 13:53:54.559545 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.559521    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c" containerName="main"
Jul 05 13:53:54.559545 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.559529    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c" containerName="main"
Jul 05 13:53:54.559832 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.559588    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b6b8989-dc50-4291-b973-d67dc2c0e370" containerName="main"
Jul 05 13:53:54.559832 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.559598    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0f9c1d3-5c8f-43dd-8fe4-e289a325ab4c" containerName="main"
Jul 05 13:53:54.559832 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.559607    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="28c93a7e-1100-464f-a110-23dc47b366f7" containerName="maas-api"
Jul 05 13:53:54.559832 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.559617    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="33d9a1d7-912d-4a20-abe0-5a1811bd11c3" containerName="maas-api"
Jul 05 13:53:54.562556 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.562535    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx"
Jul 05 13:53:54.565219 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.565185    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-e72226-serving-cert\""
Jul 05 13:53:54.565219 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.565192    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9bvwj\""
Jul 05 13:53:54.578933 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.578277    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx"]
Jul 05 13:53:54.657678 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.657611    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzhtb\" (UniqueName: \"kubernetes.io/projected/25a0d404-a949-45d9-89dd-ec9819ac9bfe-kube-api-access-pzhtb\") pod \"maas-api-e2e-api-a-e72226-74bc8549db-n67fx\" (UID: \"25a0d404-a949-45d9-89dd-ec9819ac9bfe\") " pod="opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx"
Jul 05 13:53:54.657678 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.657680    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25a0d404-a949-45d9-89dd-ec9819ac9bfe-openshift-service-ca\") pod \"maas-api-e2e-api-a-e72226-74bc8549db-n67fx\" (UID: \"25a0d404-a949-45d9-89dd-ec9819ac9bfe\") " pod="opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx"
Jul 05 13:53:54.657903 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.657700    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25a0d404-a949-45d9-89dd-ec9819ac9bfe-maas-api-tls\") pod \"maas-api-e2e-api-a-e72226-74bc8549db-n67fx\" (UID: \"25a0d404-a949-45d9-89dd-ec9819ac9bfe\") " pod="opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx"
Jul 05 13:53:54.758591 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.758541    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzhtb\" (UniqueName: \"kubernetes.io/projected/25a0d404-a949-45d9-89dd-ec9819ac9bfe-kube-api-access-pzhtb\") pod \"maas-api-e2e-api-a-e72226-74bc8549db-n67fx\" (UID: \"25a0d404-a949-45d9-89dd-ec9819ac9bfe\") " pod="opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx"
Jul 05 13:53:54.758819 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.758601    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25a0d404-a949-45d9-89dd-ec9819ac9bfe-openshift-service-ca\") pod \"maas-api-e2e-api-a-e72226-74bc8549db-n67fx\" (UID: \"25a0d404-a949-45d9-89dd-ec9819ac9bfe\") " pod="opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx"
Jul 05 13:53:54.758819 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.758664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25a0d404-a949-45d9-89dd-ec9819ac9bfe-maas-api-tls\") pod \"maas-api-e2e-api-a-e72226-74bc8549db-n67fx\" (UID: \"25a0d404-a949-45d9-89dd-ec9819ac9bfe\") " pod="opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx"
Jul 05 13:53:54.759310 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.759286    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25a0d404-a949-45d9-89dd-ec9819ac9bfe-openshift-service-ca\") pod \"maas-api-e2e-api-a-e72226-74bc8549db-n67fx\" (UID: \"25a0d404-a949-45d9-89dd-ec9819ac9bfe\") " pod="opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx"
Jul 05 13:53:54.761456 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.761428    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25a0d404-a949-45d9-89dd-ec9819ac9bfe-maas-api-tls\") pod \"maas-api-e2e-api-a-e72226-74bc8549db-n67fx\" (UID: \"25a0d404-a949-45d9-89dd-ec9819ac9bfe\") " pod="opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx"
Jul 05 13:53:54.769223 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.769200    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzhtb\" (UniqueName: \"kubernetes.io/projected/25a0d404-a949-45d9-89dd-ec9819ac9bfe-kube-api-access-pzhtb\") pod \"maas-api-e2e-api-a-e72226-74bc8549db-n67fx\" (UID: \"25a0d404-a949-45d9-89dd-ec9819ac9bfe\") " pod="opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx"
Jul 05 13:53:54.873091 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:54.873054    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx"
Jul 05 13:53:55.008766 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:55.008740    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx"]
Jul 05 13:53:55.011015 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:53:55.010982    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25a0d404_a949_45d9_89dd_ec9819ac9bfe.slice/crio-dcedcc4bb1c1f3c93e516711025bc0183ee0bbdebabf6b37259b02c04a0ceb02 WatchSource:0}: Error finding container dcedcc4bb1c1f3c93e516711025bc0183ee0bbdebabf6b37259b02c04a0ceb02: Status 404 returned error can't find the container with id dcedcc4bb1c1f3c93e516711025bc0183ee0bbdebabf6b37259b02c04a0ceb02
Jul 05 13:53:55.110752 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:55.110713    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx" event={"ID":"25a0d404-a949-45d9-89dd-ec9819ac9bfe","Type":"ContainerStarted","Data":"dcedcc4bb1c1f3c93e516711025bc0183ee0bbdebabf6b37259b02c04a0ceb02"}
Jul 05 13:53:56.117625 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:56.117591    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx" event={"ID":"25a0d404-a949-45d9-89dd-ec9819ac9bfe","Type":"ContainerStarted","Data":"c63809aae5163dd6293dee33989e690fcf274a8daa61942231d292fab38a185d"}
Jul 05 13:53:56.118023 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:56.117675    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx"
Jul 05 13:53:56.135927 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:56.135879    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx" podStartSLOduration=1.725676015 podStartE2EDuration="2.135864079s" totalImagesPullingTime="410.188064ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:53:56.134813948 +0000 UTC m=+2138.952781922" watchObservedRunningTime="2026-07-05 13:53:56.135864079 +0000 UTC m=+2138.953832048"
Jul 05 13:53:59.999805 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:53:59.999774    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:54:02.129333 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:02.129303    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx"
Jul 05 13:54:02.662664 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:02.662596    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9"]
Jul 05 13:54:02.666200 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:02.666172    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9"
Jul 05 13:54:02.669712 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:02.669682    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-d0bf0c-serving-cert\""
Jul 05 13:54:02.678697 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:02.678668    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9"]
Jul 05 13:54:02.721371 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:02.721334    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d4ff7e4-7a5a-4098-bdf6-ab33aee049df-openshift-service-ca\") pod \"maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9\" (UID: \"0d4ff7e4-7a5a-4098-bdf6-ab33aee049df\") " pod="opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9"
Jul 05 13:54:02.721371 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:02.721373    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ml7t\" (UniqueName: \"kubernetes.io/projected/0d4ff7e4-7a5a-4098-bdf6-ab33aee049df-kube-api-access-7ml7t\") pod \"maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9\" (UID: \"0d4ff7e4-7a5a-4098-bdf6-ab33aee049df\") " pod="opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9"
Jul 05 13:54:02.721671 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:02.721478    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d4ff7e4-7a5a-4098-bdf6-ab33aee049df-maas-api-tls\") pod \"maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9\" (UID: \"0d4ff7e4-7a5a-4098-bdf6-ab33aee049df\") " pod="opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9"
Jul 05 13:54:02.822145 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:02.822097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d4ff7e4-7a5a-4098-bdf6-ab33aee049df-openshift-service-ca\") pod \"maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9\" (UID: \"0d4ff7e4-7a5a-4098-bdf6-ab33aee049df\") " pod="opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9"
Jul 05 13:54:02.822145 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:02.822148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ml7t\" (UniqueName: \"kubernetes.io/projected/0d4ff7e4-7a5a-4098-bdf6-ab33aee049df-kube-api-access-7ml7t\") pod \"maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9\" (UID: \"0d4ff7e4-7a5a-4098-bdf6-ab33aee049df\") " pod="opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9"
Jul 05 13:54:02.822428 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:02.822224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d4ff7e4-7a5a-4098-bdf6-ab33aee049df-maas-api-tls\") pod \"maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9\" (UID: \"0d4ff7e4-7a5a-4098-bdf6-ab33aee049df\") " pod="opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9"
Jul 05 13:54:02.822853 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:02.822828    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d4ff7e4-7a5a-4098-bdf6-ab33aee049df-openshift-service-ca\") pod \"maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9\" (UID: \"0d4ff7e4-7a5a-4098-bdf6-ab33aee049df\") " pod="opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9"
Jul 05 13:54:02.824766 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:02.824742    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d4ff7e4-7a5a-4098-bdf6-ab33aee049df-maas-api-tls\") pod \"maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9\" (UID: \"0d4ff7e4-7a5a-4098-bdf6-ab33aee049df\") " pod="opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9"
Jul 05 13:54:02.831950 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:02.831921    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ml7t\" (UniqueName: \"kubernetes.io/projected/0d4ff7e4-7a5a-4098-bdf6-ab33aee049df-kube-api-access-7ml7t\") pod \"maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9\" (UID: \"0d4ff7e4-7a5a-4098-bdf6-ab33aee049df\") " pod="opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9"
Jul 05 13:54:02.980731 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:02.980614    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9"
Jul 05 13:54:03.120575 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:03.120549    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9"]
Jul 05 13:54:03.122374 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:54:03.122346    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d4ff7e4_7a5a_4098_bdf6_ab33aee049df.slice/crio-ce3ed0cb2d407efbdf3b06bd186f05c29bf09dd76a60f2fcd2e191d17f568d45 WatchSource:0}: Error finding container ce3ed0cb2d407efbdf3b06bd186f05c29bf09dd76a60f2fcd2e191d17f568d45: Status 404 returned error can't find the container with id ce3ed0cb2d407efbdf3b06bd186f05c29bf09dd76a60f2fcd2e191d17f568d45
Jul 05 13:54:03.153728 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:03.153682    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9" event={"ID":"0d4ff7e4-7a5a-4098-bdf6-ab33aee049df","Type":"ContainerStarted","Data":"ce3ed0cb2d407efbdf3b06bd186f05c29bf09dd76a60f2fcd2e191d17f568d45"}
Jul 05 13:54:04.160686 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:04.160616    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9" event={"ID":"0d4ff7e4-7a5a-4098-bdf6-ab33aee049df","Type":"ContainerStarted","Data":"57fbc205cc86c14c391504c3d2131ca70b8a826565e323d8adee46fd4f98c7f9"}
Jul 05 13:54:04.161085 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:04.160713    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9"
Jul 05 13:54:04.194578 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:04.194513    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9" podStartSLOduration=1.872450801 podStartE2EDuration="2.194492701s" totalImagesPullingTime="322.0419ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:54:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:54:04.191703035 +0000 UTC m=+2147.009671013" watchObservedRunningTime="2026-07-05 13:54:04.194492701 +0000 UTC m=+2147.012460660"
Jul 05 13:54:09.704229 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:09.704141    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:54:10.173066 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:10.173032    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9"
Jul 05 13:54:15.798041 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:15.798002    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx"]
Jul 05 13:54:15.798530 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:15.798238    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx" podUID="25a0d404-a949-45d9-89dd-ec9819ac9bfe" containerName="maas-api" containerID="cri-o://c63809aae5163dd6293dee33989e690fcf274a8daa61942231d292fab38a185d" gracePeriod=30
Jul 05 13:54:16.048328 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:16.048231    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx"
Jul 05 13:54:16.137691 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:16.137625    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25a0d404-a949-45d9-89dd-ec9819ac9bfe-openshift-service-ca\") pod \"25a0d404-a949-45d9-89dd-ec9819ac9bfe\" (UID: \"25a0d404-a949-45d9-89dd-ec9819ac9bfe\") "
Jul 05 13:54:16.137911 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:16.137730    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25a0d404-a949-45d9-89dd-ec9819ac9bfe-maas-api-tls\") pod \"25a0d404-a949-45d9-89dd-ec9819ac9bfe\" (UID: \"25a0d404-a949-45d9-89dd-ec9819ac9bfe\") "
Jul 05 13:54:16.137911 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:16.137824    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzhtb\" (UniqueName: \"kubernetes.io/projected/25a0d404-a949-45d9-89dd-ec9819ac9bfe-kube-api-access-pzhtb\") pod \"25a0d404-a949-45d9-89dd-ec9819ac9bfe\" (UID: \"25a0d404-a949-45d9-89dd-ec9819ac9bfe\") "
Jul 05 13:54:16.138115 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:16.138083    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25a0d404-a949-45d9-89dd-ec9819ac9bfe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "25a0d404-a949-45d9-89dd-ec9819ac9bfe" (UID: "25a0d404-a949-45d9-89dd-ec9819ac9bfe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:54:16.139879 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:16.139855    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25a0d404-a949-45d9-89dd-ec9819ac9bfe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "25a0d404-a949-45d9-89dd-ec9819ac9bfe" (UID: "25a0d404-a949-45d9-89dd-ec9819ac9bfe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:54:16.139983 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:16.139929    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25a0d404-a949-45d9-89dd-ec9819ac9bfe-kube-api-access-pzhtb" (OuterVolumeSpecName: "kube-api-access-pzhtb") pod "25a0d404-a949-45d9-89dd-ec9819ac9bfe" (UID: "25a0d404-a949-45d9-89dd-ec9819ac9bfe"). InnerVolumeSpecName "kube-api-access-pzhtb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:54:16.222731 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:16.222695    2565 generic.go:356] "Generic (PLEG): container finished" podID="25a0d404-a949-45d9-89dd-ec9819ac9bfe" containerID="c63809aae5163dd6293dee33989e690fcf274a8daa61942231d292fab38a185d" exitCode=0
Jul 05 13:54:16.222910 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:16.222741    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx"
Jul 05 13:54:16.222910 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:16.222781    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx" event={"ID":"25a0d404-a949-45d9-89dd-ec9819ac9bfe","Type":"ContainerDied","Data":"c63809aae5163dd6293dee33989e690fcf274a8daa61942231d292fab38a185d"}
Jul 05 13:54:16.222910 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:16.222840    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx" event={"ID":"25a0d404-a949-45d9-89dd-ec9819ac9bfe","Type":"ContainerDied","Data":"dcedcc4bb1c1f3c93e516711025bc0183ee0bbdebabf6b37259b02c04a0ceb02"}
Jul 05 13:54:16.222910 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:16.222873    2565 scope.go:117] "RemoveContainer" containerID="c63809aae5163dd6293dee33989e690fcf274a8daa61942231d292fab38a185d"
Jul 05 13:54:16.235394 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:16.235371    2565 scope.go:117] "RemoveContainer" containerID="c63809aae5163dd6293dee33989e690fcf274a8daa61942231d292fab38a185d"
Jul 05 13:54:16.235744 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:54:16.235723    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c63809aae5163dd6293dee33989e690fcf274a8daa61942231d292fab38a185d\": container with ID starting with c63809aae5163dd6293dee33989e690fcf274a8daa61942231d292fab38a185d not found: ID does not exist" containerID="c63809aae5163dd6293dee33989e690fcf274a8daa61942231d292fab38a185d"
Jul 05 13:54:16.235792 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:16.235756    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c63809aae5163dd6293dee33989e690fcf274a8daa61942231d292fab38a185d"} err="failed to get container status \"c63809aae5163dd6293dee33989e690fcf274a8daa61942231d292fab38a185d\": rpc error: code = NotFound desc = could not find container \"c63809aae5163dd6293dee33989e690fcf274a8daa61942231d292fab38a185d\": container with ID starting with c63809aae5163dd6293dee33989e690fcf274a8daa61942231d292fab38a185d not found: ID does not exist"
Jul 05 13:54:16.238602 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:16.238575    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25a0d404-a949-45d9-89dd-ec9819ac9bfe-maas-api-tls\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:54:16.238602 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:16.238601    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzhtb\" (UniqueName: \"kubernetes.io/projected/25a0d404-a949-45d9-89dd-ec9819ac9bfe-kube-api-access-pzhtb\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:54:16.238766 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:16.238613    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25a0d404-a949-45d9-89dd-ec9819ac9bfe-openshift-service-ca\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:54:16.249414 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:16.249378    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx"]
Jul 05 13:54:16.253023 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:16.252989    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-e72226-74bc8549db-n67fx"]
Jul 05 13:54:17.741259 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:17.741222    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25a0d404-a949-45d9-89dd-ec9819ac9bfe" path="/var/lib/kubelet/pods/25a0d404-a949-45d9-89dd-ec9819ac9bfe/volumes"
Jul 05 13:54:21.297133 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:21.297094    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:54:22.869912 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:22.869867    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9"]
Jul 05 13:54:22.870433 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:22.870185    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9" podUID="0d4ff7e4-7a5a-4098-bdf6-ab33aee049df" containerName="maas-api" containerID="cri-o://57fbc205cc86c14c391504c3d2131ca70b8a826565e323d8adee46fd4f98c7f9" gracePeriod=30
Jul 05 13:54:23.127550 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:23.127478    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9"
Jul 05 13:54:23.202267 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:23.202228    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d4ff7e4-7a5a-4098-bdf6-ab33aee049df-maas-api-tls\") pod \"0d4ff7e4-7a5a-4098-bdf6-ab33aee049df\" (UID: \"0d4ff7e4-7a5a-4098-bdf6-ab33aee049df\") "
Jul 05 13:54:23.202469 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:23.202295    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ml7t\" (UniqueName: \"kubernetes.io/projected/0d4ff7e4-7a5a-4098-bdf6-ab33aee049df-kube-api-access-7ml7t\") pod \"0d4ff7e4-7a5a-4098-bdf6-ab33aee049df\" (UID: \"0d4ff7e4-7a5a-4098-bdf6-ab33aee049df\") "
Jul 05 13:54:23.202469 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:23.202327    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d4ff7e4-7a5a-4098-bdf6-ab33aee049df-openshift-service-ca\") pod \"0d4ff7e4-7a5a-4098-bdf6-ab33aee049df\" (UID: \"0d4ff7e4-7a5a-4098-bdf6-ab33aee049df\") "
Jul 05 13:54:23.202689 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:23.202664    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d4ff7e4-7a5a-4098-bdf6-ab33aee049df-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0d4ff7e4-7a5a-4098-bdf6-ab33aee049df" (UID: "0d4ff7e4-7a5a-4098-bdf6-ab33aee049df"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 13:54:23.204456 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:23.204424    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d4ff7e4-7a5a-4098-bdf6-ab33aee049df-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0d4ff7e4-7a5a-4098-bdf6-ab33aee049df" (UID: "0d4ff7e4-7a5a-4098-bdf6-ab33aee049df"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:54:23.204555 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:23.204472    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d4ff7e4-7a5a-4098-bdf6-ab33aee049df-kube-api-access-7ml7t" (OuterVolumeSpecName: "kube-api-access-7ml7t") pod "0d4ff7e4-7a5a-4098-bdf6-ab33aee049df" (UID: "0d4ff7e4-7a5a-4098-bdf6-ab33aee049df"). InnerVolumeSpecName "kube-api-access-7ml7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:54:23.265194 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:23.265152    2565 generic.go:356] "Generic (PLEG): container finished" podID="0d4ff7e4-7a5a-4098-bdf6-ab33aee049df" containerID="57fbc205cc86c14c391504c3d2131ca70b8a826565e323d8adee46fd4f98c7f9" exitCode=0
Jul 05 13:54:23.265391 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:23.265204    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9"
Jul 05 13:54:23.265391 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:23.265226    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9" event={"ID":"0d4ff7e4-7a5a-4098-bdf6-ab33aee049df","Type":"ContainerDied","Data":"57fbc205cc86c14c391504c3d2131ca70b8a826565e323d8adee46fd4f98c7f9"}
Jul 05 13:54:23.265391 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:23.265294    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9" event={"ID":"0d4ff7e4-7a5a-4098-bdf6-ab33aee049df","Type":"ContainerDied","Data":"ce3ed0cb2d407efbdf3b06bd186f05c29bf09dd76a60f2fcd2e191d17f568d45"}
Jul 05 13:54:23.265391 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:23.265325    2565 scope.go:117] "RemoveContainer" containerID="57fbc205cc86c14c391504c3d2131ca70b8a826565e323d8adee46fd4f98c7f9"
Jul 05 13:54:23.276791 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:23.276767    2565 scope.go:117] "RemoveContainer" containerID="57fbc205cc86c14c391504c3d2131ca70b8a826565e323d8adee46fd4f98c7f9"
Jul 05 13:54:23.277144 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:54:23.277121    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57fbc205cc86c14c391504c3d2131ca70b8a826565e323d8adee46fd4f98c7f9\": container with ID starting with 57fbc205cc86c14c391504c3d2131ca70b8a826565e323d8adee46fd4f98c7f9 not found: ID does not exist" containerID="57fbc205cc86c14c391504c3d2131ca70b8a826565e323d8adee46fd4f98c7f9"
Jul 05 13:54:23.277224 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:23.277160    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57fbc205cc86c14c391504c3d2131ca70b8a826565e323d8adee46fd4f98c7f9"} err="failed to get container status \"57fbc205cc86c14c391504c3d2131ca70b8a826565e323d8adee46fd4f98c7f9\": rpc error: code = NotFound desc = could not find container \"57fbc205cc86c14c391504c3d2131ca70b8a826565e323d8adee46fd4f98c7f9\": container with ID starting with 57fbc205cc86c14c391504c3d2131ca70b8a826565e323d8adee46fd4f98c7f9 not found: ID does not exist"
Jul 05 13:54:23.288883 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:23.288846    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9"]
Jul 05 13:54:23.290783 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:23.290751    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d0bf0c-7cb8b4989b-tkmb9"]
Jul 05 13:54:23.296102 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:54:23.296066    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d4ff7e4_7a5a_4098_bdf6_ab33aee049df.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d4ff7e4_7a5a_4098_bdf6_ab33aee049df.slice/crio-ce3ed0cb2d407efbdf3b06bd186f05c29bf09dd76a60f2fcd2e191d17f568d45\": RecentStats: unable to find data in memory cache]"
Jul 05 13:54:23.305047 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:23.305006    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d4ff7e4-7a5a-4098-bdf6-ab33aee049df-openshift-service-ca\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:54:23.305047 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:23.305038    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d4ff7e4-7a5a-4098-bdf6-ab33aee049df-maas-api-tls\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:54:23.305047 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:23.305048    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ml7t\" (UniqueName: \"kubernetes.io/projected/0d4ff7e4-7a5a-4098-bdf6-ab33aee049df-kube-api-access-7ml7t\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:54:23.741255 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:23.741208    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d4ff7e4-7a5a-4098-bdf6-ab33aee049df" path="/var/lib/kubelet/pods/0d4ff7e4-7a5a-4098-bdf6-ab33aee049df/volumes"
Jul 05 13:54:30.897831 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:30.897795    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:54:32.721081 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:32.721033    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk"]
Jul 05 13:54:32.721497 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:32.721454    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d4ff7e4-7a5a-4098-bdf6-ab33aee049df" containerName="maas-api"
Jul 05 13:54:32.721497 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:32.721468    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d4ff7e4-7a5a-4098-bdf6-ab33aee049df" containerName="maas-api"
Jul 05 13:54:32.721497 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:32.721494    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25a0d404-a949-45d9-89dd-ec9819ac9bfe" containerName="maas-api"
Jul 05 13:54:32.721611 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:32.721503    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="25a0d404-a949-45d9-89dd-ec9819ac9bfe" containerName="maas-api"
Jul 05 13:54:32.721611 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:32.721577    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="25a0d404-a949-45d9-89dd-ec9819ac9bfe" containerName="maas-api"
Jul 05 13:54:32.721611 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:32.721590    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d4ff7e4-7a5a-4098-bdf6-ab33aee049df" containerName="maas-api"
Jul 05 13:54:32.726156 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:32.726130    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk"
Jul 05 13:54:32.729346 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:32.729315    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-c2f889-serving-cert\""
Jul 05 13:54:32.729494 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:32.729374    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9bvwj\""
Jul 05 13:54:32.734183 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:32.734146    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk"]
Jul 05 13:54:32.885238 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:32.885200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzgtv\" (UniqueName: \"kubernetes.io/projected/07914bb6-0c6a-4b9e-98bc-f2b966162427-kube-api-access-tzgtv\") pod \"maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk\" (UID: \"07914bb6-0c6a-4b9e-98bc-f2b966162427\") " pod="opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk"
Jul 05 13:54:32.885434 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:32.885266    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07914bb6-0c6a-4b9e-98bc-f2b966162427-maas-api-tls\") pod \"maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk\" (UID: \"07914bb6-0c6a-4b9e-98bc-f2b966162427\") " pod="opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk"
Jul 05 13:54:32.885434 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:32.885315    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07914bb6-0c6a-4b9e-98bc-f2b966162427-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk\" (UID: \"07914bb6-0c6a-4b9e-98bc-f2b966162427\") " pod="opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk"
Jul 05 13:54:32.986811 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:32.986704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzgtv\" (UniqueName: \"kubernetes.io/projected/07914bb6-0c6a-4b9e-98bc-f2b966162427-kube-api-access-tzgtv\") pod \"maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk\" (UID: \"07914bb6-0c6a-4b9e-98bc-f2b966162427\") " pod="opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk"
Jul 05 13:54:32.986811 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:32.986767    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07914bb6-0c6a-4b9e-98bc-f2b966162427-maas-api-tls\") pod \"maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk\" (UID: \"07914bb6-0c6a-4b9e-98bc-f2b966162427\") " pod="opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk"
Jul 05 13:54:32.986811 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:32.986810    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07914bb6-0c6a-4b9e-98bc-f2b966162427-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk\" (UID: \"07914bb6-0c6a-4b9e-98bc-f2b966162427\") " pod="opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk"
Jul 05 13:54:32.987492 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:32.987467    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07914bb6-0c6a-4b9e-98bc-f2b966162427-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk\" (UID: \"07914bb6-0c6a-4b9e-98bc-f2b966162427\") " pod="opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk"
Jul 05 13:54:32.989222 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:32.989199    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07914bb6-0c6a-4b9e-98bc-f2b966162427-maas-api-tls\") pod \"maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk\" (UID: \"07914bb6-0c6a-4b9e-98bc-f2b966162427\") " pod="opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk"
Jul 05 13:54:32.995188 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:32.995152    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzgtv\" (UniqueName: \"kubernetes.io/projected/07914bb6-0c6a-4b9e-98bc-f2b966162427-kube-api-access-tzgtv\") pod \"maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk\" (UID: \"07914bb6-0c6a-4b9e-98bc-f2b966162427\") " pod="opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk"
Jul 05 13:54:33.039154 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:33.039112    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk"
Jul 05 13:54:33.186276 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:33.186233    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk"]
Jul 05 13:54:33.189718 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:54:33.189687    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07914bb6_0c6a_4b9e_98bc_f2b966162427.slice/crio-a59d53e6b9156cf88425acfe87c053be13230ebd58f5f1d7c1e69e3fa4c71e47 WatchSource:0}: Error finding container a59d53e6b9156cf88425acfe87c053be13230ebd58f5f1d7c1e69e3fa4c71e47: Status 404 returned error can't find the container with id a59d53e6b9156cf88425acfe87c053be13230ebd58f5f1d7c1e69e3fa4c71e47
Jul 05 13:54:33.318372 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:33.318280    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk" event={"ID":"07914bb6-0c6a-4b9e-98bc-f2b966162427","Type":"ContainerStarted","Data":"a59d53e6b9156cf88425acfe87c053be13230ebd58f5f1d7c1e69e3fa4c71e47"}
Jul 05 13:54:34.325227 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:34.325195    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk" event={"ID":"07914bb6-0c6a-4b9e-98bc-f2b966162427","Type":"ContainerStarted","Data":"1bf5e324c608887dbcc95c0b19be3167126900c3aeed41a145d955bf6a756f9b"}
Jul 05 13:54:34.325678 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:34.325305    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk"
Jul 05 13:54:34.344114 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:34.344028    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk" podStartSLOduration=1.955004378 podStartE2EDuration="2.344007289s" totalImagesPullingTime="389.002911ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:54:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:54:34.342472779 +0000 UTC m=+2177.160440759" watchObservedRunningTime="2026-07-05 13:54:34.344007289 +0000 UTC m=+2177.161975256"
Jul 05 13:54:40.336225 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:40.336192    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk"
Jul 05 13:54:40.801006 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:40.800965    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2"]
Jul 05 13:54:40.804920 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:40.804896    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2"
Jul 05 13:54:40.807703 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:40.807672    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-7acb12-serving-cert\""
Jul 05 13:54:40.817025 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:40.816983    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2"]
Jul 05 13:54:40.953595 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:40.953554    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67461fde-4746-4aa6-bae5-15ba77bbdb5d-maas-api-tls\") pod \"maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2\" (UID: \"67461fde-4746-4aa6-bae5-15ba77bbdb5d\") " pod="opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2"
Jul 05 13:54:40.953595 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:40.953601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67461fde-4746-4aa6-bae5-15ba77bbdb5d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2\" (UID: \"67461fde-4746-4aa6-bae5-15ba77bbdb5d\") " pod="opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2"
Jul 05 13:54:40.953885 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:40.953768    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqtjs\" (UniqueName: \"kubernetes.io/projected/67461fde-4746-4aa6-bae5-15ba77bbdb5d-kube-api-access-wqtjs\") pod \"maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2\" (UID: \"67461fde-4746-4aa6-bae5-15ba77bbdb5d\") " pod="opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2"
Jul 05 13:54:41.054816 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:41.054710    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqtjs\" (UniqueName: \"kubernetes.io/projected/67461fde-4746-4aa6-bae5-15ba77bbdb5d-kube-api-access-wqtjs\") pod \"maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2\" (UID: \"67461fde-4746-4aa6-bae5-15ba77bbdb5d\") " pod="opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2"
Jul 05 13:54:41.054816 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:41.054778    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67461fde-4746-4aa6-bae5-15ba77bbdb5d-maas-api-tls\") pod \"maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2\" (UID: \"67461fde-4746-4aa6-bae5-15ba77bbdb5d\") " pod="opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2"
Jul 05 13:54:41.054816 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:41.054795    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67461fde-4746-4aa6-bae5-15ba77bbdb5d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2\" (UID: \"67461fde-4746-4aa6-bae5-15ba77bbdb5d\") " pod="opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2"
Jul 05 13:54:41.055044 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:54:41.054921    2565 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-7acb12-serving-cert: secret "maas-api-e2e-shared-b-7acb12-serving-cert" not found
Jul 05 13:54:41.055044 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:54:41.054983    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67461fde-4746-4aa6-bae5-15ba77bbdb5d-maas-api-tls podName:67461fde-4746-4aa6-bae5-15ba77bbdb5d nodeName:}" failed. No retries permitted until 2026-07-05 13:54:41.554966108 +0000 UTC m=+2184.372934044 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/67461fde-4746-4aa6-bae5-15ba77bbdb5d-maas-api-tls") pod "maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2" (UID: "67461fde-4746-4aa6-bae5-15ba77bbdb5d") : secret "maas-api-e2e-shared-b-7acb12-serving-cert" not found
Jul 05 13:54:41.055444 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:41.055427    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67461fde-4746-4aa6-bae5-15ba77bbdb5d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2\" (UID: \"67461fde-4746-4aa6-bae5-15ba77bbdb5d\") " pod="opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2"
Jul 05 13:54:41.077725 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:41.077690    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqtjs\" (UniqueName: \"kubernetes.io/projected/67461fde-4746-4aa6-bae5-15ba77bbdb5d-kube-api-access-wqtjs\") pod \"maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2\" (UID: \"67461fde-4746-4aa6-bae5-15ba77bbdb5d\") " pod="opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2"
Jul 05 13:54:41.315829 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:41.315723    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:54:41.559755 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:41.559713    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67461fde-4746-4aa6-bae5-15ba77bbdb5d-maas-api-tls\") pod \"maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2\" (UID: \"67461fde-4746-4aa6-bae5-15ba77bbdb5d\") " pod="opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2"
Jul 05 13:54:41.562209 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:41.562182    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67461fde-4746-4aa6-bae5-15ba77bbdb5d-maas-api-tls\") pod \"maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2\" (UID: \"67461fde-4746-4aa6-bae5-15ba77bbdb5d\") " pod="opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2"
Jul 05 13:54:41.717799 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:41.717753    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2"
Jul 05 13:54:41.883526 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:41.883502    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2"]
Jul 05 13:54:41.885323 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:54:41.885295    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67461fde_4746_4aa6_bae5_15ba77bbdb5d.slice/crio-f266bfde02f78086cbc801e2d95d7f8e13a983015b8efbfbf3743e45ae6d48d3 WatchSource:0}: Error finding container f266bfde02f78086cbc801e2d95d7f8e13a983015b8efbfbf3743e45ae6d48d3: Status 404 returned error can't find the container with id f266bfde02f78086cbc801e2d95d7f8e13a983015b8efbfbf3743e45ae6d48d3
Jul 05 13:54:42.366689 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:42.366652    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2" event={"ID":"67461fde-4746-4aa6-bae5-15ba77bbdb5d","Type":"ContainerStarted","Data":"d3adbc319e0a313e7ee0af60c09a26993df6b30dbc00cc0e5df9618f7a520f70"}
Jul 05 13:54:42.366870 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:42.366709    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2" event={"ID":"67461fde-4746-4aa6-bae5-15ba77bbdb5d","Type":"ContainerStarted","Data":"f266bfde02f78086cbc801e2d95d7f8e13a983015b8efbfbf3743e45ae6d48d3"}
Jul 05 13:54:42.366870 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:42.366746    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2"
Jul 05 13:54:42.385037 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:42.384975    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2" podStartSLOduration=2.007207866 podStartE2EDuration="2.384956851s" totalImagesPullingTime="377.748985ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:54:42.382722119 +0000 UTC m=+2185.200690114" watchObservedRunningTime="2026-07-05 13:54:42.384956851 +0000 UTC m=+2185.202924819"
Jul 05 13:54:48.377112 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:48.377082    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2"
Jul 05 13:54:51.899487 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:51.899434    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:54:54.393247 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.393209    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"]
Jul 05 13:54:54.395301 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.395281    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:54:54.397997 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.397967    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c2f889\"/\"default-dockercfg-qcrrz\""
Jul 05 13:54:54.399219 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.399191    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c2f889\"/\"kube-root-ca.crt\""
Jul 05 13:54:54.399219 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.399206    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c2f889\"/\"openshift-service-ca.crt\""
Jul 05 13:54:54.399429 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.399192    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c2f889\"/\"auth-test-model-c2f889-kserve-self-signed-certs\""
Jul 05 13:54:54.410958 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.410922    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"]
Jul 05 13:54:54.469298 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.469263    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-dshm\") pod \"auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") " pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:54:54.469298 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.469301    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-tmp-dir\") pod \"auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") " pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:54:54.469567 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.469398    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-model-cache\") pod \"auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") " pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:54:54.469567 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.469447    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd0f4165-5e2a-4b57-9780-b913520841d1-tls-certs\") pod \"auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") " pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:54:54.469567 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.469471    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4knt\" (UniqueName: \"kubernetes.io/projected/dd0f4165-5e2a-4b57-9780-b913520841d1-kube-api-access-s4knt\") pod \"auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") " pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:54:54.469567 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.469535    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-home\") pod \"auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") " pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:54:54.570758 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.570716    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-dshm\") pod \"auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") " pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:54:54.570758 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.570760    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-tmp-dir\") pod \"auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") " pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:54:54.570973 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.570911    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-model-cache\") pod \"auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") " pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:54:54.570973 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.570949    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd0f4165-5e2a-4b57-9780-b913520841d1-tls-certs\") pod \"auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") " pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:54:54.571052 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.570981    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4knt\" (UniqueName: \"kubernetes.io/projected/dd0f4165-5e2a-4b57-9780-b913520841d1-kube-api-access-s4knt\") pod \"auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") " pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:54:54.571052 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.571041    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-home\") pod \"auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") " pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:54:54.571263 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.571241    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-tmp-dir\") pod \"auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") " pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:54:54.571339 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.571294    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-model-cache\") pod \"auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") " pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:54:54.571423 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.571408    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-home\") pod \"auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") " pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:54:54.573239 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.573204    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-dshm\") pod \"auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") " pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:54:54.573417 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.573398    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd0f4165-5e2a-4b57-9780-b913520841d1-tls-certs\") pod \"auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") " pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:54:54.578993 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.578962    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4knt\" (UniqueName: \"kubernetes.io/projected/dd0f4165-5e2a-4b57-9780-b913520841d1-kube-api-access-s4knt\") pod \"auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") " pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:54:54.706687 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.706561    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:54:54.846537 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:54.846506    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"]
Jul 05 13:54:55.433101 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:55.433062    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl" event={"ID":"dd0f4165-5e2a-4b57-9780-b913520841d1","Type":"ContainerStarted","Data":"fb30379d8805033a366789f1d83a2f736ecc98e662d6b3d1918a921a8c2651d1"}
Jul 05 13:54:55.433101 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:55.433109    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl" event={"ID":"dd0f4165-5e2a-4b57-9780-b913520841d1","Type":"ContainerStarted","Data":"cc774c30a2867b6c947e14e3a8b038928d2289bd0a71201449df7eaaa3c5c9ba"}
Jul 05 13:54:55.450649 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:55.450577    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl" podStartSLOduration=1.450558886 podStartE2EDuration="1.450558886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:54:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:54:55.448375256 +0000 UTC m=+2198.266343213" watchObservedRunningTime="2026-07-05 13:54:55.450558886 +0000 UTC m=+2198.268526855"
Jul 05 13:54:59.699816 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:54:59.699780    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:55:04.707134 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:04.707103    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:55:04.707546 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:04.707248    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:55:04.719857 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:04.719831    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:55:05.497870 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:05.497833    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:55:35.303109 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.303070    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"]
Jul 05 13:55:35.306392 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.306371    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:35.310004 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.309972    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7acb12\"/\"openshift-service-ca.crt\""
Jul 05 13:55:35.310176 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.310082    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7acb12\"/\"auth-test-model-7acb12-kserve-self-signed-certs\""
Jul 05 13:55:35.310176 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.310155    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7acb12\"/\"kube-root-ca.crt\""
Jul 05 13:55:35.310176 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.310166    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7acb12\"/\"default-dockercfg-psrl8\""
Jul 05 13:55:35.315941 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.315913    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"]
Jul 05 13:55:35.441763 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.441727    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-home\") pod \"auth-test-model-7acb12-kserve-6fbd444955-84rz8\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") " pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:35.441763 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.441766    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-tmp-dir\") pod \"auth-test-model-7acb12-kserve-6fbd444955-84rz8\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") " pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:35.441997 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.441787    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9hx9\" (UniqueName: \"kubernetes.io/projected/137cf439-6136-4b42-8aed-c925eb7f1566-kube-api-access-f9hx9\") pod \"auth-test-model-7acb12-kserve-6fbd444955-84rz8\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") " pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:35.441997 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.441866    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-dshm\") pod \"auth-test-model-7acb12-kserve-6fbd444955-84rz8\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") " pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:35.441997 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.441900    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/137cf439-6136-4b42-8aed-c925eb7f1566-tls-certs\") pod \"auth-test-model-7acb12-kserve-6fbd444955-84rz8\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") " pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:35.441997 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.441939    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-model-cache\") pod \"auth-test-model-7acb12-kserve-6fbd444955-84rz8\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") " pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:35.543058 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.543018    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-dshm\") pod \"auth-test-model-7acb12-kserve-6fbd444955-84rz8\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") " pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:35.543245 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.543068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/137cf439-6136-4b42-8aed-c925eb7f1566-tls-certs\") pod \"auth-test-model-7acb12-kserve-6fbd444955-84rz8\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") " pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:35.543245 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.543101    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-model-cache\") pod \"auth-test-model-7acb12-kserve-6fbd444955-84rz8\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") " pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:35.543245 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.543139    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-home\") pod \"auth-test-model-7acb12-kserve-6fbd444955-84rz8\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") " pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:35.543245 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.543156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-tmp-dir\") pod \"auth-test-model-7acb12-kserve-6fbd444955-84rz8\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") " pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:35.543245 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.543180    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9hx9\" (UniqueName: \"kubernetes.io/projected/137cf439-6136-4b42-8aed-c925eb7f1566-kube-api-access-f9hx9\") pod \"auth-test-model-7acb12-kserve-6fbd444955-84rz8\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") " pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:35.543670 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.543613    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-home\") pod \"auth-test-model-7acb12-kserve-6fbd444955-84rz8\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") " pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:35.543770 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.543742    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-model-cache\") pod \"auth-test-model-7acb12-kserve-6fbd444955-84rz8\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") " pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:35.543857 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.543798    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-tmp-dir\") pod \"auth-test-model-7acb12-kserve-6fbd444955-84rz8\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") " pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:35.545530 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.545507    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-dshm\") pod \"auth-test-model-7acb12-kserve-6fbd444955-84rz8\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") " pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:35.545871 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.545852    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/137cf439-6136-4b42-8aed-c925eb7f1566-tls-certs\") pod \"auth-test-model-7acb12-kserve-6fbd444955-84rz8\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") " pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:35.551133 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.551108    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9hx9\" (UniqueName: \"kubernetes.io/projected/137cf439-6136-4b42-8aed-c925eb7f1566-kube-api-access-f9hx9\") pod \"auth-test-model-7acb12-kserve-6fbd444955-84rz8\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") " pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:35.616753 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.616716    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:35.764671 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:35.764641    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"]
Jul 05 13:55:35.766791 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:55:35.766755    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod137cf439_6136_4b42_8aed_c925eb7f1566.slice/crio-38ae44b871835e631177ffe757dc7e823ee3ba485db1e2779026ede1453d2f8e WatchSource:0}: Error finding container 38ae44b871835e631177ffe757dc7e823ee3ba485db1e2779026ede1453d2f8e: Status 404 returned error can't find the container with id 38ae44b871835e631177ffe757dc7e823ee3ba485db1e2779026ede1453d2f8e
Jul 05 13:55:36.643991 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:36.643954    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8" event={"ID":"137cf439-6136-4b42-8aed-c925eb7f1566","Type":"ContainerStarted","Data":"cad3d1f3afa628f894791dd58e1d031c4482d0a6d55fd3a792785a5e6e0770ab"}
Jul 05 13:55:36.644504 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:36.644001    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8" event={"ID":"137cf439-6136-4b42-8aed-c925eb7f1566","Type":"ContainerStarted","Data":"38ae44b871835e631177ffe757dc7e823ee3ba485db1e2779026ede1453d2f8e"}
Jul 05 13:55:38.899355 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:38.899291    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8" podStartSLOduration=3.8992707810000002 podStartE2EDuration="3.899270781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:55:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:55:36.661511964 +0000 UTC m=+2239.479479922" watchObservedRunningTime="2026-07-05 13:55:38.899270781 +0000 UTC m=+2241.717238750"
Jul 05 13:55:38.900135 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:38.900117    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:55:45.617223 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:45.617156    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:45.617223 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:45.617230    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:45.629998 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:45.629968    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:45.707167 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:45.707134    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:55:52.003463 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:55:52.003414    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:56:08.901969 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:56:08.901928    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:56:22.303819 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:56:22.303781    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:56:39.590915 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:56:39.590874    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:56:56.706239 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:56:56.706199    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:57:14.617388 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:14.617298    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:57:27.411193 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:27.411146    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"]
Jul 05 13:57:28.288623 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:28.288585    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"]
Jul 05 13:57:30.700198 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:30.700154    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:57:39.498921 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.498879    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"]
Jul 05 13:57:39.502241 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.502217    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:39.504713 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.504694    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c2f889\"/\"sub-test-model-c2f889-kserve-self-signed-certs\""
Jul 05 13:57:39.512866 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.512839    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"]
Jul 05 13:57:39.538218 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.538178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-model-cache\") pod \"sub-test-model-c2f889-kserve-985b8b4f9-q2784\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") " pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:39.538415 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.538238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xctgb\" (UniqueName: \"kubernetes.io/projected/1ac12674-9b50-49de-8631-c2daddab7026-kube-api-access-xctgb\") pod \"sub-test-model-c2f889-kserve-985b8b4f9-q2784\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") " pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:39.538415 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.538312    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-tmp-dir\") pod \"sub-test-model-c2f889-kserve-985b8b4f9-q2784\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") " pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:39.538415 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.538373    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac12674-9b50-49de-8631-c2daddab7026-tls-certs\") pod \"sub-test-model-c2f889-kserve-985b8b4f9-q2784\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") " pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:39.538415 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.538404    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-home\") pod \"sub-test-model-c2f889-kserve-985b8b4f9-q2784\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") " pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:39.538575 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.538503    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-dshm\") pod \"sub-test-model-c2f889-kserve-985b8b4f9-q2784\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") " pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:39.639806 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.639768    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-dshm\") pod \"sub-test-model-c2f889-kserve-985b8b4f9-q2784\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") " pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:39.639986 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.639820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-model-cache\") pod \"sub-test-model-c2f889-kserve-985b8b4f9-q2784\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") " pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:39.639986 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.639931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xctgb\" (UniqueName: \"kubernetes.io/projected/1ac12674-9b50-49de-8631-c2daddab7026-kube-api-access-xctgb\") pod \"sub-test-model-c2f889-kserve-985b8b4f9-q2784\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") " pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:39.639986 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.639978    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-tmp-dir\") pod \"sub-test-model-c2f889-kserve-985b8b4f9-q2784\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") " pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:39.640118 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.640010    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac12674-9b50-49de-8631-c2daddab7026-tls-certs\") pod \"sub-test-model-c2f889-kserve-985b8b4f9-q2784\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") " pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:39.640185 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.640158    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-home\") pod \"sub-test-model-c2f889-kserve-985b8b4f9-q2784\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") " pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:39.640270 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.640249    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-model-cache\") pod \"sub-test-model-c2f889-kserve-985b8b4f9-q2784\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") " pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:39.640338 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.640320    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-tmp-dir\") pod \"sub-test-model-c2f889-kserve-985b8b4f9-q2784\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") " pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:39.640523 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.640501    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-home\") pod \"sub-test-model-c2f889-kserve-985b8b4f9-q2784\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") " pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:39.642246 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.642225    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-dshm\") pod \"sub-test-model-c2f889-kserve-985b8b4f9-q2784\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") " pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:39.642534 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.642518    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac12674-9b50-49de-8631-c2daddab7026-tls-certs\") pod \"sub-test-model-c2f889-kserve-985b8b4f9-q2784\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") " pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:39.651118 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.651085    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xctgb\" (UniqueName: \"kubernetes.io/projected/1ac12674-9b50-49de-8631-c2daddab7026-kube-api-access-xctgb\") pod \"sub-test-model-c2f889-kserve-985b8b4f9-q2784\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") " pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:39.811831 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.811719    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:39.955013 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:39.954974    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"]
Jul 05 13:57:39.958085 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:57:39.958056    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ac12674_9b50_49de_8631_c2daddab7026.slice/crio-6a49fd63e59535a9a198771baa6ccbc0b787cba6a4a73945a485744a1eb8a3eb WatchSource:0}: Error finding container 6a49fd63e59535a9a198771baa6ccbc0b787cba6a4a73945a485744a1eb8a3eb: Status 404 returned error can't find the container with id 6a49fd63e59535a9a198771baa6ccbc0b787cba6a4a73945a485744a1eb8a3eb
Jul 05 13:57:40.271988 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:40.271952    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784" event={"ID":"1ac12674-9b50-49de-8631-c2daddab7026","Type":"ContainerStarted","Data":"aba446fbe95c34de00904a87f42ba29d6ea8ee55c20a156b62720a02202085d6"}
Jul 05 13:57:40.272181 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:40.271996    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784" event={"ID":"1ac12674-9b50-49de-8631-c2daddab7026","Type":"ContainerStarted","Data":"6a49fd63e59535a9a198771baa6ccbc0b787cba6a4a73945a485744a1eb8a3eb"}
Jul 05 13:57:40.290513 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:40.290454    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784" podStartSLOduration=1.290435681 podStartE2EDuration="1.290435681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:57:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:57:40.288615741 +0000 UTC m=+2363.106583719" watchObservedRunningTime="2026-07-05 13:57:40.290435681 +0000 UTC m=+2363.108403637"
Jul 05 13:57:42.432283 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:42.432201    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl" podUID="dd0f4165-5e2a-4b57-9780-b913520841d1" containerName="main" containerID="cri-o://fb30379d8805033a366789f1d83a2f736ecc98e662d6b3d1918a921a8c2651d1" gracePeriod=45
Jul 05 13:57:42.693273 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:42.693195    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:57:42.771132 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:42.771088    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-dshm\") pod \"dd0f4165-5e2a-4b57-9780-b913520841d1\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") "
Jul 05 13:57:42.771132 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:42.771134    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4knt\" (UniqueName: \"kubernetes.io/projected/dd0f4165-5e2a-4b57-9780-b913520841d1-kube-api-access-s4knt\") pod \"dd0f4165-5e2a-4b57-9780-b913520841d1\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") "
Jul 05 13:57:42.771404 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:42.771162    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-tmp-dir\") pod \"dd0f4165-5e2a-4b57-9780-b913520841d1\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") "
Jul 05 13:57:42.771404 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:42.771183    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd0f4165-5e2a-4b57-9780-b913520841d1-tls-certs\") pod \"dd0f4165-5e2a-4b57-9780-b913520841d1\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") "
Jul 05 13:57:42.771404 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:42.771204    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-home\") pod \"dd0f4165-5e2a-4b57-9780-b913520841d1\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") "
Jul 05 13:57:42.771404 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:42.771263    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-model-cache\") pod \"dd0f4165-5e2a-4b57-9780-b913520841d1\" (UID: \"dd0f4165-5e2a-4b57-9780-b913520841d1\") "
Jul 05 13:57:42.771608 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:42.771451    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dd0f4165-5e2a-4b57-9780-b913520841d1" (UID: "dd0f4165-5e2a-4b57-9780-b913520841d1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:57:42.771608 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:42.771585    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-model-cache" (OuterVolumeSpecName: "model-cache") pod "dd0f4165-5e2a-4b57-9780-b913520841d1" (UID: "dd0f4165-5e2a-4b57-9780-b913520841d1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:57:42.771763 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:42.771607    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-home" (OuterVolumeSpecName: "home") pod "dd0f4165-5e2a-4b57-9780-b913520841d1" (UID: "dd0f4165-5e2a-4b57-9780-b913520841d1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:57:42.773517 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:42.773492    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-dshm" (OuterVolumeSpecName: "dshm") pod "dd0f4165-5e2a-4b57-9780-b913520841d1" (UID: "dd0f4165-5e2a-4b57-9780-b913520841d1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:57:42.773653 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:42.773498    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd0f4165-5e2a-4b57-9780-b913520841d1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dd0f4165-5e2a-4b57-9780-b913520841d1" (UID: "dd0f4165-5e2a-4b57-9780-b913520841d1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:57:42.773653 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:42.773523    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd0f4165-5e2a-4b57-9780-b913520841d1-kube-api-access-s4knt" (OuterVolumeSpecName: "kube-api-access-s4knt") pod "dd0f4165-5e2a-4b57-9780-b913520841d1" (UID: "dd0f4165-5e2a-4b57-9780-b913520841d1"). InnerVolumeSpecName "kube-api-access-s4knt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:57:42.872817 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:42.872771    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd0f4165-5e2a-4b57-9780-b913520841d1-tls-certs\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:57:42.872817 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:42.872804    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-home\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:57:42.872817 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:42.872816    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-model-cache\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:57:42.872817 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:42.872824    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-dshm\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:57:42.872817 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:42.872832    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4knt\" (UniqueName: \"kubernetes.io/projected/dd0f4165-5e2a-4b57-9780-b913520841d1-kube-api-access-s4knt\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:57:42.873200 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:42.872860    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd0f4165-5e2a-4b57-9780-b913520841d1-tmp-dir\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:57:43.288017 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.287983    2565 generic.go:356] "Generic (PLEG): container finished" podID="dd0f4165-5e2a-4b57-9780-b913520841d1" containerID="fb30379d8805033a366789f1d83a2f736ecc98e662d6b3d1918a921a8c2651d1" exitCode=0
Jul 05 13:57:43.288199 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.288035    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"
Jul 05 13:57:43.288199 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.288041    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl" event={"ID":"dd0f4165-5e2a-4b57-9780-b913520841d1","Type":"ContainerDied","Data":"fb30379d8805033a366789f1d83a2f736ecc98e662d6b3d1918a921a8c2651d1"}
Jul 05 13:57:43.288199 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.288073    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl" event={"ID":"dd0f4165-5e2a-4b57-9780-b913520841d1","Type":"ContainerDied","Data":"cc774c30a2867b6c947e14e3a8b038928d2289bd0a71201449df7eaaa3c5c9ba"}
Jul 05 13:57:43.288199 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.288093    2565 scope.go:117] "RemoveContainer" containerID="fb30379d8805033a366789f1d83a2f736ecc98e662d6b3d1918a921a8c2651d1"
Jul 05 13:57:43.297389 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.297371    2565 scope.go:117] "RemoveContainer" containerID="fb30379d8805033a366789f1d83a2f736ecc98e662d6b3d1918a921a8c2651d1"
Jul 05 13:57:43.297704 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:57:43.297677    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb30379d8805033a366789f1d83a2f736ecc98e662d6b3d1918a921a8c2651d1\": container with ID starting with fb30379d8805033a366789f1d83a2f736ecc98e662d6b3d1918a921a8c2651d1 not found: ID does not exist" containerID="fb30379d8805033a366789f1d83a2f736ecc98e662d6b3d1918a921a8c2651d1"
Jul 05 13:57:43.297800 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.297712    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb30379d8805033a366789f1d83a2f736ecc98e662d6b3d1918a921a8c2651d1"} err="failed to get container status \"fb30379d8805033a366789f1d83a2f736ecc98e662d6b3d1918a921a8c2651d1\": rpc error: code = NotFound desc = could not find container \"fb30379d8805033a366789f1d83a2f736ecc98e662d6b3d1918a921a8c2651d1\": container with ID starting with fb30379d8805033a366789f1d83a2f736ecc98e662d6b3d1918a921a8c2651d1 not found: ID does not exist"
Jul 05 13:57:43.309063 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.309032    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"]
Jul 05 13:57:43.311868 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.311814    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8" podUID="137cf439-6136-4b42-8aed-c925eb7f1566" containerName="main" containerID="cri-o://cad3d1f3afa628f894791dd58e1d031c4482d0a6d55fd3a792785a5e6e0770ab" gracePeriod=45
Jul 05 13:57:43.313923 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.313898    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c2f889/auth-test-model-c2f889-kserve-55ffd9bd9f-75wwl"]
Jul 05 13:57:43.563699 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.563674    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:57:43.679325 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.679282    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-dshm\") pod \"137cf439-6136-4b42-8aed-c925eb7f1566\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") "
Jul 05 13:57:43.679527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.679349    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/137cf439-6136-4b42-8aed-c925eb7f1566-tls-certs\") pod \"137cf439-6136-4b42-8aed-c925eb7f1566\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") "
Jul 05 13:57:43.679527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.679380    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-home\") pod \"137cf439-6136-4b42-8aed-c925eb7f1566\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") "
Jul 05 13:57:43.679527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.679408    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-model-cache\") pod \"137cf439-6136-4b42-8aed-c925eb7f1566\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") "
Jul 05 13:57:43.679527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.679451    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9hx9\" (UniqueName: \"kubernetes.io/projected/137cf439-6136-4b42-8aed-c925eb7f1566-kube-api-access-f9hx9\") pod \"137cf439-6136-4b42-8aed-c925eb7f1566\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") "
Jul 05 13:57:43.679527 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.679504    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-tmp-dir\") pod \"137cf439-6136-4b42-8aed-c925eb7f1566\" (UID: \"137cf439-6136-4b42-8aed-c925eb7f1566\") "
Jul 05 13:57:43.679830 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.679731    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-home" (OuterVolumeSpecName: "home") pod "137cf439-6136-4b42-8aed-c925eb7f1566" (UID: "137cf439-6136-4b42-8aed-c925eb7f1566"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:57:43.679830 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.679744    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-model-cache" (OuterVolumeSpecName: "model-cache") pod "137cf439-6136-4b42-8aed-c925eb7f1566" (UID: "137cf439-6136-4b42-8aed-c925eb7f1566"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:57:43.679906 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.679857    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "137cf439-6136-4b42-8aed-c925eb7f1566" (UID: "137cf439-6136-4b42-8aed-c925eb7f1566"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:57:43.681795 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.681768    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-dshm" (OuterVolumeSpecName: "dshm") pod "137cf439-6136-4b42-8aed-c925eb7f1566" (UID: "137cf439-6136-4b42-8aed-c925eb7f1566"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:57:43.681888 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.681812    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/137cf439-6136-4b42-8aed-c925eb7f1566-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "137cf439-6136-4b42-8aed-c925eb7f1566" (UID: "137cf439-6136-4b42-8aed-c925eb7f1566"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:57:43.681888 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.681845    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/137cf439-6136-4b42-8aed-c925eb7f1566-kube-api-access-f9hx9" (OuterVolumeSpecName: "kube-api-access-f9hx9") pod "137cf439-6136-4b42-8aed-c925eb7f1566" (UID: "137cf439-6136-4b42-8aed-c925eb7f1566"). InnerVolumeSpecName "kube-api-access-f9hx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:57:43.740735 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.740701    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd0f4165-5e2a-4b57-9780-b913520841d1" path="/var/lib/kubelet/pods/dd0f4165-5e2a-4b57-9780-b913520841d1/volumes"
Jul 05 13:57:43.780447 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.780404    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9hx9\" (UniqueName: \"kubernetes.io/projected/137cf439-6136-4b42-8aed-c925eb7f1566-kube-api-access-f9hx9\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:57:43.780447 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.780441    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-tmp-dir\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:57:43.780447 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.780451    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-dshm\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:57:43.780729 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.780460    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/137cf439-6136-4b42-8aed-c925eb7f1566-tls-certs\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:57:43.780729 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.780469    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-home\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:57:43.780729 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:43.780477    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/137cf439-6136-4b42-8aed-c925eb7f1566-model-cache\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:57:44.297445 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:44.297412    2565 generic.go:356] "Generic (PLEG): container finished" podID="137cf439-6136-4b42-8aed-c925eb7f1566" containerID="cad3d1f3afa628f894791dd58e1d031c4482d0a6d55fd3a792785a5e6e0770ab" exitCode=0
Jul 05 13:57:44.297685 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:44.297474    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"
Jul 05 13:57:44.297685 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:44.297497    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8" event={"ID":"137cf439-6136-4b42-8aed-c925eb7f1566","Type":"ContainerDied","Data":"cad3d1f3afa628f894791dd58e1d031c4482d0a6d55fd3a792785a5e6e0770ab"}
Jul 05 13:57:44.297685 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:44.297544    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8" event={"ID":"137cf439-6136-4b42-8aed-c925eb7f1566","Type":"ContainerDied","Data":"38ae44b871835e631177ffe757dc7e823ee3ba485db1e2779026ede1453d2f8e"}
Jul 05 13:57:44.297685 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:44.297567    2565 scope.go:117] "RemoveContainer" containerID="cad3d1f3afa628f894791dd58e1d031c4482d0a6d55fd3a792785a5e6e0770ab"
Jul 05 13:57:44.298172 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:44.298144    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:57:44.307255 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:44.307231    2565 scope.go:117] "RemoveContainer" containerID="cad3d1f3afa628f894791dd58e1d031c4482d0a6d55fd3a792785a5e6e0770ab"
Jul 05 13:57:44.307599 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:57:44.307576    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cad3d1f3afa628f894791dd58e1d031c4482d0a6d55fd3a792785a5e6e0770ab\": container with ID starting with cad3d1f3afa628f894791dd58e1d031c4482d0a6d55fd3a792785a5e6e0770ab not found: ID does not exist" containerID="cad3d1f3afa628f894791dd58e1d031c4482d0a6d55fd3a792785a5e6e0770ab"
Jul 05 13:57:44.307698 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:44.307610    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cad3d1f3afa628f894791dd58e1d031c4482d0a6d55fd3a792785a5e6e0770ab"} err="failed to get container status \"cad3d1f3afa628f894791dd58e1d031c4482d0a6d55fd3a792785a5e6e0770ab\": rpc error: code = NotFound desc = could not find container \"cad3d1f3afa628f894791dd58e1d031c4482d0a6d55fd3a792785a5e6e0770ab\": container with ID starting with cad3d1f3afa628f894791dd58e1d031c4482d0a6d55fd3a792785a5e6e0770ab not found: ID does not exist"
Jul 05 13:57:44.315695 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:44.315656    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"]
Jul 05 13:57:44.321585 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:44.321547    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-7acb12/auth-test-model-7acb12-kserve-6fbd444955-84rz8"]
Jul 05 13:57:45.740732 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:45.740691    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="137cf439-6136-4b42-8aed-c925eb7f1566" path="/var/lib/kubelet/pods/137cf439-6136-4b42-8aed-c925eb7f1566/volumes"
Jul 05 13:57:49.811986 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:49.811940    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:49.812501 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:49.812006    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:49.824557 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:49.824520    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:57:50.340236 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:57:50.340205    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:58:17.794615 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:17.794588    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/1.log"
Jul 05 13:58:17.798915 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:17.798890    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xj7gc_6c7ce124-8975-400e-9f0b-2527ee19af46/ovn-acl-logging/0.log"
Jul 05 13:58:17.799879 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:17.799854    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/1.log"
Jul 05 13:58:17.803800 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:17.803780    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xj7gc_6c7ce124-8975-400e-9f0b-2527ee19af46/ovn-acl-logging/0.log"
Jul 05 13:58:35.314552 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.314514    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"]
Jul 05 13:58:35.315068 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.314860    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd0f4165-5e2a-4b57-9780-b913520841d1" containerName="main"
Jul 05 13:58:35.315068 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.314873    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd0f4165-5e2a-4b57-9780-b913520841d1" containerName="main"
Jul 05 13:58:35.315068 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.314892    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="137cf439-6136-4b42-8aed-c925eb7f1566" containerName="main"
Jul 05 13:58:35.315068 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.314898    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="137cf439-6136-4b42-8aed-c925eb7f1566" containerName="main"
Jul 05 13:58:35.315068 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.314957    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="137cf439-6136-4b42-8aed-c925eb7f1566" containerName="main"
Jul 05 13:58:35.315068 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.314966    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd0f4165-5e2a-4b57-9780-b913520841d1" containerName="main"
Jul 05 13:58:35.318136 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.318115    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:35.322167 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.322138    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7acb12\"/\"openshift-service-ca.crt\""
Jul 05 13:58:35.322325 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.322138    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7acb12\"/\"kube-root-ca.crt\""
Jul 05 13:58:35.322325 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.322205    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7acb12\"/\"default-dockercfg-psrl8\""
Jul 05 13:58:35.322325 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.322229    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7acb12\"/\"sub-test-model-7acb12-kserve-self-signed-certs\""
Jul 05 13:58:35.328920 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.328892    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"]
Jul 05 13:58:35.439699 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.439657    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrvkb\" (UniqueName: \"kubernetes.io/projected/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-kube-api-access-wrvkb\") pod \"sub-test-model-7acb12-kserve-7554d56b99-s89lx\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") " pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:35.439699 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.439702    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-model-cache\") pod \"sub-test-model-7acb12-kserve-7554d56b99-s89lx\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") " pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:35.439921 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.439781    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-home\") pod \"sub-test-model-7acb12-kserve-7554d56b99-s89lx\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") " pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:35.439921 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.439829    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-tmp-dir\") pod \"sub-test-model-7acb12-kserve-7554d56b99-s89lx\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") " pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:35.439921 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.439898    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-dshm\") pod \"sub-test-model-7acb12-kserve-7554d56b99-s89lx\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") " pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:35.440024 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.439938    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-tls-certs\") pod \"sub-test-model-7acb12-kserve-7554d56b99-s89lx\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") " pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:35.540858 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.540817    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-home\") pod \"sub-test-model-7acb12-kserve-7554d56b99-s89lx\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") " pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:35.541019 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.540878    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-tmp-dir\") pod \"sub-test-model-7acb12-kserve-7554d56b99-s89lx\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") " pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:35.541019 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.540918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-dshm\") pod \"sub-test-model-7acb12-kserve-7554d56b99-s89lx\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") " pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:35.541019 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.540938    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-tls-certs\") pod \"sub-test-model-7acb12-kserve-7554d56b99-s89lx\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") " pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:35.541019 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.540980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrvkb\" (UniqueName: \"kubernetes.io/projected/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-kube-api-access-wrvkb\") pod \"sub-test-model-7acb12-kserve-7554d56b99-s89lx\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") " pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:35.541019 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.541011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-model-cache\") pod \"sub-test-model-7acb12-kserve-7554d56b99-s89lx\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") " pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:35.541299 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.541264    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-home\") pod \"sub-test-model-7acb12-kserve-7554d56b99-s89lx\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") " pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:35.541371 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.541322    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-tmp-dir\") pod \"sub-test-model-7acb12-kserve-7554d56b99-s89lx\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") " pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:35.541442 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.541429    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-model-cache\") pod \"sub-test-model-7acb12-kserve-7554d56b99-s89lx\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") " pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:35.543267 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.543243    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-dshm\") pod \"sub-test-model-7acb12-kserve-7554d56b99-s89lx\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") " pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:35.543750 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.543730    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-tls-certs\") pod \"sub-test-model-7acb12-kserve-7554d56b99-s89lx\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") " pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:35.550036 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.550008    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrvkb\" (UniqueName: \"kubernetes.io/projected/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-kube-api-access-wrvkb\") pod \"sub-test-model-7acb12-kserve-7554d56b99-s89lx\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") " pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:35.628271 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.628232    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:35.767038 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:35.767010    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"]
Jul 05 13:58:35.768949 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:58:35.768918    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a8ff27c_ff45_41f6_9eae_bc6877429c0a.slice/crio-5aa9cfe5f4c1c5c82c6dbb00c6049b10635d00c18cbf4871c344a1b8c854261b WatchSource:0}: Error finding container 5aa9cfe5f4c1c5c82c6dbb00c6049b10635d00c18cbf4871c344a1b8c854261b: Status 404 returned error can't find the container with id 5aa9cfe5f4c1c5c82c6dbb00c6049b10635d00c18cbf4871c344a1b8c854261b
Jul 05 13:58:36.567152 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:36.567116    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx" event={"ID":"3a8ff27c-ff45-41f6-9eae-bc6877429c0a","Type":"ContainerStarted","Data":"dbcb10042b78501a655f7e50b58e8546d0b99e61b5aaf5f621a1e973c110941d"}
Jul 05 13:58:36.567152 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:36.567158    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx" event={"ID":"3a8ff27c-ff45-41f6-9eae-bc6877429c0a","Type":"ContainerStarted","Data":"5aa9cfe5f4c1c5c82c6dbb00c6049b10635d00c18cbf4871c344a1b8c854261b"}
Jul 05 13:58:36.590682 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:36.590611    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx" podStartSLOduration=1.590594061 podStartE2EDuration="1.590594061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:58:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:58:36.588713192 +0000 UTC m=+2419.406681150" watchObservedRunningTime="2026-07-05 13:58:36.590594061 +0000 UTC m=+2419.408562137"
Jul 05 13:58:39.804220 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:39.804132    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:58:45.629231 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:45.629176    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:45.629672 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:45.629259    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:45.642063 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:45.642035    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:46.627692 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:46.627603    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:58:57.800585 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:58:57.800535    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:59:15.396655 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:15.396605    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:59:20.784384 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:20.784344    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"]
Jul 05 13:59:21.746071 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:21.746031    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"]
Jul 05 13:59:30.905231 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:30.905193    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"]
Jul 05 13:59:30.908526 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:30.908509    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:30.911396 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:30.911365    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c2f889\"/\"rate-test-model-c2f889-kserve-self-signed-certs\""
Jul 05 13:59:30.923072 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:30.923045    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"]
Jul 05 13:59:31.033322 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.033278    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-dshm\") pod \"rate-test-model-c2f889-kserve-7f8dd9f755-mmsth\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") " pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:31.033507 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.033338    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbdvm\" (UniqueName: \"kubernetes.io/projected/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-kube-api-access-vbdvm\") pod \"rate-test-model-c2f889-kserve-7f8dd9f755-mmsth\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") " pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:31.033507 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.033410    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-home\") pod \"rate-test-model-c2f889-kserve-7f8dd9f755-mmsth\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") " pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:31.033507 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.033482    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-tls-certs\") pod \"rate-test-model-c2f889-kserve-7f8dd9f755-mmsth\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") " pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:31.033688 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.033527    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-tmp-dir\") pod \"rate-test-model-c2f889-kserve-7f8dd9f755-mmsth\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") " pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:31.033688 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.033586    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-model-cache\") pod \"rate-test-model-c2f889-kserve-7f8dd9f755-mmsth\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") " pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:31.134217 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.134180    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-model-cache\") pod \"rate-test-model-c2f889-kserve-7f8dd9f755-mmsth\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") " pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:31.134217 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.134222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-dshm\") pod \"rate-test-model-c2f889-kserve-7f8dd9f755-mmsth\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") " pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:31.134470 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.134247    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbdvm\" (UniqueName: \"kubernetes.io/projected/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-kube-api-access-vbdvm\") pod \"rate-test-model-c2f889-kserve-7f8dd9f755-mmsth\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") " pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:31.134470 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.134268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-home\") pod \"rate-test-model-c2f889-kserve-7f8dd9f755-mmsth\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") " pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:31.134470 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.134301    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-tls-certs\") pod \"rate-test-model-c2f889-kserve-7f8dd9f755-mmsth\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") " pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:31.134470 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.134329    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-tmp-dir\") pod \"rate-test-model-c2f889-kserve-7f8dd9f755-mmsth\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") " pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:31.134722 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.134683    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-model-cache\") pod \"rate-test-model-c2f889-kserve-7f8dd9f755-mmsth\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") " pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:31.134766 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.134741    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-home\") pod \"rate-test-model-c2f889-kserve-7f8dd9f755-mmsth\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") " pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:31.134868 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.134849    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-tmp-dir\") pod \"rate-test-model-c2f889-kserve-7f8dd9f755-mmsth\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") " pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:31.136539 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.136515    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-dshm\") pod \"rate-test-model-c2f889-kserve-7f8dd9f755-mmsth\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") " pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:31.136969 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.136945    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-tls-certs\") pod \"rate-test-model-c2f889-kserve-7f8dd9f755-mmsth\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") " pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:31.143122 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.143101    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbdvm\" (UniqueName: \"kubernetes.io/projected/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-kube-api-access-vbdvm\") pod \"rate-test-model-c2f889-kserve-7f8dd9f755-mmsth\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") " pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:31.217365 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.217257    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:31.355873 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.355841    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"]
Jul 05 13:59:31.357486 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:59:31.357456    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbbb6ccc_5d7a_4477_a956_5c21ccecb70d.slice/crio-daeaa761a95223a9ea152438ebfb640268135fc361b4ae49470a6db76975931d WatchSource:0}: Error finding container daeaa761a95223a9ea152438ebfb640268135fc361b4ae49470a6db76975931d: Status 404 returned error can't find the container with id daeaa761a95223a9ea152438ebfb640268135fc361b4ae49470a6db76975931d
Jul 05 13:59:31.851281 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.851244    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth" event={"ID":"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d","Type":"ContainerStarted","Data":"c3065a9d9fa583ea2b941c8faa6d471d7106c3e00ade07eb31af9e2adeb963bb"}
Jul 05 13:59:31.851453 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.851294    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth" event={"ID":"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d","Type":"ContainerStarted","Data":"daeaa761a95223a9ea152438ebfb640268135fc361b4ae49470a6db76975931d"}
Jul 05 13:59:31.872057 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:31.871993    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth" podStartSLOduration=1.8719759809999998 podStartE2EDuration="1.871975981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:59:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:59:31.868808639 +0000 UTC m=+2474.686776598" watchObservedRunningTime="2026-07-05 13:59:31.871975981 +0000 UTC m=+2474.689943948"
Jul 05 13:59:34.199091 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:34.199057    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:59:35.805651 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:35.805602    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784" podUID="1ac12674-9b50-49de-8631-c2daddab7026" containerName="main" containerID="cri-o://aba446fbe95c34de00904a87f42ba29d6ea8ee55c20a156b62720a02202085d6" gracePeriod=45
Jul 05 13:59:36.064191 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.064110    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:59:36.179060 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.178999    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac12674-9b50-49de-8631-c2daddab7026-tls-certs\") pod \"1ac12674-9b50-49de-8631-c2daddab7026\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") "
Jul 05 13:59:36.179060 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.179058    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-home\") pod \"1ac12674-9b50-49de-8631-c2daddab7026\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") "
Jul 05 13:59:36.179060 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.179080    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-dshm\") pod \"1ac12674-9b50-49de-8631-c2daddab7026\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") "
Jul 05 13:59:36.179358 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.179115    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xctgb\" (UniqueName: \"kubernetes.io/projected/1ac12674-9b50-49de-8631-c2daddab7026-kube-api-access-xctgb\") pod \"1ac12674-9b50-49de-8631-c2daddab7026\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") "
Jul 05 13:59:36.179416 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.179348    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-model-cache\") pod \"1ac12674-9b50-49de-8631-c2daddab7026\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") "
Jul 05 13:59:36.179490 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.179347    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-home" (OuterVolumeSpecName: "home") pod "1ac12674-9b50-49de-8631-c2daddab7026" (UID: "1ac12674-9b50-49de-8631-c2daddab7026"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:59:36.179490 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.179410    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-tmp-dir\") pod \"1ac12674-9b50-49de-8631-c2daddab7026\" (UID: \"1ac12674-9b50-49de-8631-c2daddab7026\") "
Jul 05 13:59:36.179600 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.179529    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-model-cache" (OuterVolumeSpecName: "model-cache") pod "1ac12674-9b50-49de-8631-c2daddab7026" (UID: "1ac12674-9b50-49de-8631-c2daddab7026"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:59:36.179702 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.179621    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1ac12674-9b50-49de-8631-c2daddab7026" (UID: "1ac12674-9b50-49de-8631-c2daddab7026"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:59:36.179792 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.179775    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-home\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:59:36.179843 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.179795    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-model-cache\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:59:36.179843 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.179806    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-tmp-dir\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:59:36.181292 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.181270    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ac12674-9b50-49de-8631-c2daddab7026-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1ac12674-9b50-49de-8631-c2daddab7026" (UID: "1ac12674-9b50-49de-8631-c2daddab7026"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:59:36.181747 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.181720    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-dshm" (OuterVolumeSpecName: "dshm") pod "1ac12674-9b50-49de-8631-c2daddab7026" (UID: "1ac12674-9b50-49de-8631-c2daddab7026"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:59:36.181747 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.181723    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ac12674-9b50-49de-8631-c2daddab7026-kube-api-access-xctgb" (OuterVolumeSpecName: "kube-api-access-xctgb") pod "1ac12674-9b50-49de-8631-c2daddab7026" (UID: "1ac12674-9b50-49de-8631-c2daddab7026"). InnerVolumeSpecName "kube-api-access-xctgb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:59:36.280586 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.280536    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac12674-9b50-49de-8631-c2daddab7026-tls-certs\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:59:36.280586 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.280574    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ac12674-9b50-49de-8631-c2daddab7026-dshm\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:59:36.280586 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.280584    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xctgb\" (UniqueName: \"kubernetes.io/projected/1ac12674-9b50-49de-8631-c2daddab7026-kube-api-access-xctgb\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:59:36.766924 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.766852    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx" podUID="3a8ff27c-ff45-41f6-9eae-bc6877429c0a" containerName="main" containerID="cri-o://dbcb10042b78501a655f7e50b58e8546d0b99e61b5aaf5f621a1e973c110941d" gracePeriod=45
Jul 05 13:59:36.878739 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.878700    2565 generic.go:356] "Generic (PLEG): container finished" podID="1ac12674-9b50-49de-8631-c2daddab7026" containerID="aba446fbe95c34de00904a87f42ba29d6ea8ee55c20a156b62720a02202085d6" exitCode=0
Jul 05 13:59:36.879106 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.878743    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"
Jul 05 13:59:36.879106 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.878777    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784" event={"ID":"1ac12674-9b50-49de-8631-c2daddab7026","Type":"ContainerDied","Data":"aba446fbe95c34de00904a87f42ba29d6ea8ee55c20a156b62720a02202085d6"}
Jul 05 13:59:36.879106 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.878825    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784" event={"ID":"1ac12674-9b50-49de-8631-c2daddab7026","Type":"ContainerDied","Data":"6a49fd63e59535a9a198771baa6ccbc0b787cba6a4a73945a485744a1eb8a3eb"}
Jul 05 13:59:36.879106 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.878847    2565 scope.go:117] "RemoveContainer" containerID="aba446fbe95c34de00904a87f42ba29d6ea8ee55c20a156b62720a02202085d6"
Jul 05 13:59:36.891589 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.891561    2565 scope.go:117] "RemoveContainer" containerID="aba446fbe95c34de00904a87f42ba29d6ea8ee55c20a156b62720a02202085d6"
Jul 05 13:59:36.891956 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:59:36.891931    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aba446fbe95c34de00904a87f42ba29d6ea8ee55c20a156b62720a02202085d6\": container with ID starting with aba446fbe95c34de00904a87f42ba29d6ea8ee55c20a156b62720a02202085d6 not found: ID does not exist" containerID="aba446fbe95c34de00904a87f42ba29d6ea8ee55c20a156b62720a02202085d6"
Jul 05 13:59:36.892048 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.891966    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aba446fbe95c34de00904a87f42ba29d6ea8ee55c20a156b62720a02202085d6"} err="failed to get container status \"aba446fbe95c34de00904a87f42ba29d6ea8ee55c20a156b62720a02202085d6\": rpc error: code = NotFound desc = could not find container \"aba446fbe95c34de00904a87f42ba29d6ea8ee55c20a156b62720a02202085d6\": container with ID starting with aba446fbe95c34de00904a87f42ba29d6ea8ee55c20a156b62720a02202085d6 not found: ID does not exist"
Jul 05 13:59:36.904711 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.904604    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"]
Jul 05 13:59:36.912473 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:36.912434    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c2f889/sub-test-model-c2f889-kserve-985b8b4f9-q2784"]
Jul 05 13:59:37.030337 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.030263    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:59:37.187719 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.187678    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-tls-certs\") pod \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") "
Jul 05 13:59:37.187719 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.187726    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-model-cache\") pod \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") "
Jul 05 13:59:37.187964 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.187751    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-dshm\") pod \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") "
Jul 05 13:59:37.187964 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.187775    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-home\") pod \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") "
Jul 05 13:59:37.187964 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.187814    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-tmp-dir\") pod \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") "
Jul 05 13:59:37.187964 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.187879    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrvkb\" (UniqueName: \"kubernetes.io/projected/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-kube-api-access-wrvkb\") pod \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\" (UID: \"3a8ff27c-ff45-41f6-9eae-bc6877429c0a\") "
Jul 05 13:59:37.188155 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.188058    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-model-cache" (OuterVolumeSpecName: "model-cache") pod "3a8ff27c-ff45-41f6-9eae-bc6877429c0a" (UID: "3a8ff27c-ff45-41f6-9eae-bc6877429c0a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:59:37.188155 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.188121    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-home" (OuterVolumeSpecName: "home") pod "3a8ff27c-ff45-41f6-9eae-bc6877429c0a" (UID: "3a8ff27c-ff45-41f6-9eae-bc6877429c0a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:59:37.188268 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.188178    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3a8ff27c-ff45-41f6-9eae-bc6877429c0a" (UID: "3a8ff27c-ff45-41f6-9eae-bc6877429c0a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:59:37.190020 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.189991    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-dshm" (OuterVolumeSpecName: "dshm") pod "3a8ff27c-ff45-41f6-9eae-bc6877429c0a" (UID: "3a8ff27c-ff45-41f6-9eae-bc6877429c0a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 13:59:37.190146 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.190047    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-kube-api-access-wrvkb" (OuterVolumeSpecName: "kube-api-access-wrvkb") pod "3a8ff27c-ff45-41f6-9eae-bc6877429c0a" (UID: "3a8ff27c-ff45-41f6-9eae-bc6877429c0a"). InnerVolumeSpecName "kube-api-access-wrvkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 13:59:37.190146 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.190050    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3a8ff27c-ff45-41f6-9eae-bc6877429c0a" (UID: "3a8ff27c-ff45-41f6-9eae-bc6877429c0a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 13:59:37.289332 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.289241    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrvkb\" (UniqueName: \"kubernetes.io/projected/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-kube-api-access-wrvkb\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:59:37.289332 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.289273    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-tls-certs\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:59:37.289332 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.289284    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-model-cache\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:59:37.289332 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.289292    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-dshm\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:59:37.289332 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.289300    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-home\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:59:37.289332 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.289307    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a8ff27c-ff45-41f6-9eae-bc6877429c0a-tmp-dir\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 13:59:37.741507 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.741470    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ac12674-9b50-49de-8631-c2daddab7026" path="/var/lib/kubelet/pods/1ac12674-9b50-49de-8631-c2daddab7026/volumes"
Jul 05 13:59:37.885557 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.885526    2565 generic.go:356] "Generic (PLEG): container finished" podID="3a8ff27c-ff45-41f6-9eae-bc6877429c0a" containerID="dbcb10042b78501a655f7e50b58e8546d0b99e61b5aaf5f621a1e973c110941d" exitCode=0
Jul 05 13:59:37.886018 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.885568    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"
Jul 05 13:59:37.886018 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.885618    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx" event={"ID":"3a8ff27c-ff45-41f6-9eae-bc6877429c0a","Type":"ContainerDied","Data":"dbcb10042b78501a655f7e50b58e8546d0b99e61b5aaf5f621a1e973c110941d"}
Jul 05 13:59:37.886018 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.885689    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx" event={"ID":"3a8ff27c-ff45-41f6-9eae-bc6877429c0a","Type":"ContainerDied","Data":"5aa9cfe5f4c1c5c82c6dbb00c6049b10635d00c18cbf4871c344a1b8c854261b"}
Jul 05 13:59:37.886018 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.885712    2565 scope.go:117] "RemoveContainer" containerID="dbcb10042b78501a655f7e50b58e8546d0b99e61b5aaf5f621a1e973c110941d"
Jul 05 13:59:37.895121 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.895097    2565 scope.go:117] "RemoveContainer" containerID="dbcb10042b78501a655f7e50b58e8546d0b99e61b5aaf5f621a1e973c110941d"
Jul 05 13:59:37.895447 ip-10-0-129-22 kubenswrapper[2565]: E0705 13:59:37.895423    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbcb10042b78501a655f7e50b58e8546d0b99e61b5aaf5f621a1e973c110941d\": container with ID starting with dbcb10042b78501a655f7e50b58e8546d0b99e61b5aaf5f621a1e973c110941d not found: ID does not exist" containerID="dbcb10042b78501a655f7e50b58e8546d0b99e61b5aaf5f621a1e973c110941d"
Jul 05 13:59:37.895519 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.895456    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbcb10042b78501a655f7e50b58e8546d0b99e61b5aaf5f621a1e973c110941d"} err="failed to get container status \"dbcb10042b78501a655f7e50b58e8546d0b99e61b5aaf5f621a1e973c110941d\": rpc error: code = NotFound desc = could not find container \"dbcb10042b78501a655f7e50b58e8546d0b99e61b5aaf5f621a1e973c110941d\": container with ID starting with dbcb10042b78501a655f7e50b58e8546d0b99e61b5aaf5f621a1e973c110941d not found: ID does not exist"
Jul 05 13:59:37.904909 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.904875    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"]
Jul 05 13:59:37.909501 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:37.909467    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-7acb12/sub-test-model-7acb12-kserve-7554d56b99-s89lx"]
Jul 05 13:59:39.741422 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:39.741384    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a8ff27c-ff45-41f6-9eae-bc6877429c0a" path="/var/lib/kubelet/pods/3a8ff27c-ff45-41f6-9eae-bc6877429c0a/volumes"
Jul 05 13:59:41.217982 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:41.217937    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:41.218461 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:41.217999    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:41.230757 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:41.230723    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:41.921383 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:41.921354    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 13:59:46.912562 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:46.912510    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"]
Jul 05 13:59:46.913004 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:46.912984    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ac12674-9b50-49de-8631-c2daddab7026" containerName="main"
Jul 05 13:59:46.913058 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:46.913009    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ac12674-9b50-49de-8631-c2daddab7026" containerName="main"
Jul 05 13:59:46.913058 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:46.913044    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a8ff27c-ff45-41f6-9eae-bc6877429c0a" containerName="main"
Jul 05 13:59:46.913058 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:46.913054    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a8ff27c-ff45-41f6-9eae-bc6877429c0a" containerName="main"
Jul 05 13:59:46.913162 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:46.913150    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a8ff27c-ff45-41f6-9eae-bc6877429c0a" containerName="main"
Jul 05 13:59:46.913200 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:46.913169    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ac12674-9b50-49de-8631-c2daddab7026" containerName="main"
Jul 05 13:59:46.918033 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:46.918007    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:46.921730 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:46.921699    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7acb12\"/\"default-dockercfg-psrl8\""
Jul 05 13:59:46.921901 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:46.921735    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7acb12\"/\"rate-test-model-7acb12-kserve-self-signed-certs\""
Jul 05 13:59:46.921901 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:46.921712    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7acb12\"/\"kube-root-ca.crt\""
Jul 05 13:59:46.922312 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:46.922289    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7acb12\"/\"openshift-service-ca.crt\""
Jul 05 13:59:46.924891 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:46.924865    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"]
Jul 05 13:59:47.073448 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.073406    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-tmp-dir\") pod \"rate-test-model-7acb12-kserve-7bc886c9d7-pls5m\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") " pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:47.073678 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.073520    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg9jk\" (UniqueName: \"kubernetes.io/projected/14d588fc-044b-4015-91e4-4b37323f31fa-kube-api-access-xg9jk\") pod \"rate-test-model-7acb12-kserve-7bc886c9d7-pls5m\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") " pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:47.073678 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.073556    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-home\") pod \"rate-test-model-7acb12-kserve-7bc886c9d7-pls5m\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") " pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:47.073678 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.073575    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14d588fc-044b-4015-91e4-4b37323f31fa-tls-certs\") pod \"rate-test-model-7acb12-kserve-7bc886c9d7-pls5m\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") " pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:47.073678 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.073594    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-model-cache\") pod \"rate-test-model-7acb12-kserve-7bc886c9d7-pls5m\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") " pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:47.073678 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.073617    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-dshm\") pod \"rate-test-model-7acb12-kserve-7bc886c9d7-pls5m\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") " pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:47.174837 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.174726    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-dshm\") pod \"rate-test-model-7acb12-kserve-7bc886c9d7-pls5m\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") " pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:47.174837 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.174792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-tmp-dir\") pod \"rate-test-model-7acb12-kserve-7bc886c9d7-pls5m\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") " pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:47.175066 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.174916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg9jk\" (UniqueName: \"kubernetes.io/projected/14d588fc-044b-4015-91e4-4b37323f31fa-kube-api-access-xg9jk\") pod \"rate-test-model-7acb12-kserve-7bc886c9d7-pls5m\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") " pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:47.175066 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.174959    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-home\") pod \"rate-test-model-7acb12-kserve-7bc886c9d7-pls5m\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") " pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:47.175066 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.174984    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14d588fc-044b-4015-91e4-4b37323f31fa-tls-certs\") pod \"rate-test-model-7acb12-kserve-7bc886c9d7-pls5m\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") " pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:47.175066 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.175013    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-model-cache\") pod \"rate-test-model-7acb12-kserve-7bc886c9d7-pls5m\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") " pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:47.175301 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.175273    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-tmp-dir\") pod \"rate-test-model-7acb12-kserve-7bc886c9d7-pls5m\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") " pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:47.175446 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.175334    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-model-cache\") pod \"rate-test-model-7acb12-kserve-7bc886c9d7-pls5m\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") " pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:47.175446 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.175434    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-home\") pod \"rate-test-model-7acb12-kserve-7bc886c9d7-pls5m\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") " pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:47.177224 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.177197    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-dshm\") pod \"rate-test-model-7acb12-kserve-7bc886c9d7-pls5m\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") " pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:47.177572 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.177552    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14d588fc-044b-4015-91e4-4b37323f31fa-tls-certs\") pod \"rate-test-model-7acb12-kserve-7bc886c9d7-pls5m\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") " pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:47.191487 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.191453    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg9jk\" (UniqueName: \"kubernetes.io/projected/14d588fc-044b-4015-91e4-4b37323f31fa-kube-api-access-xg9jk\") pod \"rate-test-model-7acb12-kserve-7bc886c9d7-pls5m\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") " pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:47.229407 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.229364    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:47.377196 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.377164    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"]
Jul 05 13:59:47.378435 ip-10-0-129-22 kubenswrapper[2565]: W0705 13:59:47.378410    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14d588fc_044b_4015_91e4_4b37323f31fa.slice/crio-c5380a6ce15a5cdc7654e031bfdf2b905631892bacc88988aa7da42f1676c33b WatchSource:0}: Error finding container c5380a6ce15a5cdc7654e031bfdf2b905631892bacc88988aa7da42f1676c33b: Status 404 returned error can't find the container with id c5380a6ce15a5cdc7654e031bfdf2b905631892bacc88988aa7da42f1676c33b
Jul 05 13:59:47.943727 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.943688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m" event={"ID":"14d588fc-044b-4015-91e4-4b37323f31fa","Type":"ContainerStarted","Data":"dd6ecafed4028297a78f022f3574fe44ef4705e6d5f2e6dc87499fe82077207c"}
Jul 05 13:59:47.944136 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.943735    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m" event={"ID":"14d588fc-044b-4015-91e4-4b37323f31fa","Type":"ContainerStarted","Data":"c5380a6ce15a5cdc7654e031bfdf2b905631892bacc88988aa7da42f1676c33b"}
Jul 05 13:59:47.961768 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:47.961710    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m" podStartSLOduration=1.9616918490000002 podStartE2EDuration="1.961691849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:59:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:59:47.961054825 +0000 UTC m=+2490.779022807" watchObservedRunningTime="2026-07-05 13:59:47.961691849 +0000 UTC m=+2490.779659850"
Jul 05 13:59:50.502345 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:50.502304    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 13:59:57.230229 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:57.230188    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:57.232877 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:57.230452    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:57.242941 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:57.242915    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 13:59:58.016492 ip-10-0-129-22 kubenswrapper[2565]: I0705 13:59:58.016462    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 14:00:21.496437 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:21.496392    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 14:00:35.595673 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:35.595617    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 14:00:40.486483 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:40.486446    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"]
Jul 05 14:00:41.478695 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:41.478660    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"]
Jul 05 14:00:43.209113 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:43.209067    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk"]
Jul 05 14:00:43.209552 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:43.209300    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk" podUID="07914bb6-0c6a-4b9e-98bc-f2b966162427" containerName="maas-api" containerID="cri-o://1bf5e324c608887dbcc95c0b19be3167126900c3aeed41a145d955bf6a756f9b" gracePeriod=30
Jul 05 14:00:43.454342 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:43.454312    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk"
Jul 05 14:00:43.481970 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:43.481881    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzgtv\" (UniqueName: \"kubernetes.io/projected/07914bb6-0c6a-4b9e-98bc-f2b966162427-kube-api-access-tzgtv\") pod \"07914bb6-0c6a-4b9e-98bc-f2b966162427\" (UID: \"07914bb6-0c6a-4b9e-98bc-f2b966162427\") "
Jul 05 14:00:43.481970 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:43.481965    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07914bb6-0c6a-4b9e-98bc-f2b966162427-maas-api-tls\") pod \"07914bb6-0c6a-4b9e-98bc-f2b966162427\" (UID: \"07914bb6-0c6a-4b9e-98bc-f2b966162427\") "
Jul 05 14:00:43.482167 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:43.482064    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07914bb6-0c6a-4b9e-98bc-f2b966162427-openshift-service-ca\") pod \"07914bb6-0c6a-4b9e-98bc-f2b966162427\" (UID: \"07914bb6-0c6a-4b9e-98bc-f2b966162427\") "
Jul 05 14:00:43.482599 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:43.482568    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07914bb6-0c6a-4b9e-98bc-f2b966162427-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "07914bb6-0c6a-4b9e-98bc-f2b966162427" (UID: "07914bb6-0c6a-4b9e-98bc-f2b966162427"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 14:00:43.484315 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:43.484277    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07914bb6-0c6a-4b9e-98bc-f2b966162427-kube-api-access-tzgtv" (OuterVolumeSpecName: "kube-api-access-tzgtv") pod "07914bb6-0c6a-4b9e-98bc-f2b966162427" (UID: "07914bb6-0c6a-4b9e-98bc-f2b966162427"). InnerVolumeSpecName "kube-api-access-tzgtv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 14:00:43.484503 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:43.484479    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07914bb6-0c6a-4b9e-98bc-f2b966162427-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "07914bb6-0c6a-4b9e-98bc-f2b966162427" (UID: "07914bb6-0c6a-4b9e-98bc-f2b966162427"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 14:00:43.583223 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:43.583174    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07914bb6-0c6a-4b9e-98bc-f2b966162427-maas-api-tls\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 14:00:43.583223 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:43.583214    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07914bb6-0c6a-4b9e-98bc-f2b966162427-openshift-service-ca\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 14:00:43.583223 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:43.583225    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzgtv\" (UniqueName: \"kubernetes.io/projected/07914bb6-0c6a-4b9e-98bc-f2b966162427-kube-api-access-tzgtv\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 14:00:44.242416 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:44.242375    2565 generic.go:356] "Generic (PLEG): container finished" podID="07914bb6-0c6a-4b9e-98bc-f2b966162427" containerID="1bf5e324c608887dbcc95c0b19be3167126900c3aeed41a145d955bf6a756f9b" exitCode=0
Jul 05 14:00:44.242904 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:44.242423    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk"
Jul 05 14:00:44.242904 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:44.242428    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk" event={"ID":"07914bb6-0c6a-4b9e-98bc-f2b966162427","Type":"ContainerDied","Data":"1bf5e324c608887dbcc95c0b19be3167126900c3aeed41a145d955bf6a756f9b"}
Jul 05 14:00:44.242904 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:44.242483    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk" event={"ID":"07914bb6-0c6a-4b9e-98bc-f2b966162427","Type":"ContainerDied","Data":"a59d53e6b9156cf88425acfe87c053be13230ebd58f5f1d7c1e69e3fa4c71e47"}
Jul 05 14:00:44.242904 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:44.242514    2565 scope.go:117] "RemoveContainer" containerID="1bf5e324c608887dbcc95c0b19be3167126900c3aeed41a145d955bf6a756f9b"
Jul 05 14:00:44.252230 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:44.252205    2565 scope.go:117] "RemoveContainer" containerID="1bf5e324c608887dbcc95c0b19be3167126900c3aeed41a145d955bf6a756f9b"
Jul 05 14:00:44.252580 ip-10-0-129-22 kubenswrapper[2565]: E0705 14:00:44.252554    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bf5e324c608887dbcc95c0b19be3167126900c3aeed41a145d955bf6a756f9b\": container with ID starting with 1bf5e324c608887dbcc95c0b19be3167126900c3aeed41a145d955bf6a756f9b not found: ID does not exist" containerID="1bf5e324c608887dbcc95c0b19be3167126900c3aeed41a145d955bf6a756f9b"
Jul 05 14:00:44.252685 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:44.252589    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bf5e324c608887dbcc95c0b19be3167126900c3aeed41a145d955bf6a756f9b"} err="failed to get container status \"1bf5e324c608887dbcc95c0b19be3167126900c3aeed41a145d955bf6a756f9b\": rpc error: code = NotFound desc = could not find container \"1bf5e324c608887dbcc95c0b19be3167126900c3aeed41a145d955bf6a756f9b\": container with ID starting with 1bf5e324c608887dbcc95c0b19be3167126900c3aeed41a145d955bf6a756f9b not found: ID does not exist"
Jul 05 14:00:44.262012 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:44.261975    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk"]
Jul 05 14:00:44.265564 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:44.265532    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-c2f889-6bb7859f85-r4csk"]
Jul 05 14:00:45.740596 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:45.740559    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07914bb6-0c6a-4b9e-98bc-f2b966162427" path="/var/lib/kubelet/pods/07914bb6-0c6a-4b9e-98bc-f2b966162427/volumes"
Jul 05 14:00:52.090907 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:52.090870    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 14:00:55.508119 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:55.508059    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth" podUID="dbbb6ccc-5d7a-4477-a956-5c21ccecb70d" containerName="main" containerID="cri-o://c3065a9d9fa583ea2b941c8faa6d471d7106c3e00ade07eb31af9e2adeb963bb" gracePeriod=45
Jul 05 14:00:55.762525 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:55.762448    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 14:00:55.891173 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:55.891134    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-dshm\") pod \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") "
Jul 05 14:00:55.891359 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:55.891202    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-tls-certs\") pod \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") "
Jul 05 14:00:55.891359 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:55.891237    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbdvm\" (UniqueName: \"kubernetes.io/projected/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-kube-api-access-vbdvm\") pod \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") "
Jul 05 14:00:55.891359 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:55.891261    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-model-cache\") pod \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") "
Jul 05 14:00:55.891359 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:55.891310    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-tmp-dir\") pod \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") "
Jul 05 14:00:55.891571 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:55.891360    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-home\") pod \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\" (UID: \"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d\") "
Jul 05 14:00:55.891628 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:55.891562    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dbbb6ccc-5d7a-4477-a956-5c21ccecb70d" (UID: "dbbb6ccc-5d7a-4477-a956-5c21ccecb70d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 14:00:55.891628 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:55.891573    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-model-cache" (OuterVolumeSpecName: "model-cache") pod "dbbb6ccc-5d7a-4477-a956-5c21ccecb70d" (UID: "dbbb6ccc-5d7a-4477-a956-5c21ccecb70d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 14:00:55.891777 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:55.891717    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-model-cache\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 14:00:55.891777 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:55.891737    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-tmp-dir\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 14:00:55.891897 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:55.891805    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-home" (OuterVolumeSpecName: "home") pod "dbbb6ccc-5d7a-4477-a956-5c21ccecb70d" (UID: "dbbb6ccc-5d7a-4477-a956-5c21ccecb70d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 14:00:55.893485 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:55.893457    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-dshm" (OuterVolumeSpecName: "dshm") pod "dbbb6ccc-5d7a-4477-a956-5c21ccecb70d" (UID: "dbbb6ccc-5d7a-4477-a956-5c21ccecb70d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 14:00:55.893485 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:55.893473    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-kube-api-access-vbdvm" (OuterVolumeSpecName: "kube-api-access-vbdvm") pod "dbbb6ccc-5d7a-4477-a956-5c21ccecb70d" (UID: "dbbb6ccc-5d7a-4477-a956-5c21ccecb70d"). InnerVolumeSpecName "kube-api-access-vbdvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 14:00:55.893677 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:55.893488    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dbbb6ccc-5d7a-4477-a956-5c21ccecb70d" (UID: "dbbb6ccc-5d7a-4477-a956-5c21ccecb70d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 14:00:55.992660 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:55.992591    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-dshm\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 14:00:55.992660 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:55.992660    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-tls-certs\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 14:00:55.992882 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:55.992679    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbdvm\" (UniqueName: \"kubernetes.io/projected/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-kube-api-access-vbdvm\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 14:00:55.992882 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:55.992690    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d-home\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 14:00:56.307754 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.307718    2565 generic.go:356] "Generic (PLEG): container finished" podID="dbbb6ccc-5d7a-4477-a956-5c21ccecb70d" containerID="c3065a9d9fa583ea2b941c8faa6d471d7106c3e00ade07eb31af9e2adeb963bb" exitCode=0
Jul 05 14:00:56.307949 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.307766    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"
Jul 05 14:00:56.307949 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.307789    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth" event={"ID":"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d","Type":"ContainerDied","Data":"c3065a9d9fa583ea2b941c8faa6d471d7106c3e00ade07eb31af9e2adeb963bb"}
Jul 05 14:00:56.307949 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.307824    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth" event={"ID":"dbbb6ccc-5d7a-4477-a956-5c21ccecb70d","Type":"ContainerDied","Data":"daeaa761a95223a9ea152438ebfb640268135fc361b4ae49470a6db76975931d"}
Jul 05 14:00:56.307949 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.307841    2565 scope.go:117] "RemoveContainer" containerID="c3065a9d9fa583ea2b941c8faa6d471d7106c3e00ade07eb31af9e2adeb963bb"
Jul 05 14:00:56.317047 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.317024    2565 scope.go:117] "RemoveContainer" containerID="c3065a9d9fa583ea2b941c8faa6d471d7106c3e00ade07eb31af9e2adeb963bb"
Jul 05 14:00:56.317387 ip-10-0-129-22 kubenswrapper[2565]: E0705 14:00:56.317366    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3065a9d9fa583ea2b941c8faa6d471d7106c3e00ade07eb31af9e2adeb963bb\": container with ID starting with c3065a9d9fa583ea2b941c8faa6d471d7106c3e00ade07eb31af9e2adeb963bb not found: ID does not exist" containerID="c3065a9d9fa583ea2b941c8faa6d471d7106c3e00ade07eb31af9e2adeb963bb"
Jul 05 14:00:56.317431 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.317396    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3065a9d9fa583ea2b941c8faa6d471d7106c3e00ade07eb31af9e2adeb963bb"} err="failed to get container status \"c3065a9d9fa583ea2b941c8faa6d471d7106c3e00ade07eb31af9e2adeb963bb\": rpc error: code = NotFound desc = could not find container \"c3065a9d9fa583ea2b941c8faa6d471d7106c3e00ade07eb31af9e2adeb963bb\": container with ID starting with c3065a9d9fa583ea2b941c8faa6d471d7106c3e00ade07eb31af9e2adeb963bb not found: ID does not exist"
Jul 05 14:00:56.329727 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.329690    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"]
Jul 05 14:00:56.334605 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.334574    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c2f889/rate-test-model-c2f889-kserve-7f8dd9f755-mmsth"]
Jul 05 14:00:56.499121 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.499071    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m" podUID="14d588fc-044b-4015-91e4-4b37323f31fa" containerName="main" containerID="cri-o://dd6ecafed4028297a78f022f3574fe44ef4705e6d5f2e6dc87499fe82077207c" gracePeriod=45
Jul 05 14:00:56.750528 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.750500    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 14:00:56.900787 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.900751    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-tmp-dir\") pod \"14d588fc-044b-4015-91e4-4b37323f31fa\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") "
Jul 05 14:00:56.900787 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.900791    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-dshm\") pod \"14d588fc-044b-4015-91e4-4b37323f31fa\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") "
Jul 05 14:00:56.901055 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.900827    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-model-cache\") pod \"14d588fc-044b-4015-91e4-4b37323f31fa\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") "
Jul 05 14:00:56.901055 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.900885    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-home\") pod \"14d588fc-044b-4015-91e4-4b37323f31fa\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") "
Jul 05 14:00:56.901055 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.900905    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14d588fc-044b-4015-91e4-4b37323f31fa-tls-certs\") pod \"14d588fc-044b-4015-91e4-4b37323f31fa\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") "
Jul 05 14:00:56.901055 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.900945    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xg9jk\" (UniqueName: \"kubernetes.io/projected/14d588fc-044b-4015-91e4-4b37323f31fa-kube-api-access-xg9jk\") pod \"14d588fc-044b-4015-91e4-4b37323f31fa\" (UID: \"14d588fc-044b-4015-91e4-4b37323f31fa\") "
Jul 05 14:00:56.901246 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.901149    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "14d588fc-044b-4015-91e4-4b37323f31fa" (UID: "14d588fc-044b-4015-91e4-4b37323f31fa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 14:00:56.901246 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.901163    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-home" (OuterVolumeSpecName: "home") pod "14d588fc-044b-4015-91e4-4b37323f31fa" (UID: "14d588fc-044b-4015-91e4-4b37323f31fa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 14:00:56.901246 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.901192    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-model-cache" (OuterVolumeSpecName: "model-cache") pod "14d588fc-044b-4015-91e4-4b37323f31fa" (UID: "14d588fc-044b-4015-91e4-4b37323f31fa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 14:00:56.902983 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.902957    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-dshm" (OuterVolumeSpecName: "dshm") pod "14d588fc-044b-4015-91e4-4b37323f31fa" (UID: "14d588fc-044b-4015-91e4-4b37323f31fa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 05 14:00:56.903094 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.903073    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14d588fc-044b-4015-91e4-4b37323f31fa-kube-api-access-xg9jk" (OuterVolumeSpecName: "kube-api-access-xg9jk") pod "14d588fc-044b-4015-91e4-4b37323f31fa" (UID: "14d588fc-044b-4015-91e4-4b37323f31fa"). InnerVolumeSpecName "kube-api-access-xg9jk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 14:00:56.903159 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:56.903076    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14d588fc-044b-4015-91e4-4b37323f31fa-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "14d588fc-044b-4015-91e4-4b37323f31fa" (UID: "14d588fc-044b-4015-91e4-4b37323f31fa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 14:00:57.002075 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:57.002031    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-tmp-dir\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 14:00:57.002075 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:57.002066    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-dshm\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 14:00:57.002075 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:57.002086    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-model-cache\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 14:00:57.002319 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:57.002095    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14d588fc-044b-4015-91e4-4b37323f31fa-home\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 14:00:57.002319 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:57.002103    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14d588fc-044b-4015-91e4-4b37323f31fa-tls-certs\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 14:00:57.002319 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:57.002112    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xg9jk\" (UniqueName: \"kubernetes.io/projected/14d588fc-044b-4015-91e4-4b37323f31fa-kube-api-access-xg9jk\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 14:00:57.315530 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:57.315443    2565 generic.go:356] "Generic (PLEG): container finished" podID="14d588fc-044b-4015-91e4-4b37323f31fa" containerID="dd6ecafed4028297a78f022f3574fe44ef4705e6d5f2e6dc87499fe82077207c" exitCode=0
Jul 05 14:00:57.315530 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:57.315482    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m" event={"ID":"14d588fc-044b-4015-91e4-4b37323f31fa","Type":"ContainerDied","Data":"dd6ecafed4028297a78f022f3574fe44ef4705e6d5f2e6dc87499fe82077207c"}
Jul 05 14:00:57.315530 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:57.315488    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"
Jul 05 14:00:57.315530 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:57.315508    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m" event={"ID":"14d588fc-044b-4015-91e4-4b37323f31fa","Type":"ContainerDied","Data":"c5380a6ce15a5cdc7654e031bfdf2b905631892bacc88988aa7da42f1676c33b"}
Jul 05 14:00:57.315530 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:57.315526    2565 scope.go:117] "RemoveContainer" containerID="dd6ecafed4028297a78f022f3574fe44ef4705e6d5f2e6dc87499fe82077207c"
Jul 05 14:00:57.325123 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:57.325101    2565 scope.go:117] "RemoveContainer" containerID="dd6ecafed4028297a78f022f3574fe44ef4705e6d5f2e6dc87499fe82077207c"
Jul 05 14:00:57.325487 ip-10-0-129-22 kubenswrapper[2565]: E0705 14:00:57.325463    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd6ecafed4028297a78f022f3574fe44ef4705e6d5f2e6dc87499fe82077207c\": container with ID starting with dd6ecafed4028297a78f022f3574fe44ef4705e6d5f2e6dc87499fe82077207c not found: ID does not exist" containerID="dd6ecafed4028297a78f022f3574fe44ef4705e6d5f2e6dc87499fe82077207c"
Jul 05 14:00:57.325589 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:57.325498    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd6ecafed4028297a78f022f3574fe44ef4705e6d5f2e6dc87499fe82077207c"} err="failed to get container status \"dd6ecafed4028297a78f022f3574fe44ef4705e6d5f2e6dc87499fe82077207c\": rpc error: code = NotFound desc = could not find container \"dd6ecafed4028297a78f022f3574fe44ef4705e6d5f2e6dc87499fe82077207c\": container with ID starting with dd6ecafed4028297a78f022f3574fe44ef4705e6d5f2e6dc87499fe82077207c not found: ID does not exist"
Jul 05 14:00:57.337110 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:57.337075    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"]
Jul 05 14:00:57.340452 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:57.340418    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-7acb12/rate-test-model-7acb12-kserve-7bc886c9d7-pls5m"]
Jul 05 14:00:57.740813 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:57.740778    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14d588fc-044b-4015-91e4-4b37323f31fa" path="/var/lib/kubelet/pods/14d588fc-044b-4015-91e4-4b37323f31fa/volumes"
Jul 05 14:00:57.741193 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:00:57.741178    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbbb6ccc-5d7a-4477-a956-5c21ccecb70d" path="/var/lib/kubelet/pods/dbbb6ccc-5d7a-4477-a956-5c21ccecb70d/volumes"
Jul 05 14:01:26.681242 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:26.681202    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2"]
Jul 05 14:01:26.681881 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:26.681443    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2" podUID="67461fde-4746-4aa6-bae5-15ba77bbdb5d" containerName="maas-api" containerID="cri-o://d3adbc319e0a313e7ee0af60c09a26993df6b30dbc00cc0e5df9618f7a520f70" gracePeriod=30
Jul 05 14:01:26.933235 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:26.933161    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2"
Jul 05 14:01:26.961398 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:26.961360    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67461fde-4746-4aa6-bae5-15ba77bbdb5d-maas-api-tls\") pod \"67461fde-4746-4aa6-bae5-15ba77bbdb5d\" (UID: \"67461fde-4746-4aa6-bae5-15ba77bbdb5d\") "
Jul 05 14:01:26.961600 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:26.961408    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67461fde-4746-4aa6-bae5-15ba77bbdb5d-openshift-service-ca\") pod \"67461fde-4746-4aa6-bae5-15ba77bbdb5d\" (UID: \"67461fde-4746-4aa6-bae5-15ba77bbdb5d\") "
Jul 05 14:01:26.961600 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:26.961504    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqtjs\" (UniqueName: \"kubernetes.io/projected/67461fde-4746-4aa6-bae5-15ba77bbdb5d-kube-api-access-wqtjs\") pod \"67461fde-4746-4aa6-bae5-15ba77bbdb5d\" (UID: \"67461fde-4746-4aa6-bae5-15ba77bbdb5d\") "
Jul 05 14:01:26.961872 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:26.961843    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67461fde-4746-4aa6-bae5-15ba77bbdb5d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "67461fde-4746-4aa6-bae5-15ba77bbdb5d" (UID: "67461fde-4746-4aa6-bae5-15ba77bbdb5d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 05 14:01:26.963595 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:26.963563    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67461fde-4746-4aa6-bae5-15ba77bbdb5d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "67461fde-4746-4aa6-bae5-15ba77bbdb5d" (UID: "67461fde-4746-4aa6-bae5-15ba77bbdb5d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 05 14:01:26.963744 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:26.963644    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67461fde-4746-4aa6-bae5-15ba77bbdb5d-kube-api-access-wqtjs" (OuterVolumeSpecName: "kube-api-access-wqtjs") pod "67461fde-4746-4aa6-bae5-15ba77bbdb5d" (UID: "67461fde-4746-4aa6-bae5-15ba77bbdb5d"). InnerVolumeSpecName "kube-api-access-wqtjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 05 14:01:27.063015 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:27.062976    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67461fde-4746-4aa6-bae5-15ba77bbdb5d-maas-api-tls\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 14:01:27.063015 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:27.063009    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67461fde-4746-4aa6-bae5-15ba77bbdb5d-openshift-service-ca\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 14:01:27.063015 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:27.063019    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqtjs\" (UniqueName: \"kubernetes.io/projected/67461fde-4746-4aa6-bae5-15ba77bbdb5d-kube-api-access-wqtjs\") on node \"ip-10-0-129-22.ec2.internal\" DevicePath \"\""
Jul 05 14:01:27.472403 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:27.472366    2565 generic.go:356] "Generic (PLEG): container finished" podID="67461fde-4746-4aa6-bae5-15ba77bbdb5d" containerID="d3adbc319e0a313e7ee0af60c09a26993df6b30dbc00cc0e5df9618f7a520f70" exitCode=0
Jul 05 14:01:27.472607 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:27.472418    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2"
Jul 05 14:01:27.472607 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:27.472429    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2" event={"ID":"67461fde-4746-4aa6-bae5-15ba77bbdb5d","Type":"ContainerDied","Data":"d3adbc319e0a313e7ee0af60c09a26993df6b30dbc00cc0e5df9618f7a520f70"}
Jul 05 14:01:27.472607 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:27.472472    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2" event={"ID":"67461fde-4746-4aa6-bae5-15ba77bbdb5d","Type":"ContainerDied","Data":"f266bfde02f78086cbc801e2d95d7f8e13a983015b8efbfbf3743e45ae6d48d3"}
Jul 05 14:01:27.472607 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:27.472493    2565 scope.go:117] "RemoveContainer" containerID="d3adbc319e0a313e7ee0af60c09a26993df6b30dbc00cc0e5df9618f7a520f70"
Jul 05 14:01:27.482216 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:27.482192    2565 scope.go:117] "RemoveContainer" containerID="d3adbc319e0a313e7ee0af60c09a26993df6b30dbc00cc0e5df9618f7a520f70"
Jul 05 14:01:27.482519 ip-10-0-129-22 kubenswrapper[2565]: E0705 14:01:27.482497    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3adbc319e0a313e7ee0af60c09a26993df6b30dbc00cc0e5df9618f7a520f70\": container with ID starting with d3adbc319e0a313e7ee0af60c09a26993df6b30dbc00cc0e5df9618f7a520f70 not found: ID does not exist" containerID="d3adbc319e0a313e7ee0af60c09a26993df6b30dbc00cc0e5df9618f7a520f70"
Jul 05 14:01:27.482565 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:27.482529    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3adbc319e0a313e7ee0af60c09a26993df6b30dbc00cc0e5df9618f7a520f70"} err="failed to get container status \"d3adbc319e0a313e7ee0af60c09a26993df6b30dbc00cc0e5df9618f7a520f70\": rpc error: code = NotFound desc = could not find container \"d3adbc319e0a313e7ee0af60c09a26993df6b30dbc00cc0e5df9618f7a520f70\": container with ID starting with d3adbc319e0a313e7ee0af60c09a26993df6b30dbc00cc0e5df9618f7a520f70 not found: ID does not exist"
Jul 05 14:01:27.494620 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:27.494583    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2"]
Jul 05 14:01:27.497979 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:27.497947    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-7acb12-56f55c89fd-b22n2"]
Jul 05 14:01:27.741567 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:27.741466    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67461fde-4746-4aa6-bae5-15ba77bbdb5d" path="/var/lib/kubelet/pods/67461fde-4746-4aa6-bae5-15ba77bbdb5d/volumes"
Jul 05 14:01:28.902420 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:28.902380    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dfgzw"]
Jul 05 14:01:33.349615 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:33.349578    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-848d544854-grk7f_5a8a418e-70a1-4d06-9ef6-39e77901fe0b/authorino/0.log"
Jul 05 14:01:39.046857 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:39.046825    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54547f4bcb-6ljqm_61f1d132-2c31-42cb-9564-f9d637db66e8/copy-manifests/0.log"
Jul 05 14:01:39.064249 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:39.064185    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54547f4bcb-6ljqm_61f1d132-2c31-42cb-9564-f9d637db66e8/manager/0.log"
Jul 05 14:01:40.191843 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:40.191808    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx_e2cc589a-7a00-4dc8-b397-ab1c94d91888/util/0.log"
Jul 05 14:01:40.199069 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:40.199043    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx_e2cc589a-7a00-4dc8-b397-ab1c94d91888/pull/0.log"
Jul 05 14:01:40.206061 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:40.206036    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx_e2cc589a-7a00-4dc8-b397-ab1c94d91888/extract/0.log"
Jul 05 14:01:40.315994 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:40.315965    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq_64eb7501-5af5-4646-83bb-9b436e7be1a3/extract/0.log"
Jul 05 14:01:40.322927 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:40.322892    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq_64eb7501-5af5-4646-83bb-9b436e7be1a3/util/0.log"
Jul 05 14:01:40.330086 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:40.330048    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq_64eb7501-5af5-4646-83bb-9b436e7be1a3/pull/0.log"
Jul 05 14:01:40.440859 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:40.440831    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg_5ba58829-beca-4aa3-92f8-716632068bb7/util/0.log"
Jul 05 14:01:40.447700 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:40.447609    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg_5ba58829-beca-4aa3-92f8-716632068bb7/pull/0.log"
Jul 05 14:01:40.461462 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:40.461436    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg_5ba58829-beca-4aa3-92f8-716632068bb7/extract/0.log"
Jul 05 14:01:40.569967 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:40.569934    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss_5bf1fef7-3d0f-4991-bab6-0aec83f6aed6/util/0.log"
Jul 05 14:01:40.576153 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:40.576125    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss_5bf1fef7-3d0f-4991-bab6-0aec83f6aed6/pull/0.log"
Jul 05 14:01:40.582358 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:40.582332    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss_5bf1fef7-3d0f-4991-bab6-0aec83f6aed6/extract/0.log"
Jul 05 14:01:40.704662 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:40.704522    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-848d544854-grk7f_5a8a418e-70a1-4d06-9ef6-39e77901fe0b/authorino/0.log"
Jul 05 14:01:41.410017 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:41.409981    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dfgzw_11aac4b6-00c7-4789-b8cc-c3a328b7f984/limitador/0.log"
Jul 05 14:01:42.121458 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:42.121425    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-776bddfb77-6q7kk_387d4097-0fb8-427f-8a30-5c4b3d383327/kube-auth-proxy/0.log"
Jul 05 14:01:43.585434 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:43.585408    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-d9dg4_69f9eb6d-1584-42d5-b30e-30e2795e9809/main/0.log"
Jul 05 14:01:48.000217 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.000177    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-srwzm/must-gather-98kl9"]
Jul 05 14:01:48.000602 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.000470    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67461fde-4746-4aa6-bae5-15ba77bbdb5d" containerName="maas-api"
Jul 05 14:01:48.000602 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.000482    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="67461fde-4746-4aa6-bae5-15ba77bbdb5d" containerName="maas-api"
Jul 05 14:01:48.000602 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.000494    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07914bb6-0c6a-4b9e-98bc-f2b966162427" containerName="maas-api"
Jul 05 14:01:48.000602 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.000499    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="07914bb6-0c6a-4b9e-98bc-f2b966162427" containerName="maas-api"
Jul 05 14:01:48.000602 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.000506    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14d588fc-044b-4015-91e4-4b37323f31fa" containerName="main"
Jul 05 14:01:48.000602 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.000525    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="14d588fc-044b-4015-91e4-4b37323f31fa" containerName="main"
Jul 05 14:01:48.000602 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.000538    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbbb6ccc-5d7a-4477-a956-5c21ccecb70d" containerName="main"
Jul 05 14:01:48.000602 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.000544    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbbb6ccc-5d7a-4477-a956-5c21ccecb70d" containerName="main"
Jul 05 14:01:48.000602 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.000599    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="67461fde-4746-4aa6-bae5-15ba77bbdb5d" containerName="maas-api"
Jul 05 14:01:48.000602 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.000606    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="14d588fc-044b-4015-91e4-4b37323f31fa" containerName="main"
Jul 05 14:01:48.000957 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.000614    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="07914bb6-0c6a-4b9e-98bc-f2b966162427" containerName="maas-api"
Jul 05 14:01:48.000957 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.000621    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbbb6ccc-5d7a-4477-a956-5c21ccecb70d" containerName="main"
Jul 05 14:01:48.005216 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.005190    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-srwzm/must-gather-98kl9"
Jul 05 14:01:48.008253 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.008220    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-srwzm\"/\"openshift-service-ca.crt\""
Jul 05 14:01:48.008444 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.008220    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-srwzm\"/\"kube-root-ca.crt\""
Jul 05 14:01:48.009068 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.009051    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-srwzm\"/\"default-dockercfg-hwlnw\""
Jul 05 14:01:48.014728 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.014699    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-srwzm/must-gather-98kl9"]
Jul 05 14:01:48.146523 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.146482    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4b12902e-72e9-4a71-b973-45316dcf892f-must-gather-output\") pod \"must-gather-98kl9\" (UID: \"4b12902e-72e9-4a71-b973-45316dcf892f\") " pod="openshift-must-gather-srwzm/must-gather-98kl9"
Jul 05 14:01:48.146748 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.146551    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsszq\" (UniqueName: \"kubernetes.io/projected/4b12902e-72e9-4a71-b973-45316dcf892f-kube-api-access-dsszq\") pod \"must-gather-98kl9\" (UID: \"4b12902e-72e9-4a71-b973-45316dcf892f\") " pod="openshift-must-gather-srwzm/must-gather-98kl9"
Jul 05 14:01:48.247493 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.247450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsszq\" (UniqueName: \"kubernetes.io/projected/4b12902e-72e9-4a71-b973-45316dcf892f-kube-api-access-dsszq\") pod \"must-gather-98kl9\" (UID: \"4b12902e-72e9-4a71-b973-45316dcf892f\") " pod="openshift-must-gather-srwzm/must-gather-98kl9"
Jul 05 14:01:48.247735 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.247522    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4b12902e-72e9-4a71-b973-45316dcf892f-must-gather-output\") pod \"must-gather-98kl9\" (UID: \"4b12902e-72e9-4a71-b973-45316dcf892f\") " pod="openshift-must-gather-srwzm/must-gather-98kl9"
Jul 05 14:01:48.247947 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.247927    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4b12902e-72e9-4a71-b973-45316dcf892f-must-gather-output\") pod \"must-gather-98kl9\" (UID: \"4b12902e-72e9-4a71-b973-45316dcf892f\") " pod="openshift-must-gather-srwzm/must-gather-98kl9"
Jul 05 14:01:48.259228 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.259156    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsszq\" (UniqueName: \"kubernetes.io/projected/4b12902e-72e9-4a71-b973-45316dcf892f-kube-api-access-dsszq\") pod \"must-gather-98kl9\" (UID: \"4b12902e-72e9-4a71-b973-45316dcf892f\") " pod="openshift-must-gather-srwzm/must-gather-98kl9"
Jul 05 14:01:48.315842 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.315806    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-srwzm/must-gather-98kl9"
Jul 05 14:01:48.457728 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.457700    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-srwzm/must-gather-98kl9"]
Jul 05 14:01:48.460041 ip-10-0-129-22 kubenswrapper[2565]: W0705 14:01:48.460012    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b12902e_72e9_4a71_b973_45316dcf892f.slice/crio-c2069e635ce2fbd943c59d54bab6e86f60626fda4074d6eafb9b1f7f8488a319 WatchSource:0}: Error finding container c2069e635ce2fbd943c59d54bab6e86f60626fda4074d6eafb9b1f7f8488a319: Status 404 returned error can't find the container with id c2069e635ce2fbd943c59d54bab6e86f60626fda4074d6eafb9b1f7f8488a319
Jul 05 14:01:48.462420 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.462399    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 05 14:01:48.581366 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:48.581274    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-srwzm/must-gather-98kl9" event={"ID":"4b12902e-72e9-4a71-b973-45316dcf892f","Type":"ContainerStarted","Data":"c2069e635ce2fbd943c59d54bab6e86f60626fda4074d6eafb9b1f7f8488a319"}
Jul 05 14:01:49.590278 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:49.589536    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-srwzm/must-gather-98kl9" event={"ID":"4b12902e-72e9-4a71-b973-45316dcf892f","Type":"ContainerStarted","Data":"64065ef2a21e713dcc54c5bfb8ab2381813897fced02ff8f90f30fa2f481a634"}
Jul 05 14:01:49.590278 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:49.589596    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-srwzm/must-gather-98kl9" event={"ID":"4b12902e-72e9-4a71-b973-45316dcf892f","Type":"ContainerStarted","Data":"bea3aaa44ea9d2fb0f1984b2385bad2d4ec6fe99b21edb9ca533bfdceea9816f"}
Jul 05 14:01:49.610938 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:49.610867    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-srwzm/must-gather-98kl9" podStartSLOduration=1.9038977419999998 podStartE2EDuration="2.61084253s" totalImagesPullingTime="706.944788ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 14:01:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:01:49.608786629 +0000 UTC m=+2612.426754572" watchObservedRunningTime="2026-07-05 14:01:49.61084253 +0000 UTC m=+2612.428810488"
Jul 05 14:01:50.904785 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:50.904753    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-t4s6n_dd27dfce-3c13-4d05-a19b-dcb32e9af21c/global-pull-secret-syncer/0.log"
Jul 05 14:01:51.064941 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:51.064909    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zgshx_2ffb49d9-ee88-454b-8b27-05a4274ef55f/konnectivity-agent/0.log"
Jul 05 14:01:51.115000 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:51.114953    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-22.ec2.internal_700cc51e5868b85faed88c518f5936e2/haproxy/0.log"
Jul 05 14:01:55.642010 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:55.641973    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx_e2cc589a-7a00-4dc8-b397-ab1c94d91888/extract/0.log"
Jul 05 14:01:55.670841 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:55.670802    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx_e2cc589a-7a00-4dc8-b397-ab1c94d91888/util/0.log"
Jul 05 14:01:55.697722 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:55.697651    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nvctx_e2cc589a-7a00-4dc8-b397-ab1c94d91888/pull/0.log"
Jul 05 14:01:55.733942 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:55.733892    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq_64eb7501-5af5-4646-83bb-9b436e7be1a3/extract/0.log"
Jul 05 14:01:55.761179 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:55.761142    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq_64eb7501-5af5-4646-83bb-9b436e7be1a3/util/0.log"
Jul 05 14:01:55.787766 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:55.787729    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jhbwq_64eb7501-5af5-4646-83bb-9b436e7be1a3/pull/0.log"
Jul 05 14:01:55.819682 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:55.819624    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg_5ba58829-beca-4aa3-92f8-716632068bb7/extract/0.log"
Jul 05 14:01:55.843175 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:55.843139    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg_5ba58829-beca-4aa3-92f8-716632068bb7/util/0.log"
Jul 05 14:01:55.867557 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:55.867519    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gjpkg_5ba58829-beca-4aa3-92f8-716632068bb7/pull/0.log"
Jul 05 14:01:55.905667 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:55.905564    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss_5bf1fef7-3d0f-4991-bab6-0aec83f6aed6/extract/0.log"
Jul 05 14:01:55.932539 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:55.932477    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss_5bf1fef7-3d0f-4991-bab6-0aec83f6aed6/util/0.log"
Jul 05 14:01:55.957247 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:55.957219    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vzjss_5bf1fef7-3d0f-4991-bab6-0aec83f6aed6/pull/0.log"
Jul 05 14:01:56.342711 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:56.342457    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-848d544854-grk7f_5a8a418e-70a1-4d06-9ef6-39e77901fe0b/authorino/0.log"
Jul 05 14:01:56.661942 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:56.661904    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dfgzw_11aac4b6-00c7-4789-b8cc-c3a328b7f984/limitador/0.log"
Jul 05 14:01:58.412039 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:58.411462    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-ftkpj_4f2b028a-938b-4fca-80a7-047076e70861/cluster-monitoring-operator/0.log"
Jul 05 14:01:58.521718 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:58.521689    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-66559985c7-scwp2_ae16044f-cbe4-42b8-bfbc-5cee0ac9750e/metrics-server/0.log"
Jul 05 14:01:58.554084 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:58.554016    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-22s4g_d4e7f0ba-4a2c-4f5f-9164-7490215eb010/monitoring-plugin/0.log"
Jul 05 14:01:58.594460 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:58.594336    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gpjqv_92188d56-7bf7-4ce6-a7a0-93aff69707ca/node-exporter/0.log"
Jul 05 14:01:58.624223 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:58.624190    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gpjqv_92188d56-7bf7-4ce6-a7a0-93aff69707ca/kube-rbac-proxy/0.log"
Jul 05 14:01:58.652106 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:01:58.652076    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gpjqv_92188d56-7bf7-4ce6-a7a0-93aff69707ca/init-textfile/0.log"
Jul 05 14:02:01.394504 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:01.394466    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/1.log"
Jul 05 14:02:01.401486 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:01.401450    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b99jf_58b76a86-1e5e-48b6-8792-80536cafcb5c/console-operator/2.log"
Jul 05 14:02:01.974664 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:01.974611    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk"]
Jul 05 14:02:01.981315 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:01.981278    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk"
Jul 05 14:02:01.988098 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:01.988064    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk"]
Jul 05 14:02:02.089971 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:02.089927    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e-sys\") pod \"perf-node-gather-daemonset-pjlgk\" (UID: \"3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk"
Jul 05 14:02:02.090181 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:02.090019    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e-lib-modules\") pod \"perf-node-gather-daemonset-pjlgk\" (UID: \"3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk"
Jul 05 14:02:02.090181 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:02.090080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e-proc\") pod \"perf-node-gather-daemonset-pjlgk\" (UID: \"3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk"
Jul 05 14:02:02.090181 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:02.090108    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdrfk\" (UniqueName: \"kubernetes.io/projected/3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e-kube-api-access-kdrfk\") pod \"perf-node-gather-daemonset-pjlgk\" (UID: \"3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk"
Jul 05 14:02:02.090181 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:02.090153    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e-podres\") pod \"perf-node-gather-daemonset-pjlgk\" (UID: \"3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk"
Jul 05 14:02:02.191448 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:02.191404    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e-sys\") pod \"perf-node-gather-daemonset-pjlgk\" (UID: \"3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk"
Jul 05 14:02:02.191908 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:02.191881    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e-lib-modules\") pod \"perf-node-gather-daemonset-pjlgk\" (UID: \"3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk"
Jul 05 14:02:02.192268 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:02.192249    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e-proc\") pod \"perf-node-gather-daemonset-pjlgk\" (UID: \"3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk"
Jul 05 14:02:02.192420 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:02.192402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdrfk\" (UniqueName: \"kubernetes.io/projected/3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e-kube-api-access-kdrfk\") pod \"perf-node-gather-daemonset-pjlgk\" (UID: \"3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk"
Jul 05 14:02:02.192682 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:02.191786    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e-sys\") pod \"perf-node-gather-daemonset-pjlgk\" (UID: \"3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk"
Jul 05 14:02:02.192833 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:02.192164    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e-lib-modules\") pod \"perf-node-gather-daemonset-pjlgk\" (UID: \"3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk"
Jul 05 14:02:02.192942 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:02.192560    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e-proc\") pod \"perf-node-gather-daemonset-pjlgk\" (UID: \"3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk"
Jul 05 14:02:02.193013 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:02.192621    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e-podres\") pod \"perf-node-gather-daemonset-pjlgk\" (UID: \"3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk"
Jul 05 14:02:02.193069 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:02.192872    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e-podres\") pod \"perf-node-gather-daemonset-pjlgk\" (UID: \"3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk"
Jul 05 14:02:02.200951 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:02.200915    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdrfk\" (UniqueName: \"kubernetes.io/projected/3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e-kube-api-access-kdrfk\") pod \"perf-node-gather-daemonset-pjlgk\" (UID: \"3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e\") " pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk"
Jul 05 14:02:02.302421 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:02.302311    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk"
Jul 05 14:02:02.485716 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:02.485681    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk"]
Jul 05 14:02:02.714691 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:02.714650    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk" event={"ID":"3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e","Type":"ContainerStarted","Data":"f4aeb83563af8a566692dfa7f4f154a09f10f041cad8104346ba7cef0df8c7bb"}
Jul 05 14:02:02.714866 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:02.714717    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk" event={"ID":"3de9e8d8-d01d-4e5a-9e7e-61fe85d1567e","Type":"ContainerStarted","Data":"ab1f93dbfeb01d80d0c11767d5bf9f70824f4afe978b9b6e98a8583364aada58"}
Jul 05 14:02:02.714967 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:02.714900    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk"
Jul 05 14:02:02.733600 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:02.733524    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk" podStartSLOduration=1.733499398 podStartE2EDuration="1.733499398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 14:02:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:02:02.730179015 +0000 UTC m=+2625.548147000" watchObservedRunningTime="2026-07-05 14:02:02.733499398 +0000 UTC m=+2625.551467356"
Jul 05 14:02:03.791877 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:03.791839    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d28zj_35b816f6-4b8c-4df8-b0f1-d51fc39569f5/dns/0.log"
Jul 05 14:02:03.817680 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:03.817620    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d28zj_35b816f6-4b8c-4df8-b0f1-d51fc39569f5/kube-rbac-proxy/0.log"
Jul 05 14:02:03.892819 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:03.892783    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nltvs_2c02645e-d3d4-4f5e-824f-c629da35133b/dns-node-resolver/0.log"
Jul 05 14:02:04.556166 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:04.556130    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rgn5q_8b968b72-7bc0-4186-aa14-7405cf541b16/node-ca/0.log"
Jul 05 14:02:05.744788 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:05.744729    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-776bddfb77-6q7kk_387d4097-0fb8-427f-8a30-5c4b3d383327/kube-auth-proxy/0.log"
Jul 05 14:02:06.637323 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:06.637284    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2hswj_6d43b236-bef2-4929-a053-d0b32a29301a/serve-healthcheck-canary/0.log"
Jul 05 14:02:07.280986 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:07.280955    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9k6px_69b9856f-38ad-40b1-996e-2ce488db00b3/kube-rbac-proxy/0.log"
Jul 05 14:02:07.305526 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:07.305499    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9k6px_69b9856f-38ad-40b1-996e-2ce488db00b3/exporter/0.log"
Jul 05 14:02:07.330499 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:07.330466    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9k6px_69b9856f-38ad-40b1-996e-2ce488db00b3/extractor/0.log"
Jul 05 14:02:08.733660 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:08.733609    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-srwzm/perf-node-gather-daemonset-pjlgk"
Jul 05 14:02:10.216622 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:10.216578    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54547f4bcb-6ljqm_61f1d132-2c31-42cb-9564-f9d637db66e8/manager/0.log"
Jul 05 14:02:10.243916 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:10.243879    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54547f4bcb-6ljqm_61f1d132-2c31-42cb-9564-f9d637db66e8/copy-manifests/0.log"
Jul 05 14:02:11.857131 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:11.857099    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-cfb4f694f-n79qn_af0302e7-8728-4e6b-a29b-308b5c155c6f/manager/0.log"
Jul 05 14:02:11.884780 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:11.884746    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ct55r_e2c3caab-4512-4cd5-b44b-27df5957d5b5/openshift-lws-operator/0.log"
Jul 05 14:02:12.789921 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:12.789833    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-776bddfb77-6q7kk_387d4097-0fb8-427f-8a30-5c4b3d383327/kube-auth-proxy/0.log"
Jul 05 14:02:14.327009 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:14.326956    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-776bddfb77-6q7kk_387d4097-0fb8-427f-8a30-5c4b3d383327/kube-auth-proxy/0.log"
Jul 05 14:02:17.447886 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:17.447854    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-xxj2g_6b02bb25-5475-4e7d-b02f-d89a084096cb/kube-storage-version-migrator-operator/1.log"
Jul 05 14:02:17.448744 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:17.448722    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-xxj2g_6b02bb25-5475-4e7d-b02f-d89a084096cb/kube-storage-version-migrator-operator/0.log"
Jul 05 14:02:18.666157 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:18.666126    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b2lbp_ed53678c-46fe-4967-b74f-c12eb3b0e626/kube-multus-additional-cni-plugins/0.log"
Jul 05 14:02:18.689871 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:18.689835    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b2lbp_ed53678c-46fe-4967-b74f-c12eb3b0e626/egress-router-binary-copy/0.log"
Jul 05 14:02:18.712308 ip-10-0-129-22 kubenswrapper[2565]: I0705 14:02:18.712276    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b2lbp_ed53678c-46fe-4967-b74f-c12eb3b0e626/cni-plugins/0.log"