Jul 17 17:22:24.108380 ip-10-0-143-187 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 17 17:22:24.108394 ip-10-0-143-187 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 17 17:22:24.108403 ip-10-0-143-187 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 17 17:22:24.108701 ip-10-0-143-187 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 17 17:22:34.182655 ip-10-0-143-187 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 17 17:22:34.182677 ip-10-0-143-187 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ef387ea482b148dc9312d0ae044e4977 --
Jul 17 17:24:09.849508 ip-10-0-143-187 systemd[1]: Starting Kubernetes Kubelet...
Jul 17 17:24:10.303229 ip-10-0-143-187 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 17:24:10.303229 ip-10-0-143-187 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 17 17:24:10.303229 ip-10-0-143-187 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 17:24:10.303229 ip-10-0-143-187 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 17 17:24:10.303229 ip-10-0-143-187 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 17:24:10.304339 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.304241    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 17 17:24:10.310090 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310065    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 17:24:10.310090 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310084    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 17:24:10.310090 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310089    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 17:24:10.310090 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310093    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 17:24:10.310090 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310096    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 17:24:10.310090 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310100    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 17:24:10.310414 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310103    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 17:24:10.310414 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310106    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 17:24:10.310414 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310109    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 17:24:10.310414 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310112    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 17:24:10.310414 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310114    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 17:24:10.310414 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310117    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 17:24:10.310414 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310120    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 17:24:10.310414 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310122    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 17:24:10.310414 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310125    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 17:24:10.310414 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310127    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 17:24:10.310414 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310130    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 17:24:10.310414 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310135    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 17:24:10.310414 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310140    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 17:24:10.310414 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310143    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 17:24:10.310414 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310146    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 17:24:10.310414 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310225    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 17:24:10.310414 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310284    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 17:24:10.310414 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310288    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 17:24:10.310414 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310292    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 17:24:10.311136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310296    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 17:24:10.311136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310299    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 17:24:10.311136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310302    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 17:24:10.311136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310305    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 17:24:10.311136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310308    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 17:24:10.311136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310310    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 17:24:10.311136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310313    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 17:24:10.311136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310316    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 17:24:10.311136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310319    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 17:24:10.311136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310324    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 17:24:10.311136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310333    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 17:24:10.311136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310337    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 17:24:10.311136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310341    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 17:24:10.311136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310347    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 17:24:10.311136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310452    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 17:24:10.311136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310475    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 17:24:10.311136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310482    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 17:24:10.311136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310489    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 17:24:10.311136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310496    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 17:24:10.311136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310501    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 17:24:10.311836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310507    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 17:24:10.311836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310512    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 17:24:10.311836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310518    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 17:24:10.311836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310523    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 17:24:10.311836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310527    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 17:24:10.311836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310532    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 17:24:10.311836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310543    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 17:24:10.311836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310547    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 17:24:10.311836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310552    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 17:24:10.311836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310556    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 17:24:10.311836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310561    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 17:24:10.311836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310566    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 17:24:10.311836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310571    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 17:24:10.311836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310575    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 17:24:10.311836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310580    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 17:24:10.311836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310584    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 17:24:10.311836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310592    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 17:24:10.311836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310600    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 17:24:10.311836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310605    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 17:24:10.311836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310620    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 17:24:10.312354 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310625    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 17:24:10.312354 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310629    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 17:24:10.312354 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310634    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 17:24:10.312354 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310638    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 17:24:10.312354 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310643    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 17:24:10.312354 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310648    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 17:24:10.312354 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310652    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 17:24:10.312354 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310658    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 17:24:10.312354 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310663    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 17:24:10.312354 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310667    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 17:24:10.312354 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310676    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 17:24:10.312354 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310681    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 17:24:10.312354 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310686    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 17:24:10.312354 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310690    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 17:24:10.312354 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310694    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 17:24:10.312354 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310698    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 17:24:10.312354 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310706    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 17:24:10.312354 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310711    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 17:24:10.312354 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310715    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 17:24:10.312354 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310720    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 17:24:10.312834 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310724    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 17:24:10.312834 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310731    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 17:24:10.312834 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310742    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 17:24:10.312834 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310747    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 17:24:10.312834 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310752    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 17:24:10.312834 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310756    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 17:24:10.312834 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310761    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 17:24:10.312834 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310766    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 17:24:10.312834 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310771    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 17:24:10.312834 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310775    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 17:24:10.312834 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310780    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 17:24:10.312834 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310785    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 17:24:10.312834 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310790    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 17:24:10.312834 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.310794    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 17:24:10.312834 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312145    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 17:24:10.312834 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312158    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 17:24:10.312834 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312182    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 17:24:10.312834 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312186    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 17:24:10.312834 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312189    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 17:24:10.313343 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312194    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 17:24:10.313343 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312199    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 17:24:10.313343 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312202    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 17:24:10.313343 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312205    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 17:24:10.313343 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312208    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 17:24:10.313343 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312211    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 17:24:10.313343 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312213    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 17:24:10.313343 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312216    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 17:24:10.313343 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312219    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 17:24:10.313343 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312221    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 17:24:10.313343 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312224    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 17:24:10.313343 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312227    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 17:24:10.313343 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312230    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 17:24:10.313343 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312232    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 17:24:10.313343 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312235    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 17:24:10.313343 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312237    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 17:24:10.313343 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312240    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 17:24:10.313343 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312242    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 17:24:10.313343 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312245    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 17:24:10.313826 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312249    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 17:24:10.313826 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312253    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 17:24:10.313826 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312256    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 17:24:10.313826 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312260    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 17:24:10.313826 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312262    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 17:24:10.313826 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312265    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 17:24:10.313826 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312267    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 17:24:10.313826 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312270    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 17:24:10.313826 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312273    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 17:24:10.313826 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312276    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 17:24:10.313826 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312278    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 17:24:10.313826 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312282    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 17:24:10.313826 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312285    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 17:24:10.313826 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312287    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 17:24:10.313826 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312290    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 17:24:10.313826 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312292    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 17:24:10.313826 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312295    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 17:24:10.313826 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312305    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 17:24:10.313826 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312309    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 17:24:10.314315 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312312    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 17:24:10.314315 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312315    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 17:24:10.314315 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312318    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 17:24:10.314315 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312321    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 17:24:10.314315 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312324    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 17:24:10.314315 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312327    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 17:24:10.314315 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312330    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 17:24:10.314315 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312333    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 17:24:10.314315 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312336    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 17:24:10.314315 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312338    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 17:24:10.314315 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312341    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 17:24:10.314315 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312344    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 17:24:10.314315 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312346    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 17:24:10.314315 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312349    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 17:24:10.314315 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312352    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 17:24:10.314315 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312355    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 17:24:10.314315 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312358    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 17:24:10.314315 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312361    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 17:24:10.314315 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312363    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 17:24:10.314315 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312367    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 17:24:10.314823 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312369    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 17:24:10.314823 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312372    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 17:24:10.314823 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312376    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 17:24:10.314823 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312379    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 17:24:10.314823 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312382    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 17:24:10.314823 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312384    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 17:24:10.314823 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312387    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 17:24:10.314823 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312390    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 17:24:10.314823 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312393    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 17:24:10.314823 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312396    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 17:24:10.314823 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312398    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 17:24:10.314823 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312401    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 17:24:10.314823 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312403    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 17:24:10.314823 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312407    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 17:24:10.314823 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312410    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 17:24:10.314823 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312412    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 17:24:10.314823 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312415    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 17:24:10.314823 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312417    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 17:24:10.314823 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312420    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 17:24:10.314823 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312422    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 17:24:10.315339 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312425    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 17:24:10.315339 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312427    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 17:24:10.315339 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312430    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 17:24:10.315339 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312433    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 17:24:10.315339 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312436    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 17:24:10.315339 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312438    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 17:24:10.315339 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312441    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 17:24:10.315339 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312443    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 17:24:10.315339 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312446    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 17:24:10.315339 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312448    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 17:24:10.315339 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312451    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 17:24:10.315339 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312453    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 17:24:10.315339 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312456    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 17:24:10.315339 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312459    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 17:24:10.315339 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312462    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 17:24:10.315339 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312465    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 17:24:10.315339 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312934    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 17:24:10.315339 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312940    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 17:24:10.315339 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312944    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 17:24:10.315339 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312947    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 17:24:10.315847 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312950    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 17:24:10.315847 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312953    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 17:24:10.315847 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312956    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 17:24:10.315847 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312959    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 17:24:10.315847 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312962    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 17:24:10.315847 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312964    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 17:24:10.315847 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312967    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 17:24:10.315847 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312969    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 17:24:10.315847 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312972    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 17:24:10.315847 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312974    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 17:24:10.315847 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312977    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 17:24:10.315847 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312980    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 17:24:10.315847 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312982    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 17:24:10.315847 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312985    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 17:24:10.315847 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312987    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 17:24:10.315847 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312991    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 17:24:10.315847 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312994    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 17:24:10.315847 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312996    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 17:24:10.315847 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.312999    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 17:24:10.315847 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313002    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 17:24:10.316389 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313005    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 17:24:10.316389 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313007    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 17:24:10.316389 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313010    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 17:24:10.316389 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313013    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 17:24:10.316389 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313015    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 17:24:10.316389 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313019    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 17:24:10.316389 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313022    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 17:24:10.316389 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313024    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 17:24:10.316389 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313027    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 17:24:10.316389 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313029    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 17:24:10.316389 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313032    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 17:24:10.316389 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313034    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 17:24:10.316389 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313037    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 17:24:10.316389 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313040    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 17:24:10.316389 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313043    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 17:24:10.316389 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313045    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 17:24:10.316389 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313048    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 17:24:10.316389 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313050    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 17:24:10.316389 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313052    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 17:24:10.316836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313055    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 17:24:10.316836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313057    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 17:24:10.316836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313060    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 17:24:10.316836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313062    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 17:24:10.316836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313065    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 17:24:10.316836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313067    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 17:24:10.316836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313070    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 17:24:10.316836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313072    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 17:24:10.316836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313076    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 17:24:10.316836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313078    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 17:24:10.316836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313081    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 17:24:10.316836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313083    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 17:24:10.316836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313086    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 17:24:10.316836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313088    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 17:24:10.316836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313091    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 17:24:10.316836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313093    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 17:24:10.316836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313096    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 17:24:10.316836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313098    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 17:24:10.316836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313101    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 17:24:10.316836 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313104    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 17:24:10.317349 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313107    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 17:24:10.317349 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313111    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 17:24:10.317349 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313114    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 17:24:10.317349 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313117    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 17:24:10.317349 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313120    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 17:24:10.317349 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313122    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 17:24:10.317349 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313125    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 17:24:10.317349 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313128    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 17:24:10.317349 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313131    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 17:24:10.317349 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313133    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 17:24:10.317349 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313138    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 17:24:10.317349 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313141    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 17:24:10.317349 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313144    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 17:24:10.317349 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313147    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 17:24:10.317349 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313150    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 17:24:10.317349 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313152    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 17:24:10.317349 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313156    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 17:24:10.317349 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313177    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 17:24:10.317349 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313183    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 17:24:10.317915 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313186    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 17:24:10.317915 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313189    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 17:24:10.317915 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313192    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 17:24:10.317915 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313195    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 17:24:10.317915 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313198    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 17:24:10.317915 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313201    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 17:24:10.317915 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313204    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 17:24:10.317915 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313206    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 17:24:10.317915 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313209    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 17:24:10.317915 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313212    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 17:24:10.317915 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313215    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 17:24:10.317915 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313218    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 17:24:10.317915 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313220    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 17:24:10.317915 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313223    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 17:24:10.317915 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313225    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 17:24:10.317915 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313228    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 17:24:10.317915 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313231    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 17:24:10.317915 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313310    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 17 17:24:10.317915 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313325    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 17 17:24:10.317915 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313331    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 17 17:24:10.317915 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313336    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313342    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313345    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313350    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313354    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313357    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313360    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313364    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313367    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313371    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313374    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313377    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313379    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313382    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313385    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313390    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313393    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313396    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313399    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313403    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313407    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313410    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313413    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 17 17:24:10.318468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313417    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313420    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313423    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313426    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313429    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313432    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313437    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313440    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313443    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313445    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313448    2576 flags.go:64] FLAG: --enable-server="true"
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313451    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313455    2576 flags.go:64] FLAG: --event-burst="100"
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313458    2576 flags.go:64] FLAG: --event-qps="50"
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313461    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313465    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313468    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313471    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313474    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313478    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313480    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313483    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313486    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313489    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313491    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 17 17:24:10.319029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313494    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313497    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313500    2576 flags.go:64] FLAG: --feature-gates=""
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313504    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313507    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313510    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313513    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313518    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313521    2576 flags.go:64] FLAG: --help="false"
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313524    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-143-187.ec2.internal"
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313527    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313530    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313533    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313536    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313540    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313543    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313546    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313549    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313551    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313555    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313558    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313561    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313563    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313568    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 17 17:24:10.319680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313571    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313574    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313577    2576 flags.go:64] FLAG: --lock-file=""
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313579    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313582    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313585    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313590    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313593    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313596    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313599    2576 flags.go:64] FLAG: --logging-format="text"
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313602    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313605    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313608    2576 flags.go:64] FLAG: --manifest-url=""
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313611    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313616    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313620    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313624    2576 flags.go:64] FLAG: --max-pods="110"
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313627    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313630    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313633    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313636    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313639    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313642    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313645    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313652    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 17 17:24:10.320299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313655    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313658    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313661    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313665    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313671    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313673    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313676    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313681    2576 flags.go:64] FLAG: --port="10250"
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313684    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313687    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08e50bfc63b2747bd"
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313690    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313693    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313696    2576 flags.go:64] FLAG: --register-node="true"
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313699    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313702    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313705    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313708    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313710    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313714    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313717    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313720    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313723    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313728    2576 flags.go:64] FLAG: --runonce="false"
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313731    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313734    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 17 17:24:10.320932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313736    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313739    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313742    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313745    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313748    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313751    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313753    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313756    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313759    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313762    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313765    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313771    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313774    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313779    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313784    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313787    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313791    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313794    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313797    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313800    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313803    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313806    2576 flags.go:64] FLAG: --v="2"
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313810    2576 flags.go:64] FLAG: --version="false"
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313814    2576 flags.go:64] FLAG: --vmodule=""
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313818    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 17 17:24:10.321603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.313821    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 17 17:24:10.322237 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313946    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 17:24:10.322237 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313950    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 17:24:10.322237 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313953    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 17:24:10.322237 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313957    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 17:24:10.322237 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313959    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 17:24:10.322237 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313962    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 17:24:10.322237 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313964    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 17:24:10.322237 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313966    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 17:24:10.322237 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313969    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 17:24:10.322237 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313972    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 17:24:10.322237 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313974    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 17:24:10.322237 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313977    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 17:24:10.322237 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313979    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 17:24:10.322237 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313981    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 17:24:10.322237 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313984    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 17:24:10.322237 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313986    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 17:24:10.322237 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313989    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 17:24:10.322237 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313991    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 17:24:10.322237 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313994    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 17:24:10.322237 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.313998    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 17:24:10.322752 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314001    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 17:24:10.322752 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314003    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 17:24:10.322752 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314006    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 17:24:10.322752 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314008    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 17:24:10.322752 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314011    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 17:24:10.322752 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314013    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 17:24:10.322752 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314015    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 17:24:10.322752 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314018    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 17:24:10.322752 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314021    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 17:24:10.322752 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314023    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 17:24:10.322752 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314026    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 17:24:10.322752 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314028    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 17:24:10.322752 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314031    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 17:24:10.322752 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314034    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 17:24:10.322752 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314036    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 17:24:10.322752 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314039    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 17:24:10.322752 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314042    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 17:24:10.322752 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314044    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 17:24:10.322752 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314047    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 17:24:10.322752 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314049    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 17:24:10.323351 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314052    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 17:24:10.323351 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314054    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 17:24:10.323351 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314057    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 17:24:10.323351 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314060    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 17:24:10.323351 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314064    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 17:24:10.323351 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314066    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 17:24:10.323351 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314069    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 17:24:10.323351 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314071    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 17:24:10.323351 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314074    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 17:24:10.323351 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314076    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 17:24:10.323351 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314079    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 17:24:10.323351 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314082    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 17:24:10.323351 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314085    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 17:24:10.323351 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314087    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 17:24:10.323351 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314091    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 17:24:10.323351 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314095    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 17:24:10.323351 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314098    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 17:24:10.323351 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314101    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 17:24:10.323351 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314104    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 17:24:10.323832 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314107    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 17:24:10.323832 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314110    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 17:24:10.323832 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314113    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 17:24:10.323832 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314115    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 17:24:10.323832 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314118    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 17:24:10.323832 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314121    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 17:24:10.323832 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314123    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 17:24:10.323832 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314126    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 17:24:10.323832 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314129    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 17:24:10.323832 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314131    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 17:24:10.323832 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314135    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 17:24:10.323832 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314139    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 17:24:10.323832 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314142    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 17:24:10.323832 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314144    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 17:24:10.323832 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314148    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 17:24:10.323832 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314151    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 17:24:10.323832 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314154    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 17:24:10.323832 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314157    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 17:24:10.323832 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314175    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 17:24:10.324312 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314180    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 17:24:10.324312 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314184    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 17:24:10.324312 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314188    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 17:24:10.324312 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314192    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 17:24:10.324312 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314195    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 17:24:10.324312 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314198    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 17:24:10.324312 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314202    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 17:24:10.324312 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314205    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 17:24:10.324312 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314207    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 17:24:10.324312 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314210    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 17:24:10.324312 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314212    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 17:24:10.324312 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314215    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 17:24:10.324312 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314217    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 17:24:10.324312 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314220    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 17:24:10.324312 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314223    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 17:24:10.324312 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314225    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 17:24:10.324312 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314228    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 17:24:10.324312 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314230    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 17:24:10.324312 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314233    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 17:24:10.324312 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314235    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 17:24:10.324797 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.314238    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 17:24:10.324797 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.314953    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 17:24:10.324797 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.322462    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 17 17:24:10.324797 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.322480    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 17 17:24:10.324797 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.322501    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 17 17:24:10.324797 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.322507    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 17 17:24:10.324797 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322567    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 17:24:10.324797 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322573    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 17:24:10.324797 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322576    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 17:24:10.324797 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322579    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 17:24:10.324797 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322584    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 17:24:10.324797 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322588    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 17:24:10.324797 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322591    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 17:24:10.324797 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322594    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 17:24:10.325141 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322597    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 17:24:10.325141 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322599    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 17:24:10.325141 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322602    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 17:24:10.325141 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322605    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 17:24:10.325141 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322608    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 17:24:10.325141 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322611    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 17:24:10.325141 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322614    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 17:24:10.325141 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322616    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 17:24:10.325141 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322619    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 17:24:10.325141 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322622    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 17:24:10.325141 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322625    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 17:24:10.325141 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322627    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 17:24:10.325141 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322630    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 17:24:10.325141 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322632    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 17:24:10.325141 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322635    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 17:24:10.325141 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322637    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 17:24:10.325141 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322640    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 17:24:10.325141 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322642    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 17:24:10.325141 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322645    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 17:24:10.325141 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322648    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 17:24:10.325647 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322650    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 17:24:10.325647 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322654    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 17:24:10.325647 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322657    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 17:24:10.325647 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322659    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 17:24:10.325647 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322662    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 17:24:10.325647 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322664    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 17:24:10.325647 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322667    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 17:24:10.325647 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322669    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 17:24:10.325647 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322672    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 17:24:10.325647 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322675    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 17:24:10.325647 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322678    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 17:24:10.325647 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322681    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 17:24:10.325647 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322683    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 17:24:10.325647 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322686    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 17:24:10.325647 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322688    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 17:24:10.325647 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322691    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 17:24:10.325647 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322693    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 17:24:10.325647 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322697    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 17:24:10.325647 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322700    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 17:24:10.325647 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322703    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 17:24:10.326136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322706    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 17:24:10.326136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322708    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 17:24:10.326136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322711    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 17:24:10.326136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322714    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 17:24:10.326136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322717    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 17:24:10.326136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322720    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 17:24:10.326136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322722    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 17:24:10.326136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322725    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 17:24:10.326136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322729    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 17:24:10.326136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322733    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 17:24:10.326136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322736    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 17:24:10.326136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322738    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 17:24:10.326136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322741    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 17:24:10.326136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322744    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 17:24:10.326136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322747    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 17:24:10.326136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322750    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 17:24:10.326136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322753    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 17:24:10.326136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322755    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 17:24:10.326136 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322759    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 17:24:10.326604 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322762    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 17:24:10.326604 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322765    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 17:24:10.326604 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322769    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 17:24:10.326604 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322772    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 17:24:10.326604 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322774    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 17:24:10.326604 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322777    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 17:24:10.326604 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322779    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 17:24:10.326604 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322782    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 17:24:10.326604 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322784    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 17:24:10.326604 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322787    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 17:24:10.326604 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322790    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 17:24:10.326604 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322793    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 17:24:10.326604 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322796    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 17:24:10.326604 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322799    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 17:24:10.326604 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322801    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 17:24:10.326604 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322804    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 17:24:10.326604 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322806    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 17:24:10.326604 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322809    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 17:24:10.326604 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322812    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 17:24:10.326604 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322814    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 17:24:10.327114 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322817    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 17:24:10.327114 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322819    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 17:24:10.327114 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322822    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 17:24:10.327114 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322824    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 17:24:10.327114 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322827    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 17:24:10.327114 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322830    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 17:24:10.327114 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322833    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 17:24:10.327114 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322836    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 17:24:10.327114 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322838    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 17:24:10.327114 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322841    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 17:24:10.327114 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322843    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 17:24:10.327114 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322846    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 17:24:10.327114 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.322851    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 17:24:10.327114 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322966    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 17:24:10.327114 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322971    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 17:24:10.327501 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322974    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 17:24:10.327501 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322977    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 17:24:10.327501 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322980    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 17:24:10.327501 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322983    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 17:24:10.327501 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322987    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 17:24:10.327501 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322990    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 17:24:10.327501 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322992    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 17:24:10.327501 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322996    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 17:24:10.327501 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.322999    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 17:24:10.327501 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323002    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 17:24:10.327501 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323005    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 17:24:10.327501 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323008    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 17:24:10.327501 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323011    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 17:24:10.327501 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323014    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 17:24:10.327501 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323017    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 17:24:10.327501 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323020    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 17:24:10.327501 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323023    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 17:24:10.327501 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323025    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 17:24:10.327501 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323028    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 17:24:10.327501 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323031    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 17:24:10.327995 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323034    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 17:24:10.327995 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323036    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 17:24:10.327995 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323039    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 17:24:10.327995 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323042    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 17:24:10.327995 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323045    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 17:24:10.327995 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323048    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 17:24:10.327995 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323051    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 17:24:10.327995 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323054    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 17:24:10.327995 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323056    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 17:24:10.327995 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323059    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 17:24:10.327995 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323061    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 17:24:10.327995 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323064    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 17:24:10.327995 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323066    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 17:24:10.327995 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323069    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 17:24:10.327995 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323071    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 17:24:10.327995 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323074    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 17:24:10.327995 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323076    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 17:24:10.327995 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323079    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 17:24:10.327995 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323081    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 17:24:10.327995 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323084    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 17:24:10.328508 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323087    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 17:24:10.328508 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323089    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 17:24:10.328508 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323092    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 17:24:10.328508 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323095    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 17:24:10.328508 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323097    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 17:24:10.328508 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323099    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 17:24:10.328508 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323102    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 17:24:10.328508 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323105    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 17:24:10.328508 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323108    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 17:24:10.328508 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323110    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 17:24:10.328508 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323113    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 17:24:10.328508 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323116    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 17:24:10.328508 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323118    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 17:24:10.328508 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323121    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 17:24:10.328508 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323123    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 17:24:10.328508 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323127    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 17:24:10.328508 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323129    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 17:24:10.328508 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323132    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 17:24:10.328508 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323134    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 17:24:10.328508 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323137    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 17:24:10.329027 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323140    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 17:24:10.329027 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323142    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 17:24:10.329027 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323146    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 17:24:10.329027 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323149    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 17:24:10.329027 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323152    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 17:24:10.329027 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323155    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 17:24:10.329027 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323158    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 17:24:10.329027 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323175    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 17:24:10.329027 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323182    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 17:24:10.329027 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323188    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 17:24:10.329027 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323191    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 17:24:10.329027 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323195    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 17:24:10.329027 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323198    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 17:24:10.329027 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323201    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 17:24:10.329027 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323204    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 17:24:10.329027 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323208    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 17:24:10.329027 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323211    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 17:24:10.329027 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323214    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 17:24:10.329475 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323217    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 17:24:10.329475 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323220    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 17:24:10.329475 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323224    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 17:24:10.329475 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323226    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 17:24:10.329475 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323229    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 17:24:10.329475 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323232    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 17:24:10.329475 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323235    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 17:24:10.329475 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323237    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 17:24:10.329475 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323240    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 17:24:10.329475 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323243    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 17:24:10.329475 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323245    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 17:24:10.329475 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323248    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 17:24:10.329475 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323250    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 17:24:10.329475 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323253    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 17:24:10.329475 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323255    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 17:24:10.329475 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323258    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 17:24:10.329475 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323260    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 17:24:10.329475 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323263    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 17:24:10.329475 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:10.323266    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 17:24:10.329926 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.323271    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 17:24:10.329926 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.323399    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 17 17:24:10.329926 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.325930    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 17 17:24:10.329926 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.327695    2576 server.go:1019] "Starting client certificate rotation"
Jul 17 17:24:10.329926 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.327803    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 17:24:10.329926 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.327858    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 17:24:10.330800 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.330786    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 17:24:10.333156 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.333142    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 17:24:10.344077 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.344048    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 17 17:24:10.346760 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.346744    2576 log.go:25] "Validated CRI v1 image API"
Jul 17 17:24:10.347542 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.347528    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 17 17:24:10.351019 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.350993    2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 da717dc1-88b6-4e5e-8846-a344c04b6fad:/dev/nvme0n1p4 ed3ebbf3-4236-4cd0-8b51-e1a6d41d30c8:/dev/nvme0n1p3]
Jul 17 17:24:10.351119 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.351016    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 17 17:24:10.356529 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.356509    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 17:24:10.357705 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.357555    2576 manager.go:216] Machine: {Timestamp:2026-07-17 17:24:10.356046663 +0000 UTC m=+0.374823253 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3088732 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27de6e3157de083eb64aab4ec94fa0 SystemUUID:ec27de6e-3157-de08-3eb6-4aab4ec94fa0 BootID:ef387ea4-82b1-48dc-9312-d0ae044e4977 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:16:3f:73:58:57 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:16:3f:73:58:57 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:04:90:94:f2:c5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 17 17:24:10.357705 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.357702    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 17 17:24:10.357851 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.357834    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 17 17:24:10.361469 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.361433    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 17 17:24:10.361614 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.361472    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-187.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 17 17:24:10.362318 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.362308    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 17 17:24:10.362357 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.362321    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 17 17:24:10.362357 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.362328    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 17:24:10.362357 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.362342    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 17:24:10.364365 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.364352    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 17 17:24:10.369031 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.369015    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 17:24:10.369181 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.369158    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 17 17:24:10.369226 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.369204    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 17 17:24:10.369226 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.369218    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 17 17:24:10.369297 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.369230    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 17 17:24:10.369297 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.369241    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 17 17:24:10.369297 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.369250    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 17 17:24:10.369659 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.369645    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 17:24:10.369695 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.369677    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 17:24:10.375288 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.375268    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 17 17:24:10.378042 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.378023    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 17 17:24:10.378147 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.378054    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 17 17:24:10.379142 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.379122    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nch84"
Jul 17 17:24:10.379570 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.379553    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 17 17:24:10.379653 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.379575    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 17 17:24:10.379653 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.379581    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 17 17:24:10.379653 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.379587    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 17 17:24:10.379653 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.379604    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 17 17:24:10.379653 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.379610    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 17 17:24:10.379653 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.379619    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 17 17:24:10.379653 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.379624    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 17 17:24:10.379653 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.379631    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 17 17:24:10.379653 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.379636    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 17 17:24:10.379921 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.379662    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 17 17:24:10.379921 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.379669    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 17 17:24:10.379921 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:10.379771    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 17 17:24:10.379921 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:10.379814    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 17 17:24:10.380574 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.380563    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 17 17:24:10.380574 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.380574    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 17 17:24:10.384028 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.384012    2576 server.go:1268] "Started kubelet"
Jul 17 17:24:10.384137 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.384110    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 17 17:24:10.384220 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.384114    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 17 17:24:10.384220 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.384212    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 17 17:24:10.384948 ip-10-0-143-187 systemd[1]: Started Kubernetes Kubelet.
Jul 17 17:24:10.389519 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.389489    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 17 17:24:10.392087 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.389838    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nch84"
Jul 17 17:24:10.392087 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:10.391148    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 17 17:24:10.392087 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.391853    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 17 17:24:10.395627 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.395606    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-187.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 17 17:24:10.396844 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:10.395708    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-187.ec2.internal.18c323a0ada428cc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-187.ec2.internal,UID:ip-10-0-143-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-187.ec2.internal,},FirstTimestamp:2026-07-17 17:24:10.38380462 +0000 UTC m=+0.402581210,LastTimestamp:2026-07-17 17:24:10.38380462 +0000 UTC m=+0.402581210,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-187.ec2.internal,}"
Jul 17 17:24:10.402704 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.402685    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 17 17:24:10.402704 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.402687    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 17 17:24:10.402862 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:10.402795    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-187.ec2.internal\" not found"
Jul 17 17:24:10.403577 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.403507    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 17 17:24:10.404096 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.403670    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 17 17:24:10.404096 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.403688    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 17 17:24:10.404096 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.403831    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 17 17:24:10.404096 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.403840    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 17 17:24:10.404096 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.403964    2576 factory.go:153] Registering CRI-O factory
Jul 17 17:24:10.404096 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.403983    2576 factory.go:223] Registration of the crio container factory successfully
Jul 17 17:24:10.404096 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.404047    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 17 17:24:10.404096 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.404058    2576 factory.go:55] Registering systemd factory
Jul 17 17:24:10.404096 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.404065    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 17 17:24:10.404096 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.404090    2576 factory.go:103] Registering Raw factory
Jul 17 17:24:10.404096 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.404104    2576 manager.go:1196] Started watching for new ooms in manager
Jul 17 17:24:10.404672 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.404657    2576 manager.go:349] Starting recovery of all containers
Jul 17 17:24:10.405941 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.405921    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 17:24:10.408608 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:10.408561    2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-187.ec2.internal\" not found" node="ip-10-0-143-187.ec2.internal"
Jul 17 17:24:10.414980 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.414957    2576 manager.go:354] Recovery completed
Jul 17 17:24:10.419748 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.419731    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 17:24:10.422831 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.422812    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 17:24:10.422916 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.422845    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 17:24:10.422916 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.422856    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientPID"
Jul 17 17:24:10.423464 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.423443    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 17 17:24:10.423464 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.423460    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 17 17:24:10.423619 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.423484    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 17:24:10.423619 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.423475    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 17:24:10.425670 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.425651    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 17:24:10.425766 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.425679    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 17:24:10.425766 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.425688    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientPID"
Jul 17 17:24:10.425822 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.425688    2576 policy_none.go:49] "None policy: Start"
Jul 17 17:24:10.425822 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.425792    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 17 17:24:10.425822 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.425805    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 17 17:24:10.427762 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.427750    2576 policy_none.go:47] "Start"
Jul 17 17:24:10.467086 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.466905    2576 manager.go:337] "Starting Device Plugin manager"
Jul 17 17:24:10.486369 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:10.467118    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 17 17:24:10.486369 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.467132    2576 server.go:87] "Starting device plugin registration server"
Jul 17 17:24:10.486369 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.467406    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 17 17:24:10.486369 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.467417    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 17 17:24:10.486369 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.467535    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 17 17:24:10.486369 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.467629    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 17 17:24:10.486369 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.467638    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 17 17:24:10.486369 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:10.469251    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 17 17:24:10.486369 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:10.469335    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-187.ec2.internal\" not found"
Jul 17 17:24:10.514325 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.514279    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 17 17:24:10.515590 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.515568    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 17 17:24:10.515590 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.515615    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 17 17:24:10.515846 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.515641    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 17 17:24:10.515846 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:10.515677    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 17 17:24:10.518199 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.518180    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 17:24:10.568479 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.568400    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 17:24:10.569472 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.569452    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 17:24:10.569563 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.569485    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 17:24:10.569563 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.569497    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientPID"
Jul 17 17:24:10.569563 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.569523    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-187.ec2.internal"
Jul 17 17:24:10.575524 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.575501    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-187.ec2.internal"
Jul 17 17:24:10.575609 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:10.575533    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-187.ec2.internal\": node \"ip-10-0-143-187.ec2.internal\" not found"
Jul 17 17:24:10.601056 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:10.601026    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-187.ec2.internal\" not found"
Jul 17 17:24:10.616102 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.616072    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal"]
Jul 17 17:24:10.616266 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.616141    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 17:24:10.617128 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.617109    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 17:24:10.617252 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.617138    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 17:24:10.617252 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.617149    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientPID"
Jul 17 17:24:10.619443 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.619431    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 17:24:10.619548 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.619534    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal"
Jul 17 17:24:10.619591 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.619564    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 17:24:10.620240 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.620221    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 17:24:10.620240 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.620234    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 17:24:10.620342 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.620253    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 17:24:10.620342 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.620253    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 17:24:10.620342 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.620269    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientPID"
Jul 17 17:24:10.620342 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.620278    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientPID"
Jul 17 17:24:10.622594 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.622571    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal"
Jul 17 17:24:10.622660 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.622607    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 17:24:10.623322 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.623309    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 17:24:10.623382 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.623337    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 17:24:10.623382 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.623354    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientPID"
Jul 17 17:24:10.645878 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:10.645848    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-187.ec2.internal\" not found" node="ip-10-0-143-187.ec2.internal"
Jul 17 17:24:10.650524 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:10.650503    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-187.ec2.internal\" not found" node="ip-10-0-143-187.ec2.internal"
Jul 17 17:24:10.701667 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:10.701629    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-187.ec2.internal\" not found"
Jul 17 17:24:10.706021 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.705997    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/055b2da4f7f1fd6f00b0fe6f11d1c89c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-187.ec2.internal\" (UID: \"055b2da4f7f1fd6f00b0fe6f11d1c89c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal"
Jul 17 17:24:10.706123 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.706029    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1398e302ef95386d2a9d899ad51d74f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal\" (UID: \"d1398e302ef95386d2a9d899ad51d74f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal"
Jul 17 17:24:10.706123 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.706052    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1398e302ef95386d2a9d899ad51d74f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal\" (UID: \"d1398e302ef95386d2a9d899ad51d74f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal"
Jul 17 17:24:10.802764 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:10.802723    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-187.ec2.internal\" not found"
Jul 17 17:24:10.807091 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.807069    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/055b2da4f7f1fd6f00b0fe6f11d1c89c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-187.ec2.internal\" (UID: \"055b2da4f7f1fd6f00b0fe6f11d1c89c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal"
Jul 17 17:24:10.807193 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.807102    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1398e302ef95386d2a9d899ad51d74f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal\" (UID: \"d1398e302ef95386d2a9d899ad51d74f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal"
Jul 17 17:24:10.807193 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.807121    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1398e302ef95386d2a9d899ad51d74f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal\" (UID: \"d1398e302ef95386d2a9d899ad51d74f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal"
Jul 17 17:24:10.807193 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.807177    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1398e302ef95386d2a9d899ad51d74f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal\" (UID: \"d1398e302ef95386d2a9d899ad51d74f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal"
Jul 17 17:24:10.807335 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.807211    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/055b2da4f7f1fd6f00b0fe6f11d1c89c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-187.ec2.internal\" (UID: \"055b2da4f7f1fd6f00b0fe6f11d1c89c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal"
Jul 17 17:24:10.807335 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.807226    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1398e302ef95386d2a9d899ad51d74f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal\" (UID: \"d1398e302ef95386d2a9d899ad51d74f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal"
Jul 17 17:24:10.903607 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:10.903517    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-187.ec2.internal\" not found"
Jul 17 17:24:10.948949 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.948924    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal"
Jul 17 17:24:10.954709 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:10.953899    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal"
Jul 17 17:24:11.003784 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:11.003738    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-187.ec2.internal\" not found"
Jul 17 17:24:11.104791 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:11.104740    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-187.ec2.internal\" not found"
Jul 17 17:24:11.210110 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:11.210075    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-187.ec2.internal\" not found"
Jul 17 17:24:11.310632 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:11.310576    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-187.ec2.internal\" not found"
Jul 17 17:24:11.326507 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.326467    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 17 17:24:11.326705 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.326683    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 17:24:11.326778 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.326754    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 17:24:11.366050 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.366023    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 17:24:11.370165 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.370143    2576 apiserver.go:52] "Watching apiserver"
Jul 17 17:24:11.378775 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.378752    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 17 17:24:11.379178 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.379151    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d","openshift-dns/node-resolver-v5dfj","openshift-network-diagnostics/network-check-target-f828l","openshift-network-operator/iptables-alerter-88wzw","openshift-ovn-kubernetes/ovnkube-node-2nlxt","kube-system/global-pull-secret-syncer-jdnds","openshift-cluster-node-tuning-operator/tuned-d24jk","openshift-image-registry/node-ca-4wnph","openshift-multus/multus-8zqpl","openshift-multus/multus-additional-cni-plugins-59gm6","openshift-multus/network-metrics-daemon-lmqqg","kube-system/konnectivity-agent-gtwmn"]
Jul 17 17:24:11.383017 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.382991    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.385628 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.385593    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 17 17:24:11.385778 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.385652    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vdvs5\""
Jul 17 17:24:11.385894 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.385805    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 17 17:24:11.385950 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.385919    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v5dfj"
Jul 17 17:24:11.386015 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.385999    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 17 17:24:11.388348 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.388328    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 17 17:24:11.388425 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.388360    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 17 17:24:11.388478 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.388461    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8tj6n\""
Jul 17 17:24:11.388928 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.388911    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:11.389010 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:11.388984    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f828l" podUID="bb26bbd0-dcaa-433b-90b2-fdf9a41181cc"
Jul 17 17:24:11.391839 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.391818    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-88wzw"
Jul 17 17:24:11.394859 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.394665    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 17 17:24:11.394859 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.394779    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 17 17:24:11.394859 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.394784    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 17 17:24:11.395087 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.394863    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7fz46\""
Jul 17 17:24:11.396822 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.395676    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.396822 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.396114    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 17:19:11 +0000 UTC" deadline="2028-02-19 02:44:35.093479695 +0000 UTC"
Jul 17 17:24:11.396822 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.396164    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13953h20m23.697320235s"
Jul 17 17:24:11.398754 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.398731    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 17 17:24:11.398844 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.398755    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b664h\""
Jul 17 17:24:11.399163 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.399146    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 17 17:24:11.399307 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.399288    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 17 17:24:11.399440 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.399424    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 17 17:24:11.399551 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.399534    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 17 17:24:11.399604 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.399593    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 17 17:24:11.399965 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.399947    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:11.400059 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:11.400036    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jdnds" podUID="9bed4dab-7c99-4599-b607-55672af77505"
Jul 17 17:24:11.402812 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.402796    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 17 17:24:11.402927 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.402902    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal"
Jul 17 17:24:11.403545 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.403499    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.405899 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.405870    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 17 17:24:11.405899 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.405891    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4szdp\""
Jul 17 17:24:11.406040 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.406007    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 17 17:24:11.406252 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.406231    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4wnph"
Jul 17 17:24:11.408817 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.408797    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 17 17:24:11.408928 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.408846    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5dwm4\""
Jul 17 17:24:11.408928 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.408941    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 17 17:24:11.409090 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.409067    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 17 17:24:11.409218 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.409198    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.410806 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.410773    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f47fbab7-f34f-40f8-b962-c7db86b31bf1-etc-selinux\") pod \"aws-ebs-csi-driver-node-ncw6d\" (UID: \"f47fbab7-f34f-40f8-b962-c7db86b31bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.410905 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.410815    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-var-lib-kubelet\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.410905 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.410838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f47fbab7-f34f-40f8-b962-c7db86b31bf1-socket-dir\") pod \"aws-ebs-csi-driver-node-ncw6d\" (UID: \"f47fbab7-f34f-40f8-b962-c7db86b31bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.410905 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.410890    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abb16003-f824-4b4d-9790-add424c54c3b-iptables-alerter-script\") pod \"iptables-alerter-88wzw\" (UID: \"abb16003-f824-4b4d-9790-add424c54c3b\") " pod="openshift-network-operator/iptables-alerter-88wzw"
Jul 17 17:24:11.411071 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.410923    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.411071 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.410943    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a3c90559-497c-41f7-9dfd-0a038dec0c80-serviceca\") pod \"node-ca-4wnph\" (UID: \"a3c90559-497c-41f7-9dfd-0a038dec0c80\") " pod="openshift-image-registry/node-ca-4wnph"
Jul 17 17:24:11.411071 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.410986    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea0cda67-da14-493a-b32a-f40756867f5e-hosts-file\") pod \"node-resolver-v5dfj\" (UID: \"ea0cda67-da14-493a-b32a-f40756867f5e\") " pod="openshift-dns/node-resolver-v5dfj"
Jul 17 17:24:11.411071 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411021    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-etc-sysconfig\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.411071 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411049    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-log-socket\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.411352 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411093    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f47fbab7-f34f-40f8-b962-c7db86b31bf1-sys-fs\") pod \"aws-ebs-csi-driver-node-ncw6d\" (UID: \"f47fbab7-f34f-40f8-b962-c7db86b31bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.411352 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411118    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-run-ovn\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.411352 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411171    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-run-openvswitch\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.411352 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411199    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dknkp\" (UniqueName: \"kubernetes.io/projected/cb20d9bf-f76d-47f0-8001-48af41809803-kube-api-access-dknkp\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.411352 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411226    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3c90559-497c-41f7-9dfd-0a038dec0c80-host\") pod \"node-ca-4wnph\" (UID: \"a3c90559-497c-41f7-9dfd-0a038dec0c80\") " pod="openshift-image-registry/node-ca-4wnph"
Jul 17 17:24:11.411352 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411271    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9bed4dab-7c99-4599-b607-55672af77505-kubelet-config\") pod \"global-pull-secret-syncer-jdnds\" (UID: \"9bed4dab-7c99-4599-b607-55672af77505\") " pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:11.411352 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411299    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f47fbab7-f34f-40f8-b962-c7db86b31bf1-device-dir\") pod \"aws-ebs-csi-driver-node-ncw6d\" (UID: \"f47fbab7-f34f-40f8-b962-c7db86b31bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.411352 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411330    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcbfm\" (UniqueName: \"kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm\") pod \"network-check-target-f828l\" (UID: \"bb26bbd0-dcaa-433b-90b2-fdf9a41181cc\") " pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:11.411728 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411356    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/937856ac-f137-4f6e-b269-a31455b4260e-tmp\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.411728 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411382    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cb20d9bf-f76d-47f0-8001-48af41809803-ovnkube-script-lib\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.411728 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411408    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-etc-sysctl-d\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.411728 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411453    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abb16003-f824-4b4d-9790-add424c54c3b-host-slash\") pod \"iptables-alerter-88wzw\" (UID: \"abb16003-f824-4b4d-9790-add424c54c3b\") " pod="openshift-network-operator/iptables-alerter-88wzw"
Jul 17 17:24:11.411728 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411476    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cb20d9bf-f76d-47f0-8001-48af41809803-ovn-node-metrics-cert\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.411728 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411501    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret\") pod \"global-pull-secret-syncer-jdnds\" (UID: \"9bed4dab-7c99-4599-b607-55672af77505\") " pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:11.411728 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411520    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f47fbab7-f34f-40f8-b962-c7db86b31bf1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ncw6d\" (UID: \"f47fbab7-f34f-40f8-b962-c7db86b31bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.411728 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411540    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-host-cni-netd\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.411728 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411547    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 17 17:24:11.411728 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411559    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnknn\" (UniqueName: \"kubernetes.io/projected/a3c90559-497c-41f7-9dfd-0a038dec0c80-kube-api-access-vnknn\") pod \"node-ca-4wnph\" (UID: \"a3c90559-497c-41f7-9dfd-0a038dec0c80\") " pod="openshift-image-registry/node-ca-4wnph"
Jul 17 17:24:11.411728 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411581    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-host\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.411728 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411603    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d76l\" (UniqueName: \"kubernetes.io/projected/937856ac-f137-4f6e-b269-a31455b4260e-kube-api-access-7d76l\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.411728 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-host-cni-bin\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.411728 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411648    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-run\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.411728 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411672    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/937856ac-f137-4f6e-b269-a31455b4260e-etc-tuned\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.411728 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411693    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-host-run-netns\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.411728 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411717    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-etc-sysctl-conf\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.412616 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411742    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89bhn\" (UniqueName: \"kubernetes.io/projected/abb16003-f824-4b4d-9790-add424c54c3b-kube-api-access-89bhn\") pod \"iptables-alerter-88wzw\" (UID: \"abb16003-f824-4b4d-9790-add424c54c3b\") " pod="openshift-network-operator/iptables-alerter-88wzw"
Jul 17 17:24:11.412616 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411779    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmm9h\" (UniqueName: \"kubernetes.io/projected/ea0cda67-da14-493a-b32a-f40756867f5e-kube-api-access-xmm9h\") pod \"node-resolver-v5dfj\" (UID: \"ea0cda67-da14-493a-b32a-f40756867f5e\") " pod="openshift-dns/node-resolver-v5dfj"
Jul 17 17:24:11.412616 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411812    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-lib-modules\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.412616 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-host-slash\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.412616 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411865    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-run-systemd\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.412616 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411901    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-etc-openvswitch\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.412616 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411935    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9bed4dab-7c99-4599-b607-55672af77505-dbus\") pod \"global-pull-secret-syncer-jdnds\" (UID: \"9bed4dab-7c99-4599-b607-55672af77505\") " pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:11.412616 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411942    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qvf5v\""
Jul 17 17:24:11.412616 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411969    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 17 17:24:11.412616 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411979    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 17 17:24:11.412616 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.411968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f47fbab7-f34f-40f8-b962-c7db86b31bf1-registration-dir\") pod \"aws-ebs-csi-driver-node-ncw6d\" (UID: \"f47fbab7-f34f-40f8-b962-c7db86b31bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.412616 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.412025    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-etc-kubernetes\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.412616 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.412087    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-systemd-units\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.412616 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.412112    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-var-lib-openvswitch\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.412616 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.412128    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-node-log\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.412616 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.412143    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cb20d9bf-f76d-47f0-8001-48af41809803-env-overrides\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.412616 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.412217    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-etc-modprobe-d\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.412616 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.412248    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-etc-systemd\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.413500 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.412272    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-sys\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.413500 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.412315    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-host-kubelet\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.413500 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.412342    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-host-run-ovn-kubernetes\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.413500 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.412381    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cb20d9bf-f76d-47f0-8001-48af41809803-ovnkube-config\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.413500 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.412414    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wsfg\" (UniqueName: \"kubernetes.io/projected/f47fbab7-f34f-40f8-b962-c7db86b31bf1-kube-api-access-9wsfg\") pod \"aws-ebs-csi-driver-node-ncw6d\" (UID: \"f47fbab7-f34f-40f8-b962-c7db86b31bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.413500 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.412460    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea0cda67-da14-493a-b32a-f40756867f5e-tmp-dir\") pod \"node-resolver-v5dfj\" (UID: \"ea0cda67-da14-493a-b32a-f40756867f5e\") " pod="openshift-dns/node-resolver-v5dfj"
Jul 17 17:24:11.413500 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.412592    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.413500 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.412874    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 17 17:24:11.415017 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.414993    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 17 17:24:11.415144 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.415080    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:11.415207 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:11.415155    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmqqg" podUID="c0e9fbee-bec3-4365-8511-247f8a0c3a0b"
Jul 17 17:24:11.415349 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.415329    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wxwbd\""
Jul 17 17:24:11.415423 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.415389    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 17:24:11.415782 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.415763    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 17 17:24:11.415897 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.415792    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal"
Jul 17 17:24:11.417475 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.417451    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 17:24:11.417988 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.417968    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal"]
Jul 17 17:24:11.418071 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.418036    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gtwmn"
Jul 17 17:24:11.420462 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.420442    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 17 17:24:11.420546 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.420524    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 17 17:24:11.420631 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.420606    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9d4rp\""
Jul 17 17:24:11.424585 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.424566    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 17:24:11.424747 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.424732    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal"]
Jul 17 17:24:11.436336 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.436315    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lcn69"
Jul 17 17:24:11.446092 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.446057    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lcn69"
Jul 17 17:24:11.504784 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.504753    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 17 17:24:11.512683 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.512655    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5s94\" (UniqueName: \"kubernetes.io/projected/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-kube-api-access-l5s94\") pod \"network-metrics-daemon-lmqqg\" (UID: \"c0e9fbee-bec3-4365-8511-247f8a0c3a0b\") " pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:11.512803 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.512696    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5acd1016-b254-462d-bccd-bcf5f1f69e61-agent-certs\") pod \"konnectivity-agent-gtwmn\" (UID: \"5acd1016-b254-462d-bccd-bcf5f1f69e61\") " pod="kube-system/konnectivity-agent-gtwmn"
Jul 17 17:24:11.512803 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.512734    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f47fbab7-f34f-40f8-b962-c7db86b31bf1-sys-fs\") pod \"aws-ebs-csi-driver-node-ncw6d\" (UID: \"f47fbab7-f34f-40f8-b962-c7db86b31bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.512803 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.512758    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-run-ovn\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.512803 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.512782    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-cnibin\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.512803 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.512804    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-run-openvswitch\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.513028 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.512823    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dknkp\" (UniqueName: \"kubernetes.io/projected/cb20d9bf-f76d-47f0-8001-48af41809803-kube-api-access-dknkp\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.513028 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.512857    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-run-ovn\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.513028 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.512870    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-run-openvswitch\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.513028 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.512897    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f47fbab7-f34f-40f8-b962-c7db86b31bf1-sys-fs\") pod \"aws-ebs-csi-driver-node-ncw6d\" (UID: \"f47fbab7-f34f-40f8-b962-c7db86b31bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.513028 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.512914    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-host-run-k8s-cni-cncf-io\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.513028 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.512936    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-os-release\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.513028 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.512960    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3c90559-497c-41f7-9dfd-0a038dec0c80-host\") pod \"node-ca-4wnph\" (UID: \"a3c90559-497c-41f7-9dfd-0a038dec0c80\") " pod="openshift-image-registry/node-ca-4wnph"
Jul 17 17:24:11.513028 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.512992    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3c90559-497c-41f7-9dfd-0a038dec0c80-host\") pod \"node-ca-4wnph\" (UID: \"a3c90559-497c-41f7-9dfd-0a038dec0c80\") " pod="openshift-image-registry/node-ca-4wnph"
Jul 17 17:24:11.513463 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513013    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9bed4dab-7c99-4599-b607-55672af77505-kubelet-config\") pod \"global-pull-secret-syncer-jdnds\" (UID: \"9bed4dab-7c99-4599-b607-55672af77505\") " pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:11.513463 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513082    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f47fbab7-f34f-40f8-b962-c7db86b31bf1-device-dir\") pod \"aws-ebs-csi-driver-node-ncw6d\" (UID: \"f47fbab7-f34f-40f8-b962-c7db86b31bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.513463 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513085    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9bed4dab-7c99-4599-b607-55672af77505-kubelet-config\") pod \"global-pull-secret-syncer-jdnds\" (UID: \"9bed4dab-7c99-4599-b607-55672af77505\") " pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:11.513463 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513115    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcbfm\" (UniqueName: \"kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm\") pod \"network-check-target-f828l\" (UID: \"bb26bbd0-dcaa-433b-90b2-fdf9a41181cc\") " pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:11.513463 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/937856ac-f137-4f6e-b269-a31455b4260e-tmp\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.513463 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513170    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cb20d9bf-f76d-47f0-8001-48af41809803-ovnkube-script-lib\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.513463 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513218    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-multus-cni-dir\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.513463 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513231    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f47fbab7-f34f-40f8-b962-c7db86b31bf1-device-dir\") pod \"aws-ebs-csi-driver-node-ncw6d\" (UID: \"f47fbab7-f34f-40f8-b962-c7db86b31bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.513463 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513241    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-host-var-lib-kubelet\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.513463 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513351    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-etc-sysctl-d\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.513463 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abb16003-f824-4b4d-9790-add424c54c3b-host-slash\") pod \"iptables-alerter-88wzw\" (UID: \"abb16003-f824-4b4d-9790-add424c54c3b\") " pod="openshift-network-operator/iptables-alerter-88wzw"
Jul 17 17:24:11.513463 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513394    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cb20d9bf-f76d-47f0-8001-48af41809803-ovn-node-metrics-cert\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.513463 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513411    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret\") pod \"global-pull-secret-syncer-jdnds\" (UID: \"9bed4dab-7c99-4599-b607-55672af77505\") " pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:11.513463 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513433    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-multus-conf-dir\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.513463 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513459    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxgxh\" (UniqueName: \"kubernetes.io/projected/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-kube-api-access-gxgxh\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.513463 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513484    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f47fbab7-f34f-40f8-b962-c7db86b31bf1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ncw6d\" (UID: \"f47fbab7-f34f-40f8-b962-c7db86b31bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.514280 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513529    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-host-cni-netd\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.514280 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:11.513543    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 17:24:11.514280 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513549    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnknn\" (UniqueName: \"kubernetes.io/projected/a3c90559-497c-41f7-9dfd-0a038dec0c80-kube-api-access-vnknn\") pod \"node-ca-4wnph\" (UID: \"a3c90559-497c-41f7-9dfd-0a038dec0c80\") " pod="openshift-image-registry/node-ca-4wnph"
Jul 17 17:24:11.514280 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513567    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-etc-sysctl-d\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.514280 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513572    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-host-run-multus-certs\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.514280 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:11.513635    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret podName:9bed4dab-7c99-4599-b607-55672af77505 nodeName:}" failed. No retries permitted until 2026-07-17 17:24:12.013608256 +0000 UTC m=+2.032384836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret") pod "global-pull-secret-syncer-jdnds" (UID: "9bed4dab-7c99-4599-b607-55672af77505") : object "kube-system"/"original-pull-secret" not registered
Jul 17 17:24:11.514280 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513643    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f47fbab7-f34f-40f8-b962-c7db86b31bf1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ncw6d\" (UID: \"f47fbab7-f34f-40f8-b962-c7db86b31bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.514280 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513656    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5acd1016-b254-462d-bccd-bcf5f1f69e61-konnectivity-ca\") pod \"konnectivity-agent-gtwmn\" (UID: \"5acd1016-b254-462d-bccd-bcf5f1f69e61\") " pod="kube-system/konnectivity-agent-gtwmn"
Jul 17 17:24:11.514280 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513686    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-host\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.514280 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513636    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-host-cni-netd\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.514280 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513714    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d76l\" (UniqueName: \"kubernetes.io/projected/937856ac-f137-4f6e-b269-a31455b4260e-kube-api-access-7d76l\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.514280 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513738    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-host-cni-bin\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.514280 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513762    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-etc-kubernetes\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.514280 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513781    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-host\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.514280 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513786    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.514280 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513818    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-host-cni-bin\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.514280 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513799    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 17 17:24:11.515107 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513837    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-run\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.515107 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513935    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cb20d9bf-f76d-47f0-8001-48af41809803-ovnkube-script-lib\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.515107 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513945    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-run\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.515107 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/937856ac-f137-4f6e-b269-a31455b4260e-etc-tuned\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.515107 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513955    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/abb16003-f824-4b4d-9790-add424c54c3b-host-slash\") pod \"iptables-alerter-88wzw\" (UID: \"abb16003-f824-4b4d-9790-add424c54c3b\") " pod="openshift-network-operator/iptables-alerter-88wzw"
Jul 17 17:24:11.515107 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.513987    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-host-run-netns\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.515107 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514061    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-system-cni-dir\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.515107 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514090    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.515107 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514064    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-host-run-netns\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.515107 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514122    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-etc-sysctl-conf\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.515107 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514187    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89bhn\" (UniqueName: \"kubernetes.io/projected/abb16003-f824-4b4d-9790-add424c54c3b-kube-api-access-89bhn\") pod \"iptables-alerter-88wzw\" (UID: \"abb16003-f824-4b4d-9790-add424c54c3b\") " pod="openshift-network-operator/iptables-alerter-88wzw"
Jul 17 17:24:11.515107 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514276    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-etc-sysctl-conf\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.515107 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514315    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-host-var-lib-cni-bin\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.515107 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514359    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-hostroot\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.515107 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514472    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-multus-daemon-config\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.515107 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514514    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmm9h\" (UniqueName: \"kubernetes.io/projected/ea0cda67-da14-493a-b32a-f40756867f5e-kube-api-access-xmm9h\") pod \"node-resolver-v5dfj\" (UID: \"ea0cda67-da14-493a-b32a-f40756867f5e\") " pod="openshift-dns/node-resolver-v5dfj"
Jul 17 17:24:11.515107 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514540    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-lib-modules\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.515990 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514560    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-host-slash\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.515990 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514600    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-run-systemd\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.515990 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514622    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-etc-openvswitch\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.515990 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514642    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9bed4dab-7c99-4599-b607-55672af77505-dbus\") pod \"global-pull-secret-syncer-jdnds\" (UID: \"9bed4dab-7c99-4599-b607-55672af77505\") " pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:11.515990 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514650    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-host-slash\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.515990 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514665    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f47fbab7-f34f-40f8-b962-c7db86b31bf1-registration-dir\") pod \"aws-ebs-csi-driver-node-ncw6d\" (UID: \"f47fbab7-f34f-40f8-b962-c7db86b31bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.515990 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514681    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-lib-modules\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.515990 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514686    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-etc-kubernetes\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.515990 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514717    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-etc-openvswitch\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.515990 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514729    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-run-systemd\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.515990 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514736    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-systemd-units\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.515990 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514777    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-systemd-units\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.515990 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514787    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-etc-kubernetes\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.515990 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-var-lib-openvswitch\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.515990 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514810    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9bed4dab-7c99-4599-b607-55672af77505-dbus\") pod \"global-pull-secret-syncer-jdnds\" (UID: \"9bed4dab-7c99-4599-b607-55672af77505\") " pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:11.515990 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-node-log\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.515990 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514831    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-var-lib-openvswitch\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.517010 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514828    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f47fbab7-f34f-40f8-b962-c7db86b31bf1-registration-dir\") pod \"aws-ebs-csi-driver-node-ncw6d\" (UID: \"f47fbab7-f34f-40f8-b962-c7db86b31bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.517010 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514867    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cb20d9bf-f76d-47f0-8001-48af41809803-env-overrides\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.517010 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514874    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-node-log\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.517010 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514908    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs\") pod \"network-metrics-daemon-lmqqg\" (UID: \"c0e9fbee-bec3-4365-8511-247f8a0c3a0b\") " pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:11.517010 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.514934    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-etc-modprobe-d\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.517010 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515000    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-etc-systemd\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.517010 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515006    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-etc-modprobe-d\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.517010 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515037    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-sys\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.517010 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515050    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-etc-systemd\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.517010 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515085    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-host-kubelet\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.517010 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515111    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-host-run-ovn-kubernetes\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.517010 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515150    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cb20d9bf-f76d-47f0-8001-48af41809803-ovnkube-config\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.517010 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515162    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-sys\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.517010 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515152    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-host-kubelet\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.517010 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515202    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4hts\" (UniqueName: \"kubernetes.io/projected/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-kube-api-access-v4hts\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.517010 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515236    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-host-run-ovn-kubernetes\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.517010 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515234    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wsfg\" (UniqueName: \"kubernetes.io/projected/f47fbab7-f34f-40f8-b962-c7db86b31bf1-kube-api-access-9wsfg\") pod \"aws-ebs-csi-driver-node-ncw6d\" (UID: \"f47fbab7-f34f-40f8-b962-c7db86b31bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.517770 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515282    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cb20d9bf-f76d-47f0-8001-48af41809803-env-overrides\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.517770 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515345    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea0cda67-da14-493a-b32a-f40756867f5e-tmp-dir\") pod \"node-resolver-v5dfj\" (UID: \"ea0cda67-da14-493a-b32a-f40756867f5e\") " pod="openshift-dns/node-resolver-v5dfj"
Jul 17 17:24:11.517770 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515407    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-os-release\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.517770 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515439    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.517770 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515500    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f47fbab7-f34f-40f8-b962-c7db86b31bf1-etc-selinux\") pod \"aws-ebs-csi-driver-node-ncw6d\" (UID: \"f47fbab7-f34f-40f8-b962-c7db86b31bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.517770 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515525    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-var-lib-kubelet\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.517770 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515585    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-cnibin\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.517770 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515600    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f47fbab7-f34f-40f8-b962-c7db86b31bf1-etc-selinux\") pod \"aws-ebs-csi-driver-node-ncw6d\" (UID: \"f47fbab7-f34f-40f8-b962-c7db86b31bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.517770 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515609    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-host-var-lib-cni-multus\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.517770 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515663    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-var-lib-kubelet\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.517770 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515747    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.517770 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515789    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cb20d9bf-f76d-47f0-8001-48af41809803-ovnkube-config\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.517770 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515798    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea0cda67-da14-493a-b32a-f40756867f5e-tmp-dir\") pod \"node-resolver-v5dfj\" (UID: \"ea0cda67-da14-493a-b32a-f40756867f5e\") " pod="openshift-dns/node-resolver-v5dfj"
Jul 17 17:24:11.517770 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515842    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f47fbab7-f34f-40f8-b962-c7db86b31bf1-socket-dir\") pod \"aws-ebs-csi-driver-node-ncw6d\" (UID: \"f47fbab7-f34f-40f8-b962-c7db86b31bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.517770 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515879    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abb16003-f824-4b4d-9790-add424c54c3b-iptables-alerter-script\") pod \"iptables-alerter-88wzw\" (UID: \"abb16003-f824-4b4d-9790-add424c54c3b\") " pod="openshift-network-operator/iptables-alerter-88wzw"
Jul 17 17:24:11.517770 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515926    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.517770 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515989    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f47fbab7-f34f-40f8-b962-c7db86b31bf1-socket-dir\") pod \"aws-ebs-csi-driver-node-ncw6d\" (UID: \"f47fbab7-f34f-40f8-b962-c7db86b31bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.518393 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.515982    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a3c90559-497c-41f7-9dfd-0a038dec0c80-serviceca\") pod \"node-ca-4wnph\" (UID: \"a3c90559-497c-41f7-9dfd-0a038dec0c80\") " pod="openshift-image-registry/node-ca-4wnph"
Jul 17 17:24:11.518393 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.516019    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.518393 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.516037    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-multus-socket-dir-parent\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.518393 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.516089    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea0cda67-da14-493a-b32a-f40756867f5e-hosts-file\") pod \"node-resolver-v5dfj\" (UID: \"ea0cda67-da14-493a-b32a-f40756867f5e\") " pod="openshift-dns/node-resolver-v5dfj"
Jul 17 17:24:11.518393 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.516117    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-etc-sysconfig\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.518393 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.516155    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-log-socket\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.518393 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.516180    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-system-cni-dir\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.518393 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.516225    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-cni-binary-copy\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.518393 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.516270    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-host-run-netns\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.518393 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.516382    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea0cda67-da14-493a-b32a-f40756867f5e-hosts-file\") pod \"node-resolver-v5dfj\" (UID: \"ea0cda67-da14-493a-b32a-f40756867f5e\") " pod="openshift-dns/node-resolver-v5dfj"
Jul 17 17:24:11.518393 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.516433    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/937856ac-f137-4f6e-b269-a31455b4260e-etc-sysconfig\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.518393 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.516472    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cb20d9bf-f76d-47f0-8001-48af41809803-log-socket\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.518393 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.516533    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a3c90559-497c-41f7-9dfd-0a038dec0c80-serviceca\") pod \"node-ca-4wnph\" (UID: \"a3c90559-497c-41f7-9dfd-0a038dec0c80\") " pod="openshift-image-registry/node-ca-4wnph"
Jul 17 17:24:11.518393 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.516564    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/abb16003-f824-4b4d-9790-add424c54c3b-iptables-alerter-script\") pod \"iptables-alerter-88wzw\" (UID: \"abb16003-f824-4b4d-9790-add424c54c3b\") " pod="openshift-network-operator/iptables-alerter-88wzw"
Jul 17 17:24:11.518393 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.517956    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/937856ac-f137-4f6e-b269-a31455b4260e-etc-tuned\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.518393 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.518026    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/937856ac-f137-4f6e-b269-a31455b4260e-tmp\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.518393 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.518120    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cb20d9bf-f76d-47f0-8001-48af41809803-ovn-node-metrics-cert\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.521477 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:11.521448    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 17:24:11.521593 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:11.521485    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 17:24:11.521593 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:11.521504    2576 projected.go:196] Error preparing data for projected volume kube-api-access-gcbfm for pod openshift-network-diagnostics/network-check-target-f828l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:24:11.521593 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:11.521577    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm podName:bb26bbd0-dcaa-433b-90b2-fdf9a41181cc nodeName:}" failed. No retries permitted until 2026-07-17 17:24:12.021557405 +0000 UTC m=+2.040333985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gcbfm" (UniqueName: "kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm") pod "network-check-target-f828l" (UID: "bb26bbd0-dcaa-433b-90b2-fdf9a41181cc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:24:11.524339 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.524311    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnknn\" (UniqueName: \"kubernetes.io/projected/a3c90559-497c-41f7-9dfd-0a038dec0c80-kube-api-access-vnknn\") pod \"node-ca-4wnph\" (UID: \"a3c90559-497c-41f7-9dfd-0a038dec0c80\") " pod="openshift-image-registry/node-ca-4wnph"
Jul 17 17:24:11.524506 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.524484    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wsfg\" (UniqueName: \"kubernetes.io/projected/f47fbab7-f34f-40f8-b962-c7db86b31bf1-kube-api-access-9wsfg\") pod \"aws-ebs-csi-driver-node-ncw6d\" (UID: \"f47fbab7-f34f-40f8-b962-c7db86b31bf1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.524627 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.524592    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dknkp\" (UniqueName: \"kubernetes.io/projected/cb20d9bf-f76d-47f0-8001-48af41809803-kube-api-access-dknkp\") pod \"ovnkube-node-2nlxt\" (UID: \"cb20d9bf-f76d-47f0-8001-48af41809803\") " pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.524820 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.524803    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d76l\" (UniqueName: \"kubernetes.io/projected/937856ac-f137-4f6e-b269-a31455b4260e-kube-api-access-7d76l\") pod \"tuned-d24jk\" (UID: \"937856ac-f137-4f6e-b269-a31455b4260e\") " pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.525092 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.525064    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89bhn\" (UniqueName: \"kubernetes.io/projected/abb16003-f824-4b4d-9790-add424c54c3b-kube-api-access-89bhn\") pod \"iptables-alerter-88wzw\" (UID: \"abb16003-f824-4b4d-9790-add424c54c3b\") " pod="openshift-network-operator/iptables-alerter-88wzw"
Jul 17 17:24:11.525244 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.525227    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmm9h\" (UniqueName: \"kubernetes.io/projected/ea0cda67-da14-493a-b32a-f40756867f5e-kube-api-access-xmm9h\") pod \"node-resolver-v5dfj\" (UID: \"ea0cda67-da14-493a-b32a-f40756867f5e\") " pod="openshift-dns/node-resolver-v5dfj"
Jul 17 17:24:11.577184 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:11.577126    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod055b2da4f7f1fd6f00b0fe6f11d1c89c.slice/crio-40c591ec9859a3faed54d369f39a108168a1c2b4bf135d8f6cac8951012cd976 WatchSource:0}: Error finding container 40c591ec9859a3faed54d369f39a108168a1c2b4bf135d8f6cac8951012cd976: Status 404 returned error can't find the container with id 40c591ec9859a3faed54d369f39a108168a1c2b4bf135d8f6cac8951012cd976
Jul 17 17:24:11.577775 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:11.577759    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1398e302ef95386d2a9d899ad51d74f.slice/crio-116981c1234b70b3cb475b2d3af2c069db8fd7bf9af8ba28a747d8b7009dd879 WatchSource:0}: Error finding container 116981c1234b70b3cb475b2d3af2c069db8fd7bf9af8ba28a747d8b7009dd879: Status 404 returned error can't find the container with id 116981c1234b70b3cb475b2d3af2c069db8fd7bf9af8ba28a747d8b7009dd879
Jul 17 17:24:11.583688 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.583664    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 17:24:11.616532 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.616501    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs\") pod \"network-metrics-daemon-lmqqg\" (UID: \"c0e9fbee-bec3-4365-8511-247f8a0c3a0b\") " pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:11.616532 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.616537    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4hts\" (UniqueName: \"kubernetes.io/projected/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-kube-api-access-v4hts\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.616772 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.616558    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-os-release\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.616772 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.616593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.616772 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.616620    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-cnibin\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.616772 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.616687    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-cnibin\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.616772 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:11.616696    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:24:11.616772 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.616711    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-os-release\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.616772 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.616721    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-host-var-lib-cni-multus\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.616772 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.616751    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-host-var-lib-cni-multus\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.616772 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:11.616774    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs podName:c0e9fbee-bec3-4365-8511-247f8a0c3a0b nodeName:}" failed. No retries permitted until 2026-07-17 17:24:12.116755615 +0000 UTC m=+2.135532197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs") pod "network-metrics-daemon-lmqqg" (UID: "c0e9fbee-bec3-4365-8511-247f8a0c3a0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:24:11.617236 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.616802    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.617236 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.616841    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-multus-socket-dir-parent\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.617236 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.616875    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-system-cni-dir\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.617236 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.616943    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-system-cni-dir\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.617236 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.616957    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-multus-socket-dir-parent\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.617236 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.616991    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-cni-binary-copy\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.617236 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617040    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-host-run-netns\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.617236 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617069    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5s94\" (UniqueName: \"kubernetes.io/projected/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-kube-api-access-l5s94\") pod \"network-metrics-daemon-lmqqg\" (UID: \"c0e9fbee-bec3-4365-8511-247f8a0c3a0b\") " pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:11.617236 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617098    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5acd1016-b254-462d-bccd-bcf5f1f69e61-agent-certs\") pod \"konnectivity-agent-gtwmn\" (UID: \"5acd1016-b254-462d-bccd-bcf5f1f69e61\") " pod="kube-system/konnectivity-agent-gtwmn"
Jul 17 17:24:11.617236 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617104    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-host-run-netns\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.617236 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617129    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-cnibin\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.617236 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617157    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-host-run-k8s-cni-cncf-io\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.617236 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617197    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-os-release\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.617236 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617217    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-cnibin\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.617962 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617291    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.617962 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617310    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-host-run-k8s-cni-cncf-io\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.617962 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617297    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-os-release\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.617962 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-multus-cni-dir\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.617962 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617377    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-host-var-lib-kubelet\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.617962 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617414    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.617962 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617420    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-multus-conf-dir\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.617962 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617416    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-multus-cni-dir\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.617962 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617442    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxgxh\" (UniqueName: \"kubernetes.io/projected/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-kube-api-access-gxgxh\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.617962 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617447    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-host-var-lib-kubelet\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.617962 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617466    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-host-run-multus-certs\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.617962 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617470    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-multus-conf-dir\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.617962 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617503    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5acd1016-b254-462d-bccd-bcf5f1f69e61-konnectivity-ca\") pod \"konnectivity-agent-gtwmn\" (UID: \"5acd1016-b254-462d-bccd-bcf5f1f69e61\") " pod="kube-system/konnectivity-agent-gtwmn"
Jul 17 17:24:11.617962 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617510    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-host-run-multus-certs\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.617962 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617559    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-etc-kubernetes\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.617962 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.617962 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617625    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-system-cni-dir\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.618833 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617647    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.618833 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617665    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-host-var-lib-cni-bin\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.618833 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617659    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-system-cni-dir\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.618833 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617625    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-etc-kubernetes\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.618833 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617687    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-hostroot\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.618833 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617714    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-multus-daemon-config\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.618833 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617743    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-hostroot\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.618833 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617798    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-host-var-lib-cni-bin\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.618833 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617811    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-cni-binary-copy\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.618833 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.617837    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.618833 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.618036    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5acd1016-b254-462d-bccd-bcf5f1f69e61-konnectivity-ca\") pod \"konnectivity-agent-gtwmn\" (UID: \"5acd1016-b254-462d-bccd-bcf5f1f69e61\") " pod="kube-system/konnectivity-agent-gtwmn"
Jul 17 17:24:11.618833 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.618043    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.618833 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.618151    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-multus-daemon-config\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.620511 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.620486    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5acd1016-b254-462d-bccd-bcf5f1f69e61-agent-certs\") pod \"konnectivity-agent-gtwmn\" (UID: \"5acd1016-b254-462d-bccd-bcf5f1f69e61\") " pod="kube-system/konnectivity-agent-gtwmn"
Jul 17 17:24:11.625183 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.625156    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4hts\" (UniqueName: \"kubernetes.io/projected/d6ad5407-4bb0-47b4-8f15-6c82b11d50c5-kube-api-access-v4hts\") pod \"multus-additional-cni-plugins-59gm6\" (UID: \"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5\") " pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.626044 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.626014    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5s94\" (UniqueName: \"kubernetes.io/projected/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-kube-api-access-l5s94\") pod \"network-metrics-daemon-lmqqg\" (UID: \"c0e9fbee-bec3-4365-8511-247f8a0c3a0b\") " pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:11.626351 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.626332    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxgxh\" (UniqueName: \"kubernetes.io/projected/9ad9862b-5fb6-4754-8e61-5f8fa0776be0-kube-api-access-gxgxh\") pod \"multus-8zqpl\" (UID: \"9ad9862b-5fb6-4754-8e61-5f8fa0776be0\") " pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.718277 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.718244    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d"
Jul 17 17:24:11.729399 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:11.729353    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf47fbab7_f34f_40f8_b962_c7db86b31bf1.slice/crio-3566302aba9dcbf879c10b55a7308dc037ab0a1d14af36c4f7fded480030d287 WatchSource:0}: Error finding container 3566302aba9dcbf879c10b55a7308dc037ab0a1d14af36c4f7fded480030d287: Status 404 returned error can't find the container with id 3566302aba9dcbf879c10b55a7308dc037ab0a1d14af36c4f7fded480030d287
Jul 17 17:24:11.734802 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.734777    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v5dfj"
Jul 17 17:24:11.742802 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.742781    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 17:24:11.743757 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:11.743731    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea0cda67_da14_493a_b32a_f40756867f5e.slice/crio-5159b40bc88b08abc8ff58420832a3e1cf0d215b11cb644e49d3469b67e39801 WatchSource:0}: Error finding container 5159b40bc88b08abc8ff58420832a3e1cf0d215b11cb644e49d3469b67e39801: Status 404 returned error can't find the container with id 5159b40bc88b08abc8ff58420832a3e1cf0d215b11cb644e49d3469b67e39801
Jul 17 17:24:11.753001 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.752978    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-88wzw"
Jul 17 17:24:11.757319 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.757299    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:11.763856 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:11.763817    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb16003_f824_4b4d_9790_add424c54c3b.slice/crio-69b24d389fcf04360f8f4d32c263ca9f17fbcfa406b9a0fb953ad984a8487736 WatchSource:0}: Error finding container 69b24d389fcf04360f8f4d32c263ca9f17fbcfa406b9a0fb953ad984a8487736: Status 404 returned error can't find the container with id 69b24d389fcf04360f8f4d32c263ca9f17fbcfa406b9a0fb953ad984a8487736
Jul 17 17:24:11.769312 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:11.769285    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb20d9bf_f76d_47f0_8001_48af41809803.slice/crio-4c2c346e95d52d2c78af07121446bad446fdd697d97dbbe3d88e94294f0c31ba WatchSource:0}: Error finding container 4c2c346e95d52d2c78af07121446bad446fdd697d97dbbe3d88e94294f0c31ba: Status 404 returned error can't find the container with id 4c2c346e95d52d2c78af07121446bad446fdd697d97dbbe3d88e94294f0c31ba
Jul 17 17:24:11.783803 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.783782    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d24jk"
Jul 17 17:24:11.793381 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:11.793355    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod937856ac_f137_4f6e_b269_a31455b4260e.slice/crio-7050c33fe4adc85f3880b12a4ea9094a7cce43100e128a2e7478293b06799bdb WatchSource:0}: Error finding container 7050c33fe4adc85f3880b12a4ea9094a7cce43100e128a2e7478293b06799bdb: Status 404 returned error can't find the container with id 7050c33fe4adc85f3880b12a4ea9094a7cce43100e128a2e7478293b06799bdb
Jul 17 17:24:11.794224 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.794162    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4wnph"
Jul 17 17:24:11.803882 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:11.803855    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3c90559_497c_41f7_9dfd_0a038dec0c80.slice/crio-1edf51fbc955196676b6868c2dd9f732b1d0aec99779e9117b05df259dc2cf27 WatchSource:0}: Error finding container 1edf51fbc955196676b6868c2dd9f732b1d0aec99779e9117b05df259dc2cf27: Status 404 returned error can't find the container with id 1edf51fbc955196676b6868c2dd9f732b1d0aec99779e9117b05df259dc2cf27
Jul 17 17:24:11.809406 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.809379    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8zqpl"
Jul 17 17:24:11.818389 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:11.818357    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ad9862b_5fb6_4754_8e61_5f8fa0776be0.slice/crio-65b53ac86f24598d1eea38c6943d9423e5454e79248c9f170bdd35d9c10d0db7 WatchSource:0}: Error finding container 65b53ac86f24598d1eea38c6943d9423e5454e79248c9f170bdd35d9c10d0db7: Status 404 returned error can't find the container with id 65b53ac86f24598d1eea38c6943d9423e5454e79248c9f170bdd35d9c10d0db7
Jul 17 17:24:11.834121 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.834091    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-59gm6"
Jul 17 17:24:11.839513 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:11.839486    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gtwmn"
Jul 17 17:24:11.844731 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:11.844706    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6ad5407_4bb0_47b4_8f15_6c82b11d50c5.slice/crio-4a3ce350c58bebabe25c3d5e2bc373a5171fcb7f4ce6325b844e9fbf270b8cf7 WatchSource:0}: Error finding container 4a3ce350c58bebabe25c3d5e2bc373a5171fcb7f4ce6325b844e9fbf270b8cf7: Status 404 returned error can't find the container with id 4a3ce350c58bebabe25c3d5e2bc373a5171fcb7f4ce6325b844e9fbf270b8cf7
Jul 17 17:24:12.021093 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:12.020982    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret\") pod \"global-pull-secret-syncer-jdnds\" (UID: \"9bed4dab-7c99-4599-b607-55672af77505\") " pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:12.021280 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:12.021154    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 17:24:12.021280 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:12.021247    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret podName:9bed4dab-7c99-4599-b607-55672af77505 nodeName:}" failed. No retries permitted until 2026-07-17 17:24:13.021225411 +0000 UTC m=+3.040002002 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret") pod "global-pull-secret-syncer-jdnds" (UID: "9bed4dab-7c99-4599-b607-55672af77505") : object "kube-system"/"original-pull-secret" not registered
Jul 17 17:24:12.122250 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:12.122171    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs\") pod \"network-metrics-daemon-lmqqg\" (UID: \"c0e9fbee-bec3-4365-8511-247f8a0c3a0b\") " pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:12.122438 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:12.122306    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:24:12.122438 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:12.122328    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcbfm\" (UniqueName: \"kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm\") pod \"network-check-target-f828l\" (UID: \"bb26bbd0-dcaa-433b-90b2-fdf9a41181cc\") " pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:12.122438 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:12.122381    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs podName:c0e9fbee-bec3-4365-8511-247f8a0c3a0b nodeName:}" failed. No retries permitted until 2026-07-17 17:24:13.122362355 +0000 UTC m=+3.141138944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs") pod "network-metrics-daemon-lmqqg" (UID: "c0e9fbee-bec3-4365-8511-247f8a0c3a0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:24:12.122596 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:12.122465    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 17:24:12.122596 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:12.122486    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 17:24:12.122596 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:12.122500    2576 projected.go:196] Error preparing data for projected volume kube-api-access-gcbfm for pod openshift-network-diagnostics/network-check-target-f828l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:24:12.122596 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:12.122556    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm podName:bb26bbd0-dcaa-433b-90b2-fdf9a41181cc nodeName:}" failed. No retries permitted until 2026-07-17 17:24:13.12253934 +0000 UTC m=+3.141315923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gcbfm" (UniqueName: "kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm") pod "network-check-target-f828l" (UID: "bb26bbd0-dcaa-433b-90b2-fdf9a41181cc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:24:12.266755 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:12.266504    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 17:24:12.454002 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:12.452309    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 17:19:12 +0000 UTC" deadline="2028-02-21 07:32:59.311890779 +0000 UTC"
Jul 17 17:24:12.454002 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:12.452351    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14006h8m46.859545146s"
Jul 17 17:24:12.502820 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:12.502577    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 17:24:12.536010 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:12.535931    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:12.536214 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:12.536129    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmqqg" podUID="c0e9fbee-bec3-4365-8511-247f8a0c3a0b"
Jul 17 17:24:12.536214 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:12.536201    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:12.536357 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:12.536306    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jdnds" podUID="9bed4dab-7c99-4599-b607-55672af77505"
Jul 17 17:24:12.553195 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:12.553062    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8zqpl" event={"ID":"9ad9862b-5fb6-4754-8e61-5f8fa0776be0","Type":"ContainerStarted","Data":"65b53ac86f24598d1eea38c6943d9423e5454e79248c9f170bdd35d9c10d0db7"}
Jul 17 17:24:12.576118 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:12.576067    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d24jk" event={"ID":"937856ac-f137-4f6e-b269-a31455b4260e","Type":"ContainerStarted","Data":"7050c33fe4adc85f3880b12a4ea9094a7cce43100e128a2e7478293b06799bdb"}
Jul 17 17:24:12.595346 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:12.595206    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt" event={"ID":"cb20d9bf-f76d-47f0-8001-48af41809803","Type":"ContainerStarted","Data":"4c2c346e95d52d2c78af07121446bad446fdd697d97dbbe3d88e94294f0c31ba"}
Jul 17 17:24:12.608308 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:12.608230    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-88wzw" event={"ID":"abb16003-f824-4b4d-9790-add424c54c3b","Type":"ContainerStarted","Data":"69b24d389fcf04360f8f4d32c263ca9f17fbcfa406b9a0fb953ad984a8487736"}
Jul 17 17:24:12.621362 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:12.621319    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v5dfj" event={"ID":"ea0cda67-da14-493a-b32a-f40756867f5e","Type":"ContainerStarted","Data":"5159b40bc88b08abc8ff58420832a3e1cf0d215b11cb644e49d3469b67e39801"}
Jul 17 17:24:12.646583 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:12.646535    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" event={"ID":"d1398e302ef95386d2a9d899ad51d74f","Type":"ContainerStarted","Data":"116981c1234b70b3cb475b2d3af2c069db8fd7bf9af8ba28a747d8b7009dd879"}
Jul 17 17:24:12.670367 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:12.670278    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal" event={"ID":"055b2da4f7f1fd6f00b0fe6f11d1c89c","Type":"ContainerStarted","Data":"40c591ec9859a3faed54d369f39a108168a1c2b4bf135d8f6cac8951012cd976"}
Jul 17 17:24:12.697638 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:12.697590    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gtwmn" event={"ID":"5acd1016-b254-462d-bccd-bcf5f1f69e61","Type":"ContainerStarted","Data":"e686144533c2e5910e67456353d3b274c9d4afd32373bbe8eca98477b8dce95c"}
Jul 17 17:24:12.721399 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:12.721071    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59gm6" event={"ID":"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5","Type":"ContainerStarted","Data":"4a3ce350c58bebabe25c3d5e2bc373a5171fcb7f4ce6325b844e9fbf270b8cf7"}
Jul 17 17:24:12.742556 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:12.742472    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4wnph" event={"ID":"a3c90559-497c-41f7-9dfd-0a038dec0c80","Type":"ContainerStarted","Data":"1edf51fbc955196676b6868c2dd9f732b1d0aec99779e9117b05df259dc2cf27"}
Jul 17 17:24:12.764650 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:12.764604    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d" event={"ID":"f47fbab7-f34f-40f8-b962-c7db86b31bf1","Type":"ContainerStarted","Data":"3566302aba9dcbf879c10b55a7308dc037ab0a1d14af36c4f7fded480030d287"}
Jul 17 17:24:13.031367 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:13.031268    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret\") pod \"global-pull-secret-syncer-jdnds\" (UID: \"9bed4dab-7c99-4599-b607-55672af77505\") " pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:13.031566 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:13.031480    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 17:24:13.031566 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:13.031563    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret podName:9bed4dab-7c99-4599-b607-55672af77505 nodeName:}" failed. No retries permitted until 2026-07-17 17:24:15.031531842 +0000 UTC m=+5.050308423 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret") pod "global-pull-secret-syncer-jdnds" (UID: "9bed4dab-7c99-4599-b607-55672af77505") : object "kube-system"/"original-pull-secret" not registered
Jul 17 17:24:13.131984 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:13.131936    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs\") pod \"network-metrics-daemon-lmqqg\" (UID: \"c0e9fbee-bec3-4365-8511-247f8a0c3a0b\") " pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:13.132193 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:13.132034    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcbfm\" (UniqueName: \"kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm\") pod \"network-check-target-f828l\" (UID: \"bb26bbd0-dcaa-433b-90b2-fdf9a41181cc\") " pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:13.132277 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:13.132241    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 17:24:13.132277 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:13.132266    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 17:24:13.132406 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:13.132281    2576 projected.go:196] Error preparing data for projected volume kube-api-access-gcbfm for pod openshift-network-diagnostics/network-check-target-f828l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:24:13.132406 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:13.132346    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm podName:bb26bbd0-dcaa-433b-90b2-fdf9a41181cc nodeName:}" failed. No retries permitted until 2026-07-17 17:24:15.132326298 +0000 UTC m=+5.151102880 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gcbfm" (UniqueName: "kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm") pod "network-check-target-f828l" (UID: "bb26bbd0-dcaa-433b-90b2-fdf9a41181cc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:24:13.132859 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:13.132789    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:24:13.132859 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:13.132853    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs podName:c0e9fbee-bec3-4365-8511-247f8a0c3a0b nodeName:}" failed. No retries permitted until 2026-07-17 17:24:15.13283465 +0000 UTC m=+5.151611232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs") pod "network-metrics-daemon-lmqqg" (UID: "c0e9fbee-bec3-4365-8511-247f8a0c3a0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:24:13.453388 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:13.453251    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 17:19:12 +0000 UTC" deadline="2027-12-17 23:29:02.953255793 +0000 UTC"
Jul 17 17:24:13.453388 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:13.453329    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12438h4m49.499931504s"
Jul 17 17:24:13.515994 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:13.515956    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:13.516493 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:13.516119    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f828l" podUID="bb26bbd0-dcaa-433b-90b2-fdf9a41181cc"
Jul 17 17:24:14.519483 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:14.519424    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:14.519994 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:14.519587    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jdnds" podUID="9bed4dab-7c99-4599-b607-55672af77505"
Jul 17 17:24:14.519994 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:14.519707    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:14.519994 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:14.519808    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmqqg" podUID="c0e9fbee-bec3-4365-8511-247f8a0c3a0b"
Jul 17 17:24:15.050484 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:15.050437    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret\") pod \"global-pull-secret-syncer-jdnds\" (UID: \"9bed4dab-7c99-4599-b607-55672af77505\") " pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:15.050687 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:15.050668    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 17:24:15.050797 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:15.050746    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret podName:9bed4dab-7c99-4599-b607-55672af77505 nodeName:}" failed. No retries permitted until 2026-07-17 17:24:19.050726013 +0000 UTC m=+9.069502598 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret") pod "global-pull-secret-syncer-jdnds" (UID: "9bed4dab-7c99-4599-b607-55672af77505") : object "kube-system"/"original-pull-secret" not registered
Jul 17 17:24:15.151979 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:15.151922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs\") pod \"network-metrics-daemon-lmqqg\" (UID: \"c0e9fbee-bec3-4365-8511-247f8a0c3a0b\") " pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:15.152217 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:15.152017    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcbfm\" (UniqueName: \"kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm\") pod \"network-check-target-f828l\" (UID: \"bb26bbd0-dcaa-433b-90b2-fdf9a41181cc\") " pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:15.152217 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:15.152192    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 17:24:15.152365 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:15.152232    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 17:24:15.152365 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:15.152248    2576 projected.go:196] Error preparing data for projected volume kube-api-access-gcbfm for pod openshift-network-diagnostics/network-check-target-f828l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:24:15.152365 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:15.152349    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm podName:bb26bbd0-dcaa-433b-90b2-fdf9a41181cc nodeName:}" failed. No retries permitted until 2026-07-17 17:24:19.152328685 +0000 UTC m=+9.171105278 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gcbfm" (UniqueName: "kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm") pod "network-check-target-f828l" (UID: "bb26bbd0-dcaa-433b-90b2-fdf9a41181cc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:24:15.152828 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:15.152804    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:24:15.152962 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:15.152865    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs podName:c0e9fbee-bec3-4365-8511-247f8a0c3a0b nodeName:}" failed. No retries permitted until 2026-07-17 17:24:19.152848756 +0000 UTC m=+9.171625340 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs") pod "network-metrics-daemon-lmqqg" (UID: "c0e9fbee-bec3-4365-8511-247f8a0c3a0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:24:15.516744 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:15.516701    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:15.516961 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:15.516852    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f828l" podUID="bb26bbd0-dcaa-433b-90b2-fdf9a41181cc"
Jul 17 17:24:16.516616 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:16.516570    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:16.517214 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:16.516731    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jdnds" podUID="9bed4dab-7c99-4599-b607-55672af77505"
Jul 17 17:24:16.517214 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:16.517155    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:16.517382 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:16.517292    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmqqg" podUID="c0e9fbee-bec3-4365-8511-247f8a0c3a0b"
Jul 17 17:24:17.516072 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:17.516029    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:17.516299 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:17.516218    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f828l" podUID="bb26bbd0-dcaa-433b-90b2-fdf9a41181cc"
Jul 17 17:24:18.517111 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:18.516537    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:18.517111 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:18.516687    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jdnds" podUID="9bed4dab-7c99-4599-b607-55672af77505"
Jul 17 17:24:18.517111 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:18.516806    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:18.517111 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:18.516956    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmqqg" podUID="c0e9fbee-bec3-4365-8511-247f8a0c3a0b"
Jul 17 17:24:19.088371 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:19.088320    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret\") pod \"global-pull-secret-syncer-jdnds\" (UID: \"9bed4dab-7c99-4599-b607-55672af77505\") " pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:19.088571 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:19.088498    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 17:24:19.088634 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:19.088587    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret podName:9bed4dab-7c99-4599-b607-55672af77505 nodeName:}" failed. No retries permitted until 2026-07-17 17:24:27.088563564 +0000 UTC m=+17.107340158 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret") pod "global-pull-secret-syncer-jdnds" (UID: "9bed4dab-7c99-4599-b607-55672af77505") : object "kube-system"/"original-pull-secret" not registered
Jul 17 17:24:19.189974 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:19.189560    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs\") pod \"network-metrics-daemon-lmqqg\" (UID: \"c0e9fbee-bec3-4365-8511-247f8a0c3a0b\") " pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:19.189974 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:19.189649    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcbfm\" (UniqueName: \"kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm\") pod \"network-check-target-f828l\" (UID: \"bb26bbd0-dcaa-433b-90b2-fdf9a41181cc\") " pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:19.189974 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:19.189720    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:24:19.189974 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:19.189809    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs podName:c0e9fbee-bec3-4365-8511-247f8a0c3a0b nodeName:}" failed. No retries permitted until 2026-07-17 17:24:27.189785466 +0000 UTC m=+17.208562059 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs") pod "network-metrics-daemon-lmqqg" (UID: "c0e9fbee-bec3-4365-8511-247f8a0c3a0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:24:19.189974 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:19.189839    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 17:24:19.189974 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:19.189861    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 17:24:19.189974 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:19.189876    2576 projected.go:196] Error preparing data for projected volume kube-api-access-gcbfm for pod openshift-network-diagnostics/network-check-target-f828l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:24:19.189974 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:19.189930    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm podName:bb26bbd0-dcaa-433b-90b2-fdf9a41181cc nodeName:}" failed. No retries permitted until 2026-07-17 17:24:27.189914038 +0000 UTC m=+17.208690620 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gcbfm" (UniqueName: "kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm") pod "network-check-target-f828l" (UID: "bb26bbd0-dcaa-433b-90b2-fdf9a41181cc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:24:19.516472 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:19.515884    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:19.516472 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:19.516042    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f828l" podUID="bb26bbd0-dcaa-433b-90b2-fdf9a41181cc"
Jul 17 17:24:20.518271 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:20.518022    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:20.518271 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:20.518149    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jdnds" podUID="9bed4dab-7c99-4599-b607-55672af77505"
Jul 17 17:24:20.518271 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:20.518272    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:20.518909 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:20.518416    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmqqg" podUID="c0e9fbee-bec3-4365-8511-247f8a0c3a0b"
Jul 17 17:24:21.515920 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:21.515874    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:21.516124 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:21.516050    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f828l" podUID="bb26bbd0-dcaa-433b-90b2-fdf9a41181cc"
Jul 17 17:24:22.516939 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:22.516593    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:22.516939 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:22.516743    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jdnds" podUID="9bed4dab-7c99-4599-b607-55672af77505"
Jul 17 17:24:22.517869 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:22.517747    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:22.518016 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:22.517946    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmqqg" podUID="c0e9fbee-bec3-4365-8511-247f8a0c3a0b"
Jul 17 17:24:23.516177 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:23.516121    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:23.516375 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:23.516277    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f828l" podUID="bb26bbd0-dcaa-433b-90b2-fdf9a41181cc"
Jul 17 17:24:24.516777 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:24.516743    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:24.517146 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:24.516849    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jdnds" podUID="9bed4dab-7c99-4599-b607-55672af77505"
Jul 17 17:24:24.517146 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:24.516902    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:24.517146 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:24.517026    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmqqg" podUID="c0e9fbee-bec3-4365-8511-247f8a0c3a0b"
Jul 17 17:24:25.516276 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:25.516230    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:25.516472 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:25.516376    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f828l" podUID="bb26bbd0-dcaa-433b-90b2-fdf9a41181cc"
Jul 17 17:24:26.516025 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:26.515989    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:26.516532 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:26.516128    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jdnds" podUID="9bed4dab-7c99-4599-b607-55672af77505"
Jul 17 17:24:26.516532 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:26.515989    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:26.516532 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:26.516413    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmqqg" podUID="c0e9fbee-bec3-4365-8511-247f8a0c3a0b"
Jul 17 17:24:27.153636 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:27.153596    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret\") pod \"global-pull-secret-syncer-jdnds\" (UID: \"9bed4dab-7c99-4599-b607-55672af77505\") " pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:27.153858 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:27.153764    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 17:24:27.153858 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:27.153829    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret podName:9bed4dab-7c99-4599-b607-55672af77505 nodeName:}" failed. No retries permitted until 2026-07-17 17:24:43.153812941 +0000 UTC m=+33.172589522 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret") pod "global-pull-secret-syncer-jdnds" (UID: "9bed4dab-7c99-4599-b607-55672af77505") : object "kube-system"/"original-pull-secret" not registered
Jul 17 17:24:27.254777 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:27.254737    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs\") pod \"network-metrics-daemon-lmqqg\" (UID: \"c0e9fbee-bec3-4365-8511-247f8a0c3a0b\") " pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:27.254943 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:27.254818    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcbfm\" (UniqueName: \"kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm\") pod \"network-check-target-f828l\" (UID: \"bb26bbd0-dcaa-433b-90b2-fdf9a41181cc\") " pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:27.254943 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:27.254908    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:24:27.254943 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:27.254941    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 17:24:27.255052 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:27.254962    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 17:24:27.255052 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:27.254973    2576 projected.go:196] Error preparing data for projected volume kube-api-access-gcbfm for pod openshift-network-diagnostics/network-check-target-f828l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:24:27.255052 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:27.254975    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs podName:c0e9fbee-bec3-4365-8511-247f8a0c3a0b nodeName:}" failed. No retries permitted until 2026-07-17 17:24:43.254958161 +0000 UTC m=+33.273734737 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs") pod "network-metrics-daemon-lmqqg" (UID: "c0e9fbee-bec3-4365-8511-247f8a0c3a0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:24:27.255052 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:27.255015    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm podName:bb26bbd0-dcaa-433b-90b2-fdf9a41181cc nodeName:}" failed. No retries permitted until 2026-07-17 17:24:43.255000133 +0000 UTC m=+33.273776710 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gcbfm" (UniqueName: "kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm") pod "network-check-target-f828l" (UID: "bb26bbd0-dcaa-433b-90b2-fdf9a41181cc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:24:27.516197 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:27.516138    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:27.516631 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:27.516270    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f828l" podUID="bb26bbd0-dcaa-433b-90b2-fdf9a41181cc"
Jul 17 17:24:28.516750 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:28.516711    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:28.517216 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:28.516865    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmqqg" podUID="c0e9fbee-bec3-4365-8511-247f8a0c3a0b"
Jul 17 17:24:28.517216 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:28.516923    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:28.517216 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:28.517040    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jdnds" podUID="9bed4dab-7c99-4599-b607-55672af77505"
Jul 17 17:24:29.516386 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:29.516160    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:29.516563 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:29.516485    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f828l" podUID="bb26bbd0-dcaa-433b-90b2-fdf9a41181cc"
Jul 17 17:24:30.517699 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:30.517666    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:30.518224 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:30.517772    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jdnds" podUID="9bed4dab-7c99-4599-b607-55672af77505"
Jul 17 17:24:30.518224 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:30.517870    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:30.518224 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:30.517977    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmqqg" podUID="c0e9fbee-bec3-4365-8511-247f8a0c3a0b"
Jul 17 17:24:31.516663 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:31.516631    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:31.516849 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:31.516741    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f828l" podUID="bb26bbd0-dcaa-433b-90b2-fdf9a41181cc"
Jul 17 17:24:32.516266 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:32.516223    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:32.516868 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:32.516228    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:32.516868 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:32.516358    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jdnds" podUID="9bed4dab-7c99-4599-b607-55672af77505"
Jul 17 17:24:32.516868 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:32.516456    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmqqg" podUID="c0e9fbee-bec3-4365-8511-247f8a0c3a0b"
Jul 17 17:24:32.835702 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:32.835656    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal" event={"ID":"055b2da4f7f1fd6f00b0fe6f11d1c89c","Type":"ContainerStarted","Data":"d29a43b0bf11f14558f697235896780e528dcfcd1d0f879ffa332f8c4c17856f"}
Jul 17 17:24:32.850964 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:32.850901    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal" podStartSLOduration=20.850877731 podStartE2EDuration="20.850877731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:24:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:24:32.850147279 +0000 UTC m=+22.868923878" watchObservedRunningTime="2026-07-17 17:24:32.850877731 +0000 UTC m=+22.869654540"
Jul 17 17:24:33.516362 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:33.516327    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:33.516904 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:33.516440    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f828l" podUID="bb26bbd0-dcaa-433b-90b2-fdf9a41181cc"
Jul 17 17:24:33.845885 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:33.845645    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d" event={"ID":"f47fbab7-f34f-40f8-b962-c7db86b31bf1","Type":"ContainerStarted","Data":"9cb856e98a42aba6f9f7b7a2fe011b40573d370caa875a34d59a43a260acb317"}
Jul 17 17:24:33.847470 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:33.847439    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8zqpl" event={"ID":"9ad9862b-5fb6-4754-8e61-5f8fa0776be0","Type":"ContainerStarted","Data":"0213d1ceec58819a4f75c1af27d9d25dd26d4342284032075625249bc87aeb04"}
Jul 17 17:24:33.849116 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:33.849078    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d24jk" event={"ID":"937856ac-f137-4f6e-b269-a31455b4260e","Type":"ContainerStarted","Data":"73e80dbaf76c39a16a623016a92dfcdf7d8fbd09ef7c6380542937ee0da518b6"}
Jul 17 17:24:33.852513 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:33.852485    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt" event={"ID":"cb20d9bf-f76d-47f0-8001-48af41809803","Type":"ContainerStarted","Data":"dc3f1f6ebc8634dab791e488fad79f4eda38c6d073ee5fc53cc24b1453bcc1b3"}
Jul 17 17:24:33.852632 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:33.852545    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt" event={"ID":"cb20d9bf-f76d-47f0-8001-48af41809803","Type":"ContainerStarted","Data":"ffe552e893e7cd79610bb8c0e7b6076e352677b988effd21448dc6a4acf38d60"}
Jul 17 17:24:33.852632 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:33.852590    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt" event={"ID":"cb20d9bf-f76d-47f0-8001-48af41809803","Type":"ContainerStarted","Data":"9d2f3f235c3018c5fc6070cfbf0399aa2055b90fd030a7b159c039c0a8f1a5cb"}
Jul 17 17:24:33.852632 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:33.852624    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt" event={"ID":"cb20d9bf-f76d-47f0-8001-48af41809803","Type":"ContainerStarted","Data":"3340dd2e0e5de177032585ff7f350c2dfbaf6058e71268711afb2b9575875dad"}
Jul 17 17:24:33.852756 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:33.852654    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt" event={"ID":"cb20d9bf-f76d-47f0-8001-48af41809803","Type":"ContainerStarted","Data":"545f68eba97ca4c0e40c97f164df248cf565bd124bc7819d0c245b27f0d871fc"}
Jul 17 17:24:33.852756 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:33.852690    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt" event={"ID":"cb20d9bf-f76d-47f0-8001-48af41809803","Type":"ContainerStarted","Data":"da25745540858203d0fb4adb6ba03874415ccd1e093c53bbd72562cb56345de5"}
Jul 17 17:24:33.853750 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:33.853730    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v5dfj" event={"ID":"ea0cda67-da14-493a-b32a-f40756867f5e","Type":"ContainerStarted","Data":"0feab4c7ab313018cd6ceed0cd862a9025d43cdfe86d10a96f42ae900a96306d"}
Jul 17 17:24:33.855238 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:33.855216    2576 generic.go:356] "Generic (PLEG): container finished" podID="d1398e302ef95386d2a9d899ad51d74f" containerID="c3bba0025d4bf61035afdd0076d1a5a24cefd52adf9bd6857c2b69ea6dd2733d" exitCode=0
Jul 17 17:24:33.855327 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:33.855291    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" event={"ID":"d1398e302ef95386d2a9d899ad51d74f","Type":"ContainerDied","Data":"c3bba0025d4bf61035afdd0076d1a5a24cefd52adf9bd6857c2b69ea6dd2733d"}
Jul 17 17:24:33.856648 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:33.856631    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gtwmn" event={"ID":"5acd1016-b254-462d-bccd-bcf5f1f69e61","Type":"ContainerStarted","Data":"da924cd21349e35e08268a19c1e9f7b77426d6a8a964387db64a75919ad8bb30"}
Jul 17 17:24:33.858258 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:33.858231    2576 generic.go:356] "Generic (PLEG): container finished" podID="d6ad5407-4bb0-47b4-8f15-6c82b11d50c5" containerID="8b10830b69702829f184219527436bb1a6fff13653c2562c57794584d26d0dc8" exitCode=0
Jul 17 17:24:33.858346 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:33.858269    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59gm6" event={"ID":"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5","Type":"ContainerDied","Data":"8b10830b69702829f184219527436bb1a6fff13653c2562c57794584d26d0dc8"}
Jul 17 17:24:33.859743 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:33.859720    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4wnph" event={"ID":"a3c90559-497c-41f7-9dfd-0a038dec0c80","Type":"ContainerStarted","Data":"b17e2e5047f7051091e106b311aee18f68391b1b8ba84710bb1022947d9b0c7f"}
Jul 17 17:24:33.867884 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:33.867843    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8zqpl" podStartSLOduration=1.9540341319999999 podStartE2EDuration="22.867830417s" totalImagesPullingTime="20.913796285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:24:33.867799891 +0000 UTC m=+23.886576490" watchObservedRunningTime="2026-07-17 17:24:33.867830417 +0000 UTC m=+23.886607015"
Jul 17 17:24:33.898500 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:33.898448    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4wnph" podStartSLOduration=5.701158448 podStartE2EDuration="22.898426963s" totalImagesPullingTime="17.197268515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:24:33.897916512 +0000 UTC m=+23.916693112" watchObservedRunningTime="2026-07-17 17:24:33.898426963 +0000 UTC m=+23.917203562"
Jul 17 17:24:33.938182 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:33.938105    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v5dfj" podStartSLOduration=2.013535131 podStartE2EDuration="22.938081686s" totalImagesPullingTime="20.924546555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:24:33.937332911 +0000 UTC m=+23.956109510" watchObservedRunningTime="2026-07-17 17:24:33.938081686 +0000 UTC m=+23.956858285"
Jul 17 17:24:33.956774 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:33.956719    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-d24jk" podStartSLOduration=2.065288779 podStartE2EDuration="22.956697725s" totalImagesPullingTime="20.891408946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:24:33.95658391 +0000 UTC m=+23.975360510" watchObservedRunningTime="2026-07-17 17:24:33.956697725 +0000 UTC m=+23.975474325"
Jul 17 17:24:33.975466 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:33.975422    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gtwmn" podStartSLOduration=2.152013993 podStartE2EDuration="22.975407032s" totalImagesPullingTime="20.823393039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:24:33.975082967 +0000 UTC m=+23.993859565" watchObservedRunningTime="2026-07-17 17:24:33.975407032 +0000 UTC m=+23.994183629"
Jul 17 17:24:34.054513 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:34.054473    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:34.077411 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:34.077376    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gtwmn"
Jul 17 17:24:34.078105 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:34.078085    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gtwmn"
Jul 17 17:24:34.127585 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:34.127540    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:34.516450 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:34.516414    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:34.516944 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:34.516531    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmqqg" podUID="c0e9fbee-bec3-4365-8511-247f8a0c3a0b"
Jul 17 17:24:34.516944 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:34.516582    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:34.516944 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:34.516670    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jdnds" podUID="9bed4dab-7c99-4599-b607-55672af77505"
Jul 17 17:24:34.531905 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:34.531880    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 17 17:24:34.865618 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:34.865582    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d" event={"ID":"f47fbab7-f34f-40f8-b962-c7db86b31bf1","Type":"ContainerStarted","Data":"1373fe3d3f459999b2222c5fd6485e382c9d45a182091473af08e40ff742aa3b"}
Jul 17 17:24:34.867047 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:34.867018    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-88wzw" event={"ID":"abb16003-f824-4b4d-9790-add424c54c3b","Type":"ContainerStarted","Data":"add2d1611af2192ea5d9aac03ea0eaa5e282ef5253796c9bd7b2a86c0387a669"}
Jul 17 17:24:34.868676 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:34.868653    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" event={"ID":"d1398e302ef95386d2a9d899ad51d74f","Type":"ContainerStarted","Data":"76565a5c30af2add6ee562585de3cca32273d0fab0d8c5d05b21bac45ad05c6b"}
Jul 17 17:24:34.881420 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:34.881359    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-88wzw" podStartSLOduration=2.966644643 podStartE2EDuration="23.881344523s" totalImagesPullingTime="20.91469988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:24:34.881093749 +0000 UTC m=+24.899870347" watchObservedRunningTime="2026-07-17 17:24:34.881344523 +0000 UTC m=+24.900121121"
Jul 17 17:24:34.895671 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:34.895618    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" podStartSLOduration=22.89560155 podStartE2EDuration="22.89560155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:24:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:24:34.895221708 +0000 UTC m=+24.913998308" watchObservedRunningTime="2026-07-17 17:24:34.89560155 +0000 UTC m=+24.914378147"
Jul 17 17:24:35.000254 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:35.000215    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:35.061274 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:35.061242    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:35.481354 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:35.481233    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T17:24:34.531898659Z","UUID":"6381c016-ad37-4c47-9422-31699d2b0dde","Handler":null,"Name":"","Endpoint":""}
Jul 17 17:24:35.482881 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:35.482734    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 17 17:24:35.482881 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:35.482772    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 17 17:24:35.516767 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:35.516734    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:35.517287 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:35.516832    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f828l" podUID="bb26bbd0-dcaa-433b-90b2-fdf9a41181cc"
Jul 17 17:24:35.874537 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:35.874506    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt" event={"ID":"cb20d9bf-f76d-47f0-8001-48af41809803","Type":"ContainerStarted","Data":"60d0e3fa60c942734cb205a277d6a13b4e527b7bd28fcda116458d86eae29848"}
Jul 17 17:24:35.874812 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:35.874794    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 17 17:24:36.517222 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:36.517185    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:36.517740 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:36.517334    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jdnds" podUID="9bed4dab-7c99-4599-b607-55672af77505"
Jul 17 17:24:36.517740 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:36.517384    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:36.517740 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:36.517516    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmqqg" podUID="c0e9fbee-bec3-4365-8511-247f8a0c3a0b"
Jul 17 17:24:36.878975 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:36.878883    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d" event={"ID":"f47fbab7-f34f-40f8-b962-c7db86b31bf1","Type":"ContainerStarted","Data":"d86a4209ae3a10912c2df956d9990d4e9f8b8d55e8bc95e1ddece843e8d47dd1"}
Jul 17 17:24:36.896034 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:36.895975    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ncw6d" podStartSLOduration=2.071486199 podStartE2EDuration="25.895960455s" totalImagesPullingTime="23.824474256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:24:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:24:36.895738172 +0000 UTC m=+26.914514784" watchObservedRunningTime="2026-07-17 17:24:36.895960455 +0000 UTC m=+26.914737052"
Jul 17 17:24:37.516615 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:37.516575    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:37.516803 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:37.516700    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f828l" podUID="bb26bbd0-dcaa-433b-90b2-fdf9a41181cc"
Jul 17 17:24:38.516135 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:38.516099    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:38.516135 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:38.516122    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:38.516645 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:38.516233    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jdnds" podUID="9bed4dab-7c99-4599-b607-55672af77505"
Jul 17 17:24:38.516645 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:38.516384    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmqqg" podUID="c0e9fbee-bec3-4365-8511-247f8a0c3a0b"
Jul 17 17:24:39.363613 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:39.363193    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:39.438409 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:39.438378    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:39.516782 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:39.516759    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:39.517371 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:39.516857    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f828l" podUID="bb26bbd0-dcaa-433b-90b2-fdf9a41181cc"
Jul 17 17:24:39.630157 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:39.630126    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gtwmn"
Jul 17 17:24:39.630310 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:39.630271    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 17 17:24:39.630930 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:39.630907    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gtwmn"
Jul 17 17:24:39.696316 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:39.696288    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:39.889399 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:39.889034    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt" event={"ID":"cb20d9bf-f76d-47f0-8001-48af41809803","Type":"ContainerStarted","Data":"3f76b9527cf9888875749979e35684dbd2958d87228f8b1e00feccbe9c9e5765"}
Jul 17 17:24:39.889399 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:39.889379    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:39.889625 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:39.889428    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:39.894346 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:39.894318    2576 generic.go:356] "Generic (PLEG): container finished" podID="d6ad5407-4bb0-47b4-8f15-6c82b11d50c5" containerID="422220d45c1dd19095e35237d3e4ad6359b518ef2b98ffcdb8c98bbe68d83d7a" exitCode=0
Jul 17 17:24:39.894525 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:39.894397    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59gm6" event={"ID":"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5","Type":"ContainerDied","Data":"422220d45c1dd19095e35237d3e4ad6359b518ef2b98ffcdb8c98bbe68d83d7a"}
Jul 17 17:24:39.906754 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:39.906730    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:39.920239 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:39.920208    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:39.924337 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:39.924299    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt" podStartSLOduration=7.952740311 podStartE2EDuration="28.924285004s" totalImagesPullingTime="20.971544693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:24:39.922150936 +0000 UTC m=+29.940927533" watchObservedRunningTime="2026-07-17 17:24:39.924285004 +0000 UTC m=+29.943061602"
Jul 17 17:24:40.011085 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:40.011044    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:40.116266 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:40.116237    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:40.199223 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:40.199093    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:40.293745 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:40.293710    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:40.517608 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:40.517575    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:40.518281 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:40.517688    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jdnds" podUID="9bed4dab-7c99-4599-b607-55672af77505"
Jul 17 17:24:40.518281 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:40.517742    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:40.518281 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:40.517874    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmqqg" podUID="c0e9fbee-bec3-4365-8511-247f8a0c3a0b"
Jul 17 17:24:40.874583 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:40.874495    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:40.897457 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:40.897429    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:40.912772 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:40.912742    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:24:40.927445 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:40.927402    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:41.277549 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:41.277506    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:41.373041 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:41.373001    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:41.516680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:41.516646    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:41.516926 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:41.516775    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f828l" podUID="bb26bbd0-dcaa-433b-90b2-fdf9a41181cc"
Jul 17 17:24:41.618917 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:41.618884    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jdnds"]
Jul 17 17:24:41.619469 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:41.619022    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:41.619469 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:41.619115    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jdnds" podUID="9bed4dab-7c99-4599-b607-55672af77505"
Jul 17 17:24:41.619691 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:41.619667    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lmqqg"]
Jul 17 17:24:41.619804 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:41.619787    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:41.620015 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:41.619994    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmqqg" podUID="c0e9fbee-bec3-4365-8511-247f8a0c3a0b"
Jul 17 17:24:41.620374 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:41.620357    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f828l"]
Jul 17 17:24:41.901259 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:41.901224    2576 generic.go:356] "Generic (PLEG): container finished" podID="d6ad5407-4bb0-47b4-8f15-6c82b11d50c5" containerID="bc2381f4477a98205c3eb9bab212d1cde5dda5cdc6decbefce4ef43ed77f3b6d" exitCode=0
Jul 17 17:24:41.901452 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:41.901300    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:41.901452 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:41.901306    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59gm6" event={"ID":"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5","Type":"ContainerDied","Data":"bc2381f4477a98205c3eb9bab212d1cde5dda5cdc6decbefce4ef43ed77f3b6d"}
Jul 17 17:24:41.901577 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:41.901528    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f828l" podUID="bb26bbd0-dcaa-433b-90b2-fdf9a41181cc"
Jul 17 17:24:43.182145 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:43.182102    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret\") pod \"global-pull-secret-syncer-jdnds\" (UID: \"9bed4dab-7c99-4599-b607-55672af77505\") " pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:43.182575 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:43.182261    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 17:24:43.182575 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:43.182344    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret podName:9bed4dab-7c99-4599-b607-55672af77505 nodeName:}" failed. No retries permitted until 2026-07-17 17:25:15.182322365 +0000 UTC m=+65.201098961 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret") pod "global-pull-secret-syncer-jdnds" (UID: "9bed4dab-7c99-4599-b607-55672af77505") : object "kube-system"/"original-pull-secret" not registered
Jul 17 17:24:43.283011 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:43.282981    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcbfm\" (UniqueName: \"kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm\") pod \"network-check-target-f828l\" (UID: \"bb26bbd0-dcaa-433b-90b2-fdf9a41181cc\") " pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:43.283214 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:43.283037    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs\") pod \"network-metrics-daemon-lmqqg\" (UID: \"c0e9fbee-bec3-4365-8511-247f8a0c3a0b\") " pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:43.283214 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:43.283127    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:24:43.283214 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:43.283135    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 17:24:43.283214 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:43.283155    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 17:24:43.283445 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:43.283216    2576 projected.go:196] Error preparing data for projected volume kube-api-access-gcbfm for pod openshift-network-diagnostics/network-check-target-f828l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:24:43.283445 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:43.283248    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs podName:c0e9fbee-bec3-4365-8511-247f8a0c3a0b nodeName:}" failed. No retries permitted until 2026-07-17 17:25:15.283233377 +0000 UTC m=+65.302009967 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs") pod "network-metrics-daemon-lmqqg" (UID: "c0e9fbee-bec3-4365-8511-247f8a0c3a0b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:24:43.283445 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:43.283264    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm podName:bb26bbd0-dcaa-433b-90b2-fdf9a41181cc nodeName:}" failed. No retries permitted until 2026-07-17 17:25:15.283257629 +0000 UTC m=+65.302034204 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gcbfm" (UniqueName: "kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm") pod "network-check-target-f828l" (UID: "bb26bbd0-dcaa-433b-90b2-fdf9a41181cc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:24:43.516046 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:43.515996    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:43.516251 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:43.516025    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:43.516251 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:43.516124    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:43.516251 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:43.516130    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f828l" podUID="bb26bbd0-dcaa-433b-90b2-fdf9a41181cc"
Jul 17 17:24:43.516251 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:43.516226    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jdnds" podUID="9bed4dab-7c99-4599-b607-55672af77505"
Jul 17 17:24:43.516429 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:43.516316    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmqqg" podUID="c0e9fbee-bec3-4365-8511-247f8a0c3a0b"
Jul 17 17:24:43.907891 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:43.907851    2576 generic.go:356] "Generic (PLEG): container finished" podID="d6ad5407-4bb0-47b4-8f15-6c82b11d50c5" containerID="b7c038f9191fb62acd843cff8b986bffb5dba3dc82bf833ae7d1962ea7d16b4f" exitCode=0
Jul 17 17:24:43.908088 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:43.907903    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59gm6" event={"ID":"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5","Type":"ContainerDied","Data":"b7c038f9191fb62acd843cff8b986bffb5dba3dc82bf833ae7d1962ea7d16b4f"}
Jul 17 17:24:45.516739 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:45.516537    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:45.517190 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:45.516570    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:45.517190 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:45.516957    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jdnds" podUID="9bed4dab-7c99-4599-b607-55672af77505"
Jul 17 17:24:45.517190 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:45.516837    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f828l" podUID="bb26bbd0-dcaa-433b-90b2-fdf9a41181cc"
Jul 17 17:24:45.517190 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:45.516594    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:45.517190 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:45.517078    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lmqqg" podUID="c0e9fbee-bec3-4365-8511-247f8a0c3a0b"
Jul 17 17:24:46.772455 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.772422    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeReady"
Jul 17 17:24:46.772930 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.772591    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 17 17:24:46.819792 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.819758    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b6srd"]
Jul 17 17:24:46.823287 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.823269    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hndwr"]
Jul 17 17:24:46.823406 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.823387    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b6srd"
Jul 17 17:24:46.826182 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.825925    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 17 17:24:46.826182 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.825975    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-smb8x\""
Jul 17 17:24:46.827760 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.827739    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 17 17:24:46.830133 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.830113    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hndwr"
Jul 17 17:24:46.831296 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.831277    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hndwr"]
Jul 17 17:24:46.833908 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.832724    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 17 17:24:46.833908 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.832788    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 17 17:24:46.833908 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.832803    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mcwhs\""
Jul 17 17:24:46.833908 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.833611    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 17 17:24:46.834737 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.834483    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b6srd"]
Jul 17 17:24:46.909286 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.909253    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjfml\" (UniqueName: \"kubernetes.io/projected/dea89e0b-2f80-4f56-a41b-707e580fca42-kube-api-access-fjfml\") pod \"ingress-canary-hndwr\" (UID: \"dea89e0b-2f80-4f56-a41b-707e580fca42\") " pod="openshift-ingress-canary/ingress-canary-hndwr"
Jul 17 17:24:46.909286 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.909290    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dea89e0b-2f80-4f56-a41b-707e580fca42-cert\") pod \"ingress-canary-hndwr\" (UID: \"dea89e0b-2f80-4f56-a41b-707e580fca42\") " pod="openshift-ingress-canary/ingress-canary-hndwr"
Jul 17 17:24:46.909584 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.909343    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b45e0ab-c974-4125-af1b-72d77697f266-metrics-tls\") pod \"dns-default-b6srd\" (UID: \"8b45e0ab-c974-4125-af1b-72d77697f266\") " pod="openshift-dns/dns-default-b6srd"
Jul 17 17:24:46.909584 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.909365    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8b45e0ab-c974-4125-af1b-72d77697f266-config-volume\") pod \"dns-default-b6srd\" (UID: \"8b45e0ab-c974-4125-af1b-72d77697f266\") " pod="openshift-dns/dns-default-b6srd"
Jul 17 17:24:46.909584 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.909384    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b45e0ab-c974-4125-af1b-72d77697f266-tmp-dir\") pod \"dns-default-b6srd\" (UID: \"8b45e0ab-c974-4125-af1b-72d77697f266\") " pod="openshift-dns/dns-default-b6srd"
Jul 17 17:24:46.909584 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.909488    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxt88\" (UniqueName: \"kubernetes.io/projected/8b45e0ab-c974-4125-af1b-72d77697f266-kube-api-access-dxt88\") pod \"dns-default-b6srd\" (UID: \"8b45e0ab-c974-4125-af1b-72d77697f266\") " pod="openshift-dns/dns-default-b6srd"
Jul 17 17:24:46.935212 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.935156    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:46.999121 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:46.999075    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:47.010072 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:47.010032    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b45e0ab-c974-4125-af1b-72d77697f266-metrics-tls\") pod \"dns-default-b6srd\" (UID: \"8b45e0ab-c974-4125-af1b-72d77697f266\") " pod="openshift-dns/dns-default-b6srd"
Jul 17 17:24:47.010273 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:47.010085    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8b45e0ab-c974-4125-af1b-72d77697f266-config-volume\") pod \"dns-default-b6srd\" (UID: \"8b45e0ab-c974-4125-af1b-72d77697f266\") " pod="openshift-dns/dns-default-b6srd"
Jul 17 17:24:47.010273 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:47.010112    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b45e0ab-c974-4125-af1b-72d77697f266-tmp-dir\") pod \"dns-default-b6srd\" (UID: \"8b45e0ab-c974-4125-af1b-72d77697f266\") " pod="openshift-dns/dns-default-b6srd"
Jul 17 17:24:47.010273 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:47.010174    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxt88\" (UniqueName: \"kubernetes.io/projected/8b45e0ab-c974-4125-af1b-72d77697f266-kube-api-access-dxt88\") pod \"dns-default-b6srd\" (UID: \"8b45e0ab-c974-4125-af1b-72d77697f266\") " pod="openshift-dns/dns-default-b6srd"
Jul 17 17:24:47.010273 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:47.010203    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 17:24:47.010273 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:47.010224    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjfml\" (UniqueName: \"kubernetes.io/projected/dea89e0b-2f80-4f56-a41b-707e580fca42-kube-api-access-fjfml\") pod \"ingress-canary-hndwr\" (UID: \"dea89e0b-2f80-4f56-a41b-707e580fca42\") " pod="openshift-ingress-canary/ingress-canary-hndwr"
Jul 17 17:24:47.010273 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:47.010251    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dea89e0b-2f80-4f56-a41b-707e580fca42-cert\") pod \"ingress-canary-hndwr\" (UID: \"dea89e0b-2f80-4f56-a41b-707e580fca42\") " pod="openshift-ingress-canary/ingress-canary-hndwr"
Jul 17 17:24:47.010677 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:47.010287    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b45e0ab-c974-4125-af1b-72d77697f266-metrics-tls podName:8b45e0ab-c974-4125-af1b-72d77697f266 nodeName:}" failed. No retries permitted until 2026-07-17 17:24:47.510265515 +0000 UTC m=+37.529042090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8b45e0ab-c974-4125-af1b-72d77697f266-metrics-tls") pod "dns-default-b6srd" (UID: "8b45e0ab-c974-4125-af1b-72d77697f266") : secret "dns-default-metrics-tls" not found
Jul 17 17:24:47.010677 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:47.010589    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b45e0ab-c974-4125-af1b-72d77697f266-tmp-dir\") pod \"dns-default-b6srd\" (UID: \"8b45e0ab-c974-4125-af1b-72d77697f266\") " pod="openshift-dns/dns-default-b6srd"
Jul 17 17:24:47.010874 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:47.010837    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8b45e0ab-c974-4125-af1b-72d77697f266-config-volume\") pod \"dns-default-b6srd\" (UID: \"8b45e0ab-c974-4125-af1b-72d77697f266\") " pod="openshift-dns/dns-default-b6srd"
Jul 17 17:24:47.015256 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:47.015231    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dea89e0b-2f80-4f56-a41b-707e580fca42-cert\") pod \"ingress-canary-hndwr\" (UID: \"dea89e0b-2f80-4f56-a41b-707e580fca42\") " pod="openshift-ingress-canary/ingress-canary-hndwr"
Jul 17 17:24:47.022830 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:47.022771    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxt88\" (UniqueName: \"kubernetes.io/projected/8b45e0ab-c974-4125-af1b-72d77697f266-kube-api-access-dxt88\") pod \"dns-default-b6srd\" (UID: \"8b45e0ab-c974-4125-af1b-72d77697f266\") " pod="openshift-dns/dns-default-b6srd"
Jul 17 17:24:47.023114 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:47.023091    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjfml\" (UniqueName: \"kubernetes.io/projected/dea89e0b-2f80-4f56-a41b-707e580fca42-kube-api-access-fjfml\") pod \"ingress-canary-hndwr\" (UID: \"dea89e0b-2f80-4f56-a41b-707e580fca42\") " pod="openshift-ingress-canary/ingress-canary-hndwr"
Jul 17 17:24:47.142379 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:47.142341    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hndwr"
Jul 17 17:24:47.513987 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:47.513950    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b45e0ab-c974-4125-af1b-72d77697f266-metrics-tls\") pod \"dns-default-b6srd\" (UID: \"8b45e0ab-c974-4125-af1b-72d77697f266\") " pod="openshift-dns/dns-default-b6srd"
Jul 17 17:24:47.514187 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:47.514093    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 17:24:47.514187 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:47.514182    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b45e0ab-c974-4125-af1b-72d77697f266-metrics-tls podName:8b45e0ab-c974-4125-af1b-72d77697f266 nodeName:}" failed. No retries permitted until 2026-07-17 17:24:48.514145828 +0000 UTC m=+38.532922407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8b45e0ab-c974-4125-af1b-72d77697f266-metrics-tls") pod "dns-default-b6srd" (UID: "8b45e0ab-c974-4125-af1b-72d77697f266") : secret "dns-default-metrics-tls" not found
Jul 17 17:24:47.516011 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:47.515981    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:24:47.516150 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:47.516031    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:24:47.516150 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:47.515987    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:24:47.519758 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:47.519733    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 17:24:47.519886 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:47.519734    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 17:24:47.519886 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:47.519734    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nlczc\""
Jul 17 17:24:47.519886 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:47.519812    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 17:24:47.519886 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:47.519733    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-srf5x\""
Jul 17 17:24:47.519886 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:47.519734    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 17:24:48.521079 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:48.521050    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b45e0ab-c974-4125-af1b-72d77697f266-metrics-tls\") pod \"dns-default-b6srd\" (UID: \"8b45e0ab-c974-4125-af1b-72d77697f266\") " pod="openshift-dns/dns-default-b6srd"
Jul 17 17:24:48.521848 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:48.521179    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 17:24:48.521848 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:48.521241    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b45e0ab-c974-4125-af1b-72d77697f266-metrics-tls podName:8b45e0ab-c974-4125-af1b-72d77697f266 nodeName:}" failed. No retries permitted until 2026-07-17 17:24:50.521225716 +0000 UTC m=+40.540002294 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8b45e0ab-c974-4125-af1b-72d77697f266-metrics-tls") pod "dns-default-b6srd" (UID: "8b45e0ab-c974-4125-af1b-72d77697f266") : secret "dns-default-metrics-tls" not found
Jul 17 17:24:48.541379 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:48.541351    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hndwr"]
Jul 17 17:24:48.544809 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:48.544779    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea89e0b_2f80_4f56_a41b_707e580fca42.slice/crio-bdd7e6b48736310e71b3d148c5237ae7cb72c3376a4fd0c3e4885d108579f5fd WatchSource:0}: Error finding container bdd7e6b48736310e71b3d148c5237ae7cb72c3376a4fd0c3e4885d108579f5fd: Status 404 returned error can't find the container with id bdd7e6b48736310e71b3d148c5237ae7cb72c3376a4fd0c3e4885d108579f5fd
Jul 17 17:24:48.920377 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:48.920288    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hndwr" event={"ID":"dea89e0b-2f80-4f56-a41b-707e580fca42","Type":"ContainerStarted","Data":"bdd7e6b48736310e71b3d148c5237ae7cb72c3376a4fd0c3e4885d108579f5fd"}
Jul 17 17:24:48.923017 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:48.922989    2576 generic.go:356] "Generic (PLEG): container finished" podID="d6ad5407-4bb0-47b4-8f15-6c82b11d50c5" containerID="f11652491211d6aa7ae91758d269cb68faaad8a006d8d582b266358561389611" exitCode=0
Jul 17 17:24:48.923130 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:48.923034    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59gm6" event={"ID":"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5","Type":"ContainerDied","Data":"f11652491211d6aa7ae91758d269cb68faaad8a006d8d582b266358561389611"}
Jul 17 17:24:49.890254 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:49.890191    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:49.928360 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:49.928330    2576 generic.go:356] "Generic (PLEG): container finished" podID="d6ad5407-4bb0-47b4-8f15-6c82b11d50c5" containerID="b3645334527d81918c59376e5f30bcd7eb183992fc68df4640e8498180b578a4" exitCode=0
Jul 17 17:24:49.928535 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:49.928375    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59gm6" event={"ID":"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5","Type":"ContainerDied","Data":"b3645334527d81918c59376e5f30bcd7eb183992fc68df4640e8498180b578a4"}
Jul 17 17:24:49.956241 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:49.956196    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:50.537988 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:50.537950    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b45e0ab-c974-4125-af1b-72d77697f266-metrics-tls\") pod \"dns-default-b6srd\" (UID: \"8b45e0ab-c974-4125-af1b-72d77697f266\") " pod="openshift-dns/dns-default-b6srd"
Jul 17 17:24:50.538199 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:50.538093    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 17:24:50.538199 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:50.538186    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b45e0ab-c974-4125-af1b-72d77697f266-metrics-tls podName:8b45e0ab-c974-4125-af1b-72d77697f266 nodeName:}" failed. No retries permitted until 2026-07-17 17:24:54.538147435 +0000 UTC m=+44.556924011 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8b45e0ab-c974-4125-af1b-72d77697f266-metrics-tls") pod "dns-default-b6srd" (UID: "8b45e0ab-c974-4125-af1b-72d77697f266") : secret "dns-default-metrics-tls" not found
Jul 17 17:24:50.914492 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:50.914384    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:50.934032 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:50.933996    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-59gm6" event={"ID":"d6ad5407-4bb0-47b4-8f15-6c82b11d50c5","Type":"ContainerStarted","Data":"5c8384959b663c78f37e1254e2a61d2cb8efe187765e1d1fe50290e3becf6e27"}
Jul 17 17:24:50.957408 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:50.957337    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-59gm6" podStartSLOduration=6.554943447 podStartE2EDuration="39.957316796s" totalImagesPullingTime="33.402373349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:24:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:24:50.956502883 +0000 UTC m=+40.975279482" watchObservedRunningTime="2026-07-17 17:24:50.957316796 +0000 UTC m=+40.976093394"
Jul 17 17:24:51.016567 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:51.016525    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:51.115767 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:51.115708    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:51.216467 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:51.216429    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:51.317435 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:51.317394    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:51.937834 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:51.937797    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hndwr" event={"ID":"dea89e0b-2f80-4f56-a41b-707e580fca42","Type":"ContainerStarted","Data":"c226e156b34a62f53e56e06d28eea297b384757859e1d89c567a019a707bce02"}
Jul 17 17:24:51.954064 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:51.954015    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hndwr" podStartSLOduration=3.255932371 podStartE2EDuration="5.953997387s" totalImagesPullingTime="2.698065016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:24:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:24:51.952804758 +0000 UTC m=+41.971581358" watchObservedRunningTime="2026-07-17 17:24:51.953997387 +0000 UTC m=+41.972773985"
Jul 17 17:24:53.919248 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:53.919218    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-jbhqq"]
Jul 17 17:24:53.953500 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:53.953464    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-594dfb5cc5-4zxww"]
Jul 17 17:24:53.953641 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:53.953586    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-jbhqq"
Jul 17 17:24:53.956429 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:53.956398    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vqmh4\""
Jul 17 17:24:53.956429 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:53.956417    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 17 17:24:53.956652 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:53.956454    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 17 17:24:53.956707 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:53.956699    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 17 17:24:53.956796 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:53.956779    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 17 17:24:53.969256 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:53.969218    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-jbhqq"]
Jul 17 17:24:53.969419 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:53.969333    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:53.969419 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:53.969355    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-594dfb5cc5-4zxww"]
Jul 17 17:24:53.971574 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:53.971552    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 17 17:24:53.971693 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:53.971584    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kbx6g\""
Jul 17 17:24:53.971693 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:53.971679    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 17 17:24:53.971785 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:53.971776    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 17 17:24:53.978589 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:53.978564    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 17 17:24:54.025345 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.025306    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-97g4v"]
Jul 17 17:24:54.055208 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.055156    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-ccd4cd878-b9n7t"]
Jul 17 17:24:54.055356 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.055291    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-97g4v"
Jul 17 17:24:54.057859 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.057837    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nrfxc\""
Jul 17 17:24:54.058023 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.057893    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 17 17:24:54.058078 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.058062    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 17 17:24:54.058178 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.058069    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 17 17:24:54.060197 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.060147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8589fbe7-8408-49d1-9197-bc82c6f3c7c4-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-jbhqq\" (UID: \"8589fbe7-8408-49d1-9197-bc82c6f3c7c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-jbhqq"
Jul 17 17:24:54.060322 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.060222    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9fdae5cb-898e-4d87-a602-2032a59bb948-installation-pull-secrets\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.060322 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.060270    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72h8h\" (UniqueName: \"kubernetes.io/projected/8589fbe7-8408-49d1-9197-bc82c6f3c7c4-kube-api-access-72h8h\") pod \"kube-storage-version-migrator-operator-7658d9b749-jbhqq\" (UID: \"8589fbe7-8408-49d1-9197-bc82c6f3c7c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-jbhqq"
Jul 17 17:24:54.060440 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.060322    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8589fbe7-8408-49d1-9197-bc82c6f3c7c4-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-jbhqq\" (UID: \"8589fbe7-8408-49d1-9197-bc82c6f3c7c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-jbhqq"
Jul 17 17:24:54.060440 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.060369    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9fdae5cb-898e-4d87-a602-2032a59bb948-image-registry-private-configuration\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.060440 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.060432    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9fdae5cb-898e-4d87-a602-2032a59bb948-ca-trust-extracted\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.060585 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.060461    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-certificates\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.060585 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.060504    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-tls\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.060585 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.060548    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsmmk\" (UniqueName: \"kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-kube-api-access-vsmmk\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.060758 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.060590    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9fdae5cb-898e-4d87-a602-2032a59bb948-trusted-ca\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.060758 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.060629    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-bound-sa-token\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.069904 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.069876    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-97g4v"]
Jul 17 17:24:54.070034 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.069926    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:24:54.070034 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.069929    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-ccd4cd878-b9n7t"]
Jul 17 17:24:54.072422 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.072402    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 17 17:24:54.072717 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.072699    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 17 17:24:54.072811 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.072756    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 17 17:24:54.072811 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.072707    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 17 17:24:54.072811 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.072779    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 17 17:24:54.072955 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.072860    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 17 17:24:54.073145 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.073130    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xjfjt\""
Jul 17 17:24:54.120441 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.120408    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kfm4v"]
Jul 17 17:24:54.146681 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.146647    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kfm4v"]
Jul 17 17:24:54.146844 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.146748    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kfm4v"
Jul 17 17:24:54.150477 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.150454    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 17 17:24:54.150975 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.150957    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 17 17:24:54.151107 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.151003    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 17 17:24:54.151107 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.150964    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 17 17:24:54.151107 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.150963    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-wczbh\""
Jul 17 17:24:54.161757 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.161731    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9fdae5cb-898e-4d87-a602-2032a59bb948-ca-trust-extracted\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.161885 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.161760    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-certificates\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.161885 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.161785    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8mtn\" (UniqueName: \"kubernetes.io/projected/4e492fb9-ff0a-4e77-915d-33b764158097-kube-api-access-h8mtn\") pod \"cluster-samples-operator-79b7c55f87-97g4v\" (UID: \"4e492fb9-ff0a-4e77-915d-33b764158097\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-97g4v"
Jul 17 17:24:54.161885 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.161806    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-tls\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.161885 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.161841    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53a3cf11-c213-41a8-9f95-0c1563f42f3a-service-ca-bundle\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:24:54.162095 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.161948    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-stats-auth\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:24:54.162095 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.161980    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsmmk\" (UniqueName: \"kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-kube-api-access-vsmmk\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.162095 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:54.161950    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 17:24:54.162095 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:54.162022    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594dfb5cc5-4zxww: secret "image-registry-tls" not found
Jul 17 17:24:54.162095 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.162028    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9fdae5cb-898e-4d87-a602-2032a59bb948-trusted-ca\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.162095 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.162058    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e492fb9-ff0a-4e77-915d-33b764158097-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-97g4v\" (UID: \"4e492fb9-ff0a-4e77-915d-33b764158097\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-97g4v"
Jul 17 17:24:54.162392 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.162103    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-bound-sa-token\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.162392 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.162107    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9fdae5cb-898e-4d87-a602-2032a59bb948-ca-trust-extracted\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.162392 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:54.162121    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-tls podName:9fdae5cb-898e-4d87-a602-2032a59bb948 nodeName:}" failed. No retries permitted until 2026-07-17 17:24:54.662100269 +0000 UTC m=+44.680876849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-tls") pod "image-registry-594dfb5cc5-4zxww" (UID: "9fdae5cb-898e-4d87-a602-2032a59bb948") : secret "image-registry-tls" not found
Jul 17 17:24:54.162392 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.162206    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8589fbe7-8408-49d1-9197-bc82c6f3c7c4-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-jbhqq\" (UID: \"8589fbe7-8408-49d1-9197-bc82c6f3c7c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-jbhqq"
Jul 17 17:24:54.162392 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.162243    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9fdae5cb-898e-4d87-a602-2032a59bb948-installation-pull-secrets\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.162392 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.162276    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-default-certificate\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:24:54.162392 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.162312    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72h8h\" (UniqueName: \"kubernetes.io/projected/8589fbe7-8408-49d1-9197-bc82c6f3c7c4-kube-api-access-72h8h\") pod \"kube-storage-version-migrator-operator-7658d9b749-jbhqq\" (UID: \"8589fbe7-8408-49d1-9197-bc82c6f3c7c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-jbhqq"
Jul 17 17:24:54.162392 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.162340    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-metrics-certs\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:24:54.162392 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.162372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8589fbe7-8408-49d1-9197-bc82c6f3c7c4-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-jbhqq\" (UID: \"8589fbe7-8408-49d1-9197-bc82c6f3c7c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-jbhqq"
Jul 17 17:24:54.162802 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.162405    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9fdae5cb-898e-4d87-a602-2032a59bb948-image-registry-private-configuration\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.162802 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.162430    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtnf9\" (UniqueName: \"kubernetes.io/projected/53a3cf11-c213-41a8-9f95-0c1563f42f3a-kube-api-access-vtnf9\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:24:54.162802 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.162496    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-certificates\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.162802 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.162790    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8589fbe7-8408-49d1-9197-bc82c6f3c7c4-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-jbhqq\" (UID: \"8589fbe7-8408-49d1-9197-bc82c6f3c7c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-jbhqq"
Jul 17 17:24:54.163042 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.163021    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9fdae5cb-898e-4d87-a602-2032a59bb948-trusted-ca\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.165833 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.165806    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9fdae5cb-898e-4d87-a602-2032a59bb948-image-registry-private-configuration\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.165833 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.165818    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8589fbe7-8408-49d1-9197-bc82c6f3c7c4-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-jbhqq\" (UID: \"8589fbe7-8408-49d1-9197-bc82c6f3c7c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-jbhqq"
Jul 17 17:24:54.166057 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.166036    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9fdae5cb-898e-4d87-a602-2032a59bb948-installation-pull-secrets\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.171354 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.171295    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72h8h\" (UniqueName: \"kubernetes.io/projected/8589fbe7-8408-49d1-9197-bc82c6f3c7c4-kube-api-access-72h8h\") pod \"kube-storage-version-migrator-operator-7658d9b749-jbhqq\" (UID: \"8589fbe7-8408-49d1-9197-bc82c6f3c7c4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-jbhqq"
Jul 17 17:24:54.171556 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.171540    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsmmk\" (UniqueName: \"kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-kube-api-access-vsmmk\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.171610 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.171570    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-bound-sa-token\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.258921 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.258883    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:54.262640 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.262613    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-jbhqq"
Jul 17 17:24:54.262780 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.262759    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-default-certificate\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:24:54.262830 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.262812    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53a3cf11-c213-41a8-9f95-0c1563f42f3a-service-ca-bundle\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:24:54.262876 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.262830    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-stats-auth\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:24:54.262876 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.262851    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdlf4\" (UniqueName: \"kubernetes.io/projected/5fe08929-8648-486b-9bcc-0d3f5c7645b1-kube-api-access-sdlf4\") pod \"service-ca-operator-5bcbc94c78-kfm4v\" (UID: \"5fe08929-8648-486b-9bcc-0d3f5c7645b1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kfm4v"
Jul 17 17:24:54.262955 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.262876    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e492fb9-ff0a-4e77-915d-33b764158097-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-97g4v\" (UID: \"4e492fb9-ff0a-4e77-915d-33b764158097\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-97g4v"
Jul 17 17:24:54.262955 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.262893    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5fe08929-8648-486b-9bcc-0d3f5c7645b1-config\") pod \"service-ca-operator-5bcbc94c78-kfm4v\" (UID: \"5fe08929-8648-486b-9bcc-0d3f5c7645b1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kfm4v"
Jul 17 17:24:54.263037 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:54.263020    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 17:24:54.263100 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:54.263087    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e492fb9-ff0a-4e77-915d-33b764158097-samples-operator-tls podName:4e492fb9-ff0a-4e77-915d-33b764158097 nodeName:}" failed. No retries permitted until 2026-07-17 17:24:54.763072758 +0000 UTC m=+44.781849343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e492fb9-ff0a-4e77-915d-33b764158097-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-97g4v" (UID: "4e492fb9-ff0a-4e77-915d-33b764158097") : secret "samples-operator-tls" not found
Jul 17 17:24:54.263185 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:54.263107    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53a3cf11-c213-41a8-9f95-0c1563f42f3a-service-ca-bundle podName:53a3cf11-c213-41a8-9f95-0c1563f42f3a nodeName:}" failed. No retries permitted until 2026-07-17 17:24:54.763100695 +0000 UTC m=+44.781877271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53a3cf11-c213-41a8-9f95-0c1563f42f3a-service-ca-bundle") pod "router-default-ccd4cd878-b9n7t" (UID: "53a3cf11-c213-41a8-9f95-0c1563f42f3a") : configmap references non-existent config key: service-ca.crt
Jul 17 17:24:54.263185 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.263145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-metrics-certs\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:24:54.263305 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.263204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5fe08929-8648-486b-9bcc-0d3f5c7645b1-serving-cert\") pod \"service-ca-operator-5bcbc94c78-kfm4v\" (UID: \"5fe08929-8648-486b-9bcc-0d3f5c7645b1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kfm4v"
Jul 17 17:24:54.263305 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:54.263227    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 17:24:54.263305 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.263241    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtnf9\" (UniqueName: \"kubernetes.io/projected/53a3cf11-c213-41a8-9f95-0c1563f42f3a-kube-api-access-vtnf9\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:24:54.263305 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:54.263261    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-metrics-certs podName:53a3cf11-c213-41a8-9f95-0c1563f42f3a nodeName:}" failed. No retries permitted until 2026-07-17 17:24:54.763249352 +0000 UTC m=+44.782025929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-metrics-certs") pod "router-default-ccd4cd878-b9n7t" (UID: "53a3cf11-c213-41a8-9f95-0c1563f42f3a") : secret "router-metrics-certs-default" not found
Jul 17 17:24:54.263305 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.263289    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8mtn\" (UniqueName: \"kubernetes.io/projected/4e492fb9-ff0a-4e77-915d-33b764158097-kube-api-access-h8mtn\") pod \"cluster-samples-operator-79b7c55f87-97g4v\" (UID: \"4e492fb9-ff0a-4e77-915d-33b764158097\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-97g4v"
Jul 17 17:24:54.265353 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.265331    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-stats-auth\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:24:54.265438 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.265372    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-default-certificate\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:24:54.274751 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.274721    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtnf9\" (UniqueName: \"kubernetes.io/projected/53a3cf11-c213-41a8-9f95-0c1563f42f3a-kube-api-access-vtnf9\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:24:54.274860 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.274722    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8mtn\" (UniqueName: \"kubernetes.io/projected/4e492fb9-ff0a-4e77-915d-33b764158097-kube-api-access-h8mtn\") pod \"cluster-samples-operator-79b7c55f87-97g4v\" (UID: \"4e492fb9-ff0a-4e77-915d-33b764158097\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-97g4v"
Jul 17 17:24:54.362845 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.362807    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:54.364619 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.364595    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdlf4\" (UniqueName: \"kubernetes.io/projected/5fe08929-8648-486b-9bcc-0d3f5c7645b1-kube-api-access-sdlf4\") pod \"service-ca-operator-5bcbc94c78-kfm4v\" (UID: \"5fe08929-8648-486b-9bcc-0d3f5c7645b1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kfm4v"
Jul 17 17:24:54.364712 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.364637    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5fe08929-8648-486b-9bcc-0d3f5c7645b1-config\") pod \"service-ca-operator-5bcbc94c78-kfm4v\" (UID: \"5fe08929-8648-486b-9bcc-0d3f5c7645b1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kfm4v"
Jul 17 17:24:54.364849 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.364827    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5fe08929-8648-486b-9bcc-0d3f5c7645b1-serving-cert\") pod \"service-ca-operator-5bcbc94c78-kfm4v\" (UID: \"5fe08929-8648-486b-9bcc-0d3f5c7645b1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kfm4v"
Jul 17 17:24:54.365096 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.365082    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5fe08929-8648-486b-9bcc-0d3f5c7645b1-config\") pod \"service-ca-operator-5bcbc94c78-kfm4v\" (UID: \"5fe08929-8648-486b-9bcc-0d3f5c7645b1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kfm4v"
Jul 17 17:24:54.367085 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.367066    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5fe08929-8648-486b-9bcc-0d3f5c7645b1-serving-cert\") pod \"service-ca-operator-5bcbc94c78-kfm4v\" (UID: \"5fe08929-8648-486b-9bcc-0d3f5c7645b1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kfm4v"
Jul 17 17:24:54.374059 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.374026    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdlf4\" (UniqueName: \"kubernetes.io/projected/5fe08929-8648-486b-9bcc-0d3f5c7645b1-kube-api-access-sdlf4\") pod \"service-ca-operator-5bcbc94c78-kfm4v\" (UID: \"5fe08929-8648-486b-9bcc-0d3f5c7645b1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kfm4v"
Jul 17 17:24:54.416386 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.416354    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-jbhqq"]
Jul 17 17:24:54.419095 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.419063    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:54.419532 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:54.419506    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8589fbe7_8408_49d1_9197_bc82c6f3c7c4.slice/crio-f5cee6ec4903223d71f4ac27aa1927345541f06fc2031655a382a303b8787742 WatchSource:0}: Error finding container f5cee6ec4903223d71f4ac27aa1927345541f06fc2031655a382a303b8787742: Status 404 returned error can't find the container with id f5cee6ec4903223d71f4ac27aa1927345541f06fc2031655a382a303b8787742
Jul 17 17:24:54.455762 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.455726    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kfm4v"
Jul 17 17:24:54.566764 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.566724    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b45e0ab-c974-4125-af1b-72d77697f266-metrics-tls\") pod \"dns-default-b6srd\" (UID: \"8b45e0ab-c974-4125-af1b-72d77697f266\") " pod="openshift-dns/dns-default-b6srd"
Jul 17 17:24:54.566904 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:54.566875    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 17:24:54.566952 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:54.566939    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b45e0ab-c974-4125-af1b-72d77697f266-metrics-tls podName:8b45e0ab-c974-4125-af1b-72d77697f266 nodeName:}" failed. No retries permitted until 2026-07-17 17:25:02.566922492 +0000 UTC m=+52.585699079 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8b45e0ab-c974-4125-af1b-72d77697f266-metrics-tls") pod "dns-default-b6srd" (UID: "8b45e0ab-c974-4125-af1b-72d77697f266") : secret "dns-default-metrics-tls" not found
Jul 17 17:24:54.609406 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.609366    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kfm4v"]
Jul 17 17:24:54.612113 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:54.612082    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fe08929_8648_486b_9bcc_0d3f5c7645b1.slice/crio-8f7b9b0be2466269d6050dd7289be338fd79d374971020573b3b3d08ec2df91d WatchSource:0}: Error finding container 8f7b9b0be2466269d6050dd7289be338fd79d374971020573b3b3d08ec2df91d: Status 404 returned error can't find the container with id 8f7b9b0be2466269d6050dd7289be338fd79d374971020573b3b3d08ec2df91d
Jul 17 17:24:54.667855 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.667820    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-tls\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:54.668015 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:54.667996    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 17:24:54.668049 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:54.668019    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594dfb5cc5-4zxww: secret "image-registry-tls" not found
Jul 17 17:24:54.668098 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:54.668079    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-tls podName:9fdae5cb-898e-4d87-a602-2032a59bb948 nodeName:}" failed. No retries permitted until 2026-07-17 17:24:55.668060659 +0000 UTC m=+45.686837235 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-tls") pod "image-registry-594dfb5cc5-4zxww" (UID: "9fdae5cb-898e-4d87-a602-2032a59bb948") : secret "image-registry-tls" not found
Jul 17 17:24:54.768928 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.768885    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53a3cf11-c213-41a8-9f95-0c1563f42f3a-service-ca-bundle\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:24:54.769082 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.768937    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e492fb9-ff0a-4e77-915d-33b764158097-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-97g4v\" (UID: \"4e492fb9-ff0a-4e77-915d-33b764158097\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-97g4v"
Jul 17 17:24:54.769082 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:54.769034    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 17:24:54.769082 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:54.769062    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53a3cf11-c213-41a8-9f95-0c1563f42f3a-service-ca-bundle podName:53a3cf11-c213-41a8-9f95-0c1563f42f3a nodeName:}" failed. No retries permitted until 2026-07-17 17:24:55.769043279 +0000 UTC m=+45.787819855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53a3cf11-c213-41a8-9f95-0c1563f42f3a-service-ca-bundle") pod "router-default-ccd4cd878-b9n7t" (UID: "53a3cf11-c213-41a8-9f95-0c1563f42f3a") : configmap references non-existent config key: service-ca.crt
Jul 17 17:24:54.769228 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.769093    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-metrics-certs\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:24:54.769228 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:54.769201    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e492fb9-ff0a-4e77-915d-33b764158097-samples-operator-tls podName:4e492fb9-ff0a-4e77-915d-33b764158097 nodeName:}" failed. No retries permitted until 2026-07-17 17:24:55.769191697 +0000 UTC m=+45.787968273 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e492fb9-ff0a-4e77-915d-33b764158097-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-97g4v" (UID: "4e492fb9-ff0a-4e77-915d-33b764158097") : secret "samples-operator-tls" not found
Jul 17 17:24:54.769228 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:54.769207    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 17:24:54.769326 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:54.769265    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-metrics-certs podName:53a3cf11-c213-41a8-9f95-0c1563f42f3a nodeName:}" failed. No retries permitted until 2026-07-17 17:24:55.769249069 +0000 UTC m=+45.788025645 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-metrics-certs") pod "router-default-ccd4cd878-b9n7t" (UID: "53a3cf11-c213-41a8-9f95-0c1563f42f3a") : secret "router-metrics-certs-default" not found
Jul 17 17:24:54.945699 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.945661    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kfm4v" event={"ID":"5fe08929-8648-486b-9bcc-0d3f5c7645b1","Type":"ContainerStarted","Data":"8f7b9b0be2466269d6050dd7289be338fd79d374971020573b3b3d08ec2df91d"}
Jul 17 17:24:54.946700 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:54.946665    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-jbhqq" event={"ID":"8589fbe7-8408-49d1-9197-bc82c6f3c7c4","Type":"ContainerStarted","Data":"f5cee6ec4903223d71f4ac27aa1927345541f06fc2031655a382a303b8787742"}
Jul 17 17:24:55.676846 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:55.676809    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-tls\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:55.677033 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:55.676981    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 17:24:55.677033 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:55.676996    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594dfb5cc5-4zxww: secret "image-registry-tls" not found
Jul 17 17:24:55.677107 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:55.677058    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-tls podName:9fdae5cb-898e-4d87-a602-2032a59bb948 nodeName:}" failed. No retries permitted until 2026-07-17 17:24:57.677042411 +0000 UTC m=+47.695818990 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-tls") pod "image-registry-594dfb5cc5-4zxww" (UID: "9fdae5cb-898e-4d87-a602-2032a59bb948") : secret "image-registry-tls" not found
Jul 17 17:24:55.777947 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:55.777900    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-metrics-certs\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:24:55.778263 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:55.778058    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53a3cf11-c213-41a8-9f95-0c1563f42f3a-service-ca-bundle\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:24:55.778263 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:55.778090    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 17:24:55.778263 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:55.778104    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e492fb9-ff0a-4e77-915d-33b764158097-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-97g4v\" (UID: \"4e492fb9-ff0a-4e77-915d-33b764158097\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-97g4v"
Jul 17 17:24:55.778263 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:55.778186    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-metrics-certs podName:53a3cf11-c213-41a8-9f95-0c1563f42f3a nodeName:}" failed. No retries permitted until 2026-07-17 17:24:57.778146467 +0000 UTC m=+47.796923046 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-metrics-certs") pod "router-default-ccd4cd878-b9n7t" (UID: "53a3cf11-c213-41a8-9f95-0c1563f42f3a") : secret "router-metrics-certs-default" not found
Jul 17 17:24:55.778263 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:55.778248    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 17:24:55.778539 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:55.778259    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53a3cf11-c213-41a8-9f95-0c1563f42f3a-service-ca-bundle podName:53a3cf11-c213-41a8-9f95-0c1563f42f3a nodeName:}" failed. No retries permitted until 2026-07-17 17:24:57.77824219 +0000 UTC m=+47.797018789 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53a3cf11-c213-41a8-9f95-0c1563f42f3a-service-ca-bundle") pod "router-default-ccd4cd878-b9n7t" (UID: "53a3cf11-c213-41a8-9f95-0c1563f42f3a") : configmap references non-existent config key: service-ca.crt
Jul 17 17:24:55.778539 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:55.778293    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e492fb9-ff0a-4e77-915d-33b764158097-samples-operator-tls podName:4e492fb9-ff0a-4e77-915d-33b764158097 nodeName:}" failed. No retries permitted until 2026-07-17 17:24:57.778279795 +0000 UTC m=+47.797056377 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e492fb9-ff0a-4e77-915d-33b764158097-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-97g4v" (UID: "4e492fb9-ff0a-4e77-915d-33b764158097") : secret "samples-operator-tls" not found
Jul 17 17:24:56.967593 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:56.967554    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:57.018180 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:57.018134    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:57.693462 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:57.693371    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-tls\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:24:57.693662 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:57.693547    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 17:24:57.693662 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:57.693572    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594dfb5cc5-4zxww: secret "image-registry-tls" not found
Jul 17 17:24:57.693662 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:57.693642    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-tls podName:9fdae5cb-898e-4d87-a602-2032a59bb948 nodeName:}" failed. No retries permitted until 2026-07-17 17:25:01.693621319 +0000 UTC m=+51.712397924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-tls") pod "image-registry-594dfb5cc5-4zxww" (UID: "9fdae5cb-898e-4d87-a602-2032a59bb948") : secret "image-registry-tls" not found
Jul 17 17:24:57.794588 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:57.794547    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53a3cf11-c213-41a8-9f95-0c1563f42f3a-service-ca-bundle\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:24:57.794588 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:57.794596    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e492fb9-ff0a-4e77-915d-33b764158097-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-97g4v\" (UID: \"4e492fb9-ff0a-4e77-915d-33b764158097\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-97g4v"
Jul 17 17:24:57.794798 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:57.794635    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-metrics-certs\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:24:57.794798 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:57.794726    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53a3cf11-c213-41a8-9f95-0c1563f42f3a-service-ca-bundle podName:53a3cf11-c213-41a8-9f95-0c1563f42f3a nodeName:}" failed. No retries permitted until 2026-07-17 17:25:01.794706325 +0000 UTC m=+51.813482918 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53a3cf11-c213-41a8-9f95-0c1563f42f3a-service-ca-bundle") pod "router-default-ccd4cd878-b9n7t" (UID: "53a3cf11-c213-41a8-9f95-0c1563f42f3a") : configmap references non-existent config key: service-ca.crt
Jul 17 17:24:57.794798 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:57.794780    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 17:24:57.794906 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:57.794841    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e492fb9-ff0a-4e77-915d-33b764158097-samples-operator-tls podName:4e492fb9-ff0a-4e77-915d-33b764158097 nodeName:}" failed. No retries permitted until 2026-07-17 17:25:01.794828889 +0000 UTC m=+51.813605468 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e492fb9-ff0a-4e77-915d-33b764158097-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-97g4v" (UID: "4e492fb9-ff0a-4e77-915d-33b764158097") : secret "samples-operator-tls" not found
Jul 17 17:24:57.794906 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:57.794780    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 17:24:57.794906 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:24:57.794879    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-metrics-certs podName:53a3cf11-c213-41a8-9f95-0c1563f42f3a nodeName:}" failed. No retries permitted until 2026-07-17 17:25:01.794869128 +0000 UTC m=+51.813645704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-metrics-certs") pod "router-default-ccd4cd878-b9n7t" (UID: "53a3cf11-c213-41a8-9f95-0c1563f42f3a") : secret "router-metrics-certs-default" not found
Jul 17 17:24:57.956752 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:57.956640    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kfm4v" event={"ID":"5fe08929-8648-486b-9bcc-0d3f5c7645b1","Type":"ContainerStarted","Data":"8f47e35d4a9124dad8571d547c4025bd9bc339afe9f998cf8d855f2ffc0a7296"}
Jul 17 17:24:57.958442 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:57.958408    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-jbhqq" event={"ID":"8589fbe7-8408-49d1-9197-bc82c6f3c7c4","Type":"ContainerStarted","Data":"3ca3d8886baf30fbd96cee6f791b7b6fa91c0b683ec734a3f955a08645debcce"}
Jul 17 17:24:57.972276 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:57.972215    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kfm4v" podStartSLOduration=1.2048499129999999 podStartE2EDuration="3.972199091s" totalImagesPullingTime="2.767349178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:24:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:24:57.971350157 +0000 UTC m=+47.990126755" watchObservedRunningTime="2026-07-17 17:24:57.972199091 +0000 UTC m=+47.990975689"
Jul 17 17:24:57.986484 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:57.986424    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-jbhqq" podStartSLOduration=2.032073838 podStartE2EDuration="4.986404358s" totalImagesPullingTime="2.95433052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:24:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:24:57.985603491 +0000 UTC m=+48.004380088" watchObservedRunningTime="2026-07-17 17:24:57.986404358 +0000 UTC m=+48.005180937"
Jul 17 17:24:58.205209 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:58.205175    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:58.215478 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:58.215407    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lldq2"]
Jul 17 17:24:58.238881 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:58.238846    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lldq2"]
Jul 17 17:24:58.239054 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:58.239000    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lldq2"
Jul 17 17:24:58.241647 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:58.241623    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-z66bx\""
Jul 17 17:24:58.241647 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:58.241643    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 17 17:24:58.241852 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:58.241803    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 17 17:24:58.269443 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:58.269400    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:58.324535 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:58.324496    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:58.401069 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:58.401027    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v5pz\" (UniqueName: \"kubernetes.io/projected/ad6bf2ef-6b2a-44dd-97c2-8f06ddc2ad82-kube-api-access-8v5pz\") pod \"migrator-7cc9c7ffd7-lldq2\" (UID: \"ad6bf2ef-6b2a-44dd-97c2-8f06ddc2ad82\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lldq2"
Jul 17 17:24:58.425680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:58.425645    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:58.502332 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:58.502230    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v5pz\" (UniqueName: \"kubernetes.io/projected/ad6bf2ef-6b2a-44dd-97c2-8f06ddc2ad82-kube-api-access-8v5pz\") pod \"migrator-7cc9c7ffd7-lldq2\" (UID: \"ad6bf2ef-6b2a-44dd-97c2-8f06ddc2ad82\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lldq2"
Jul 17 17:24:58.510733 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:58.510695    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v5pz\" (UniqueName: \"kubernetes.io/projected/ad6bf2ef-6b2a-44dd-97c2-8f06ddc2ad82-kube-api-access-8v5pz\") pod \"migrator-7cc9c7ffd7-lldq2\" (UID: \"ad6bf2ef-6b2a-44dd-97c2-8f06ddc2ad82\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lldq2"
Jul 17 17:24:58.550886 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:58.550842    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lldq2"
Jul 17 17:24:58.689299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:58.689260    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lldq2"]
Jul 17 17:24:58.692815 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:24:58.692785    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad6bf2ef_6b2a_44dd_97c2_8f06ddc2ad82.slice/crio-8758e462633307cf885d4517361499a6dfa898ac9bc7e4234d1f703676ef0151 WatchSource:0}: Error finding container 8758e462633307cf885d4517361499a6dfa898ac9bc7e4234d1f703676ef0151: Status 404 returned error can't find the container with id 8758e462633307cf885d4517361499a6dfa898ac9bc7e4234d1f703676ef0151
Jul 17 17:24:58.768913 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:58.768827    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:58.868845 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:58.868805    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:58.962232 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:58.962192    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lldq2" event={"ID":"ad6bf2ef-6b2a-44dd-97c2-8f06ddc2ad82","Type":"ContainerStarted","Data":"8758e462633307cf885d4517361499a6dfa898ac9bc7e4234d1f703676ef0151"}
Jul 17 17:24:59.038770 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:59.038678    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:24:59.136629 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:24:59.136585    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:25:00.671818 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:00.671710    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:25:00.731516 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:00.731483    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:25:00.968395 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:00.968360    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lldq2" event={"ID":"ad6bf2ef-6b2a-44dd-97c2-8f06ddc2ad82","Type":"ContainerStarted","Data":"21570088d1945d4b573eebc0b039da506706627a097c7b2e2a5872fa4dba130a"}
Jul 17 17:25:00.968561 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:00.968413    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lldq2" event={"ID":"ad6bf2ef-6b2a-44dd-97c2-8f06ddc2ad82","Type":"ContainerStarted","Data":"7a19b7d7d969d064615f67c864257ec05ac0aeff957209ef094fd52d4a81204e"}
Jul 17 17:25:00.985853 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:00.985798    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lldq2" podStartSLOduration=1.4070430489999999 podStartE2EDuration="2.985780149s" totalImagesPullingTime="1.5787371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:25:00.985408349 +0000 UTC m=+51.004184948" watchObservedRunningTime="2026-07-17 17:25:00.985780149 +0000 UTC m=+51.004556746"
Jul 17 17:25:01.067614 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:01.067578    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:25:01.625216 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:01.625174    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:25:01.727992 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:01.727950    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-tls\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:25:01.728421 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:25:01.728074    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 17:25:01.728421 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:25:01.728086    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594dfb5cc5-4zxww: secret "image-registry-tls" not found
Jul 17 17:25:01.728421 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:25:01.728135    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-tls podName:9fdae5cb-898e-4d87-a602-2032a59bb948 nodeName:}" failed. No retries permitted until 2026-07-17 17:25:09.72812091 +0000 UTC m=+59.746897486 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-tls") pod "image-registry-594dfb5cc5-4zxww" (UID: "9fdae5cb-898e-4d87-a602-2032a59bb948") : secret "image-registry-tls" not found
Jul 17 17:25:01.828759 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:01.828714    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53a3cf11-c213-41a8-9f95-0c1563f42f3a-service-ca-bundle\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:25:01.828972 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:01.828784    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e492fb9-ff0a-4e77-915d-33b764158097-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-97g4v\" (UID: \"4e492fb9-ff0a-4e77-915d-33b764158097\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-97g4v"
Jul 17 17:25:01.828972 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:01.828816    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-metrics-certs\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:25:01.828972 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:25:01.828915    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53a3cf11-c213-41a8-9f95-0c1563f42f3a-service-ca-bundle podName:53a3cf11-c213-41a8-9f95-0c1563f42f3a nodeName:}" failed. No retries permitted until 2026-07-17 17:25:09.828890471 +0000 UTC m=+59.847667047 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53a3cf11-c213-41a8-9f95-0c1563f42f3a-service-ca-bundle") pod "router-default-ccd4cd878-b9n7t" (UID: "53a3cf11-c213-41a8-9f95-0c1563f42f3a") : configmap references non-existent config key: service-ca.crt
Jul 17 17:25:01.828972 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:25:01.828925    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 17:25:01.828972 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:25:01.828967    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-metrics-certs podName:53a3cf11-c213-41a8-9f95-0c1563f42f3a nodeName:}" failed. No retries permitted until 2026-07-17 17:25:09.828958274 +0000 UTC m=+59.847734888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-metrics-certs") pod "router-default-ccd4cd878-b9n7t" (UID: "53a3cf11-c213-41a8-9f95-0c1563f42f3a") : secret "router-metrics-certs-default" not found
Jul 17 17:25:01.828972 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:25:01.828925    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 17:25:01.829239 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:25:01.829001    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e492fb9-ff0a-4e77-915d-33b764158097-samples-operator-tls podName:4e492fb9-ff0a-4e77-915d-33b764158097 nodeName:}" failed. No retries permitted until 2026-07-17 17:25:09.828992872 +0000 UTC m=+59.847769454 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e492fb9-ff0a-4e77-915d-33b764158097-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-97g4v" (UID: "4e492fb9-ff0a-4e77-915d-33b764158097") : secret "samples-operator-tls" not found
Jul 17 17:25:02.016490 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:02.016457    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:25:02.089609 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:02.089578    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log" limit=1024
Jul 17 17:25:02.636528 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:02.636487    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b45e0ab-c974-4125-af1b-72d77697f266-metrics-tls\") pod \"dns-default-b6srd\" (UID: \"8b45e0ab-c974-4125-af1b-72d77697f266\") " pod="openshift-dns/dns-default-b6srd"
Jul 17 17:25:02.636708 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:25:02.636653    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 17:25:02.636752 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:25:02.636719    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b45e0ab-c974-4125-af1b-72d77697f266-metrics-tls podName:8b45e0ab-c974-4125-af1b-72d77697f266 nodeName:}" failed. No retries permitted until 2026-07-17 17:25:18.636702436 +0000 UTC m=+68.655479011 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8b45e0ab-c974-4125-af1b-72d77697f266-metrics-tls") pod "dns-default-b6srd" (UID: "8b45e0ab-c974-4125-af1b-72d77697f266") : secret "dns-default-metrics-tls" not found
Jul 17 17:25:03.730547 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:03.730516    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v5dfj_ea0cda67-da14-493a-b32a-f40756867f5e/dns-node-resolver/0.log"
Jul 17 17:25:04.331930 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:04.331900    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4wnph_a3c90559-497c-41f7-9dfd-0a038dec0c80/node-ca/0.log"
Jul 17 17:25:05.335930 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:05.335898    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hndwr_dea89e0b-2f80-4f56-a41b-707e580fca42/serve-healthcheck-canary/0.log"
Jul 17 17:25:09.794355 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:09.794306    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-tls\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:25:09.796700 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:09.796677    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-tls\") pod \"image-registry-594dfb5cc5-4zxww\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") " pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:25:09.880730 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:09.880677    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:25:09.895716 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:09.895684    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53a3cf11-c213-41a8-9f95-0c1563f42f3a-service-ca-bundle\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:25:09.895839 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:09.895739    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e492fb9-ff0a-4e77-915d-33b764158097-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-97g4v\" (UID: \"4e492fb9-ff0a-4e77-915d-33b764158097\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-97g4v"
Jul 17 17:25:09.895918 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:09.895887    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-metrics-certs\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:25:09.895918 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:25:09.895902    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/53a3cf11-c213-41a8-9f95-0c1563f42f3a-service-ca-bundle podName:53a3cf11-c213-41a8-9f95-0c1563f42f3a nodeName:}" failed. No retries permitted until 2026-07-17 17:25:25.895877856 +0000 UTC m=+75.914654438 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/53a3cf11-c213-41a8-9f95-0c1563f42f3a-service-ca-bundle") pod "router-default-ccd4cd878-b9n7t" (UID: "53a3cf11-c213-41a8-9f95-0c1563f42f3a") : configmap references non-existent config key: service-ca.crt
Jul 17 17:25:09.898281 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:09.898255    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e492fb9-ff0a-4e77-915d-33b764158097-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-97g4v\" (UID: \"4e492fb9-ff0a-4e77-915d-33b764158097\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-97g4v"
Jul 17 17:25:09.899454 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:09.899405    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a3cf11-c213-41a8-9f95-0c1563f42f3a-metrics-certs\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:25:09.965052 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:09.964789    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-97g4v"
Jul 17 17:25:10.015679 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:10.015595    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-594dfb5cc5-4zxww"]
Jul 17 17:25:10.019276 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:25:10.019247    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fdae5cb_898e_4d87_a602_2032a59bb948.slice/crio-91f0b08f5d122b94730770d93883010d4eb0a97e348548ba7889f92c9acc408d WatchSource:0}: Error finding container 91f0b08f5d122b94730770d93883010d4eb0a97e348548ba7889f92c9acc408d: Status 404 returned error can't find the container with id 91f0b08f5d122b94730770d93883010d4eb0a97e348548ba7889f92c9acc408d
Jul 17 17:25:10.109182 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:10.109126    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-97g4v"]
Jul 17 17:25:10.998430 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:10.998381    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-97g4v" event={"ID":"4e492fb9-ff0a-4e77-915d-33b764158097","Type":"ContainerStarted","Data":"c1f753e8c7788b27bdfe23927278b8e1a21bcabc858b96941d5249f5f3dd9da7"}
Jul 17 17:25:11.000074 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:11.000033    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww" event={"ID":"9fdae5cb-898e-4d87-a602-2032a59bb948","Type":"ContainerStarted","Data":"f29eee02473065aa10830616b11b901dadf0132b57a5b96e3559aec182e52f3d"}
Jul 17 17:25:11.000227 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:11.000096    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww" event={"ID":"9fdae5cb-898e-4d87-a602-2032a59bb948","Type":"ContainerStarted","Data":"91f0b08f5d122b94730770d93883010d4eb0a97e348548ba7889f92c9acc408d"}
Jul 17 17:25:11.000227 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:11.000140    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:25:11.022192 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:11.022123    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww" podStartSLOduration=18.02210555 podStartE2EDuration="18.02210555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:24:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:25:11.02147609 +0000 UTC m=+61.040252689" watchObservedRunningTime="2026-07-17 17:25:11.02210555 +0000 UTC m=+61.040882149"
Jul 17 17:25:12.005553 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:12.005477    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-97g4v" event={"ID":"4e492fb9-ff0a-4e77-915d-33b764158097","Type":"ContainerStarted","Data":"02eddd6d214e56b59f32ee9e2f0fe83170595bfc799b149013e179efb5562bf5"}
Jul 17 17:25:12.921686 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:12.921658    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2nlxt"
Jul 17 17:25:13.010011 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:13.009959    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-97g4v" event={"ID":"4e492fb9-ff0a-4e77-915d-33b764158097","Type":"ContainerStarted","Data":"34f5d393e143e8ad596c339630e08222f7caf6ce65f01ccc0dec4f91a054591b"}
Jul 17 17:25:13.033522 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:13.033469    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-97g4v" podStartSLOduration=17.285244467 podStartE2EDuration="19.033448257s" totalImagesPullingTime="1.74820379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:24:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:25:13.032645013 +0000 UTC m=+63.051421611" watchObservedRunningTime="2026-07-17 17:25:13.033448257 +0000 UTC m=+63.052224856"
Jul 17 17:25:15.240240 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:15.240193    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret\") pod \"global-pull-secret-syncer-jdnds\" (UID: \"9bed4dab-7c99-4599-b607-55672af77505\") " pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:25:15.242666 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:15.242647    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 17:25:15.252884 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:15.252852    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9bed4dab-7c99-4599-b607-55672af77505-original-pull-secret\") pod \"global-pull-secret-syncer-jdnds\" (UID: \"9bed4dab-7c99-4599-b607-55672af77505\") " pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:25:15.341011 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:15.340973    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcbfm\" (UniqueName: \"kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm\") pod \"network-check-target-f828l\" (UID: \"bb26bbd0-dcaa-433b-90b2-fdf9a41181cc\") " pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:25:15.341189 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:15.341151    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs\") pod \"network-metrics-daemon-lmqqg\" (UID: \"c0e9fbee-bec3-4365-8511-247f8a0c3a0b\") " pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:25:15.343439 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:15.343412    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 17:25:15.343439 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:15.343435    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 17:25:15.353795 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:15.353764    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0e9fbee-bec3-4365-8511-247f8a0c3a0b-metrics-certs\") pod \"network-metrics-daemon-lmqqg\" (UID: \"c0e9fbee-bec3-4365-8511-247f8a0c3a0b\") " pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:25:15.353921 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:15.353769    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 17:25:15.364218 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:15.364186    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcbfm\" (UniqueName: \"kubernetes.io/projected/bb26bbd0-dcaa-433b-90b2-fdf9a41181cc-kube-api-access-gcbfm\") pod \"network-check-target-f828l\" (UID: \"bb26bbd0-dcaa-433b-90b2-fdf9a41181cc\") " pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:25:15.431022 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:15.430989    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nlczc\""
Jul 17 17:25:15.438338 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:15.438306    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-srf5x\""
Jul 17 17:25:15.438508 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:15.438495    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lmqqg"
Jul 17 17:25:15.442253 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:15.442233    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jdnds"
Jul 17 17:25:15.447139 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:15.447116    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:25:15.586792 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:15.586761    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lmqqg"]
Jul 17 17:25:15.592568 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:25:15.592536    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0e9fbee_bec3_4365_8511_247f8a0c3a0b.slice/crio-146e4291cf19531e8ea1b96c63b7fdc74d4e54ca96d3727d88fc5d8dab740b55 WatchSource:0}: Error finding container 146e4291cf19531e8ea1b96c63b7fdc74d4e54ca96d3727d88fc5d8dab740b55: Status 404 returned error can't find the container with id 146e4291cf19531e8ea1b96c63b7fdc74d4e54ca96d3727d88fc5d8dab740b55
Jul 17 17:25:15.609017 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:15.608993    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jdnds"]
Jul 17 17:25:15.611692 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:25:15.611649    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bed4dab_7c99_4599_b607_55672af77505.slice/crio-eb03fcfd228a82e7e8586a6dd56017bca82563cdcdf279cc9ad63ac703c7b4f3 WatchSource:0}: Error finding container eb03fcfd228a82e7e8586a6dd56017bca82563cdcdf279cc9ad63ac703c7b4f3: Status 404 returned error can't find the container with id eb03fcfd228a82e7e8586a6dd56017bca82563cdcdf279cc9ad63ac703c7b4f3
Jul 17 17:25:15.633197 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:15.633153    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f828l"]
Jul 17 17:25:15.637533 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:25:15.637506    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb26bbd0_dcaa_433b_90b2_fdf9a41181cc.slice/crio-f460c80b75f9737d10aab31fcac179b7198bc8946ecc9f3fbd5c2c6261624ceb WatchSource:0}: Error finding container f460c80b75f9737d10aab31fcac179b7198bc8946ecc9f3fbd5c2c6261624ceb: Status 404 returned error can't find the container with id f460c80b75f9737d10aab31fcac179b7198bc8946ecc9f3fbd5c2c6261624ceb
Jul 17 17:25:16.021927 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:16.021879    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f828l" event={"ID":"bb26bbd0-dcaa-433b-90b2-fdf9a41181cc","Type":"ContainerStarted","Data":"f460c80b75f9737d10aab31fcac179b7198bc8946ecc9f3fbd5c2c6261624ceb"}
Jul 17 17:25:16.023314 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:16.023282    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jdnds" event={"ID":"9bed4dab-7c99-4599-b607-55672af77505","Type":"ContainerStarted","Data":"eb03fcfd228a82e7e8586a6dd56017bca82563cdcdf279cc9ad63ac703c7b4f3"}
Jul 17 17:25:16.024612 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:16.024578    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lmqqg" event={"ID":"c0e9fbee-bec3-4365-8511-247f8a0c3a0b","Type":"ContainerStarted","Data":"146e4291cf19531e8ea1b96c63b7fdc74d4e54ca96d3727d88fc5d8dab740b55"}
Jul 17 17:25:17.031306 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:17.031267    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lmqqg" event={"ID":"c0e9fbee-bec3-4365-8511-247f8a0c3a0b","Type":"ContainerStarted","Data":"1e1a9bacbe33e3f97cc85bff6fad438913a4aa34482c4684066087de0512c623"}
Jul 17 17:25:17.031896 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:17.031334    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lmqqg" event={"ID":"c0e9fbee-bec3-4365-8511-247f8a0c3a0b","Type":"ContainerStarted","Data":"b43e3fa3d3102aa74e5b3a9bd328b76bd2f9b57a2ae3c70b1ee489a6f555c773"}
Jul 17 17:25:17.047691 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:17.047630    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lmqqg" podStartSLOduration=65.007555624 podStartE2EDuration="1m6.047605198s" totalImagesPullingTime="1.040049574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:25:17.047450612 +0000 UTC m=+67.066227211" watchObservedRunningTime="2026-07-17 17:25:17.047605198 +0000 UTC m=+67.066381797"
Jul 17 17:25:18.670214 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:18.670139    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b45e0ab-c974-4125-af1b-72d77697f266-metrics-tls\") pod \"dns-default-b6srd\" (UID: \"8b45e0ab-c974-4125-af1b-72d77697f266\") " pod="openshift-dns/dns-default-b6srd"
Jul 17 17:25:18.672829 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:18.672803    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b45e0ab-c974-4125-af1b-72d77697f266-metrics-tls\") pod \"dns-default-b6srd\" (UID: \"8b45e0ab-c974-4125-af1b-72d77697f266\") " pod="openshift-dns/dns-default-b6srd"
Jul 17 17:25:18.939477 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:18.939387    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-smb8x\""
Jul 17 17:25:18.947598 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:18.947559    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b6srd"
Jul 17 17:25:20.936642 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:20.936484    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b6srd"]
Jul 17 17:25:20.960966 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:25:20.960925    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b45e0ab_c974_4125_af1b_72d77697f266.slice/crio-154a08fcd8d28f9e7e373fb139715aca0f1d854a5b6dd221b13c2db54d5aa336 WatchSource:0}: Error finding container 154a08fcd8d28f9e7e373fb139715aca0f1d854a5b6dd221b13c2db54d5aa336: Status 404 returned error can't find the container with id 154a08fcd8d28f9e7e373fb139715aca0f1d854a5b6dd221b13c2db54d5aa336
Jul 17 17:25:21.048581 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:21.048479    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b6srd" event={"ID":"8b45e0ab-c974-4125-af1b-72d77697f266","Type":"ContainerStarted","Data":"154a08fcd8d28f9e7e373fb139715aca0f1d854a5b6dd221b13c2db54d5aa336"}
Jul 17 17:25:21.050014 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:21.049967    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f828l" event={"ID":"bb26bbd0-dcaa-433b-90b2-fdf9a41181cc","Type":"ContainerStarted","Data":"63f35fddb8716c11d894d36b15fc580b5a85aff57506390ac4eeaac882af7ec3"}
Jul 17 17:25:21.050186 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:21.050072    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:25:21.051587 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:21.051557    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jdnds" event={"ID":"9bed4dab-7c99-4599-b607-55672af77505","Type":"ContainerStarted","Data":"c2f276d9d9b51db25a147d64e8f46fe1c4da8095c40c39fe8a9d46b840a4823a"}
Jul 17 17:25:21.067400 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:21.067325    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f828l" podStartSLOduration=64.910586509 podStartE2EDuration="1m10.067305431s" totalImagesPullingTime="5.156718922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:25:21.065902951 +0000 UTC m=+71.084679549" watchObservedRunningTime="2026-07-17 17:25:21.067305431 +0000 UTC m=+71.086082030"
Jul 17 17:25:21.081000 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:21.080941    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jdnds" podStartSLOduration=64.885797197 podStartE2EDuration="1m10.080922773s" totalImagesPullingTime="5.195125576s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:25:21.08027643 +0000 UTC m=+71.099053030" watchObservedRunningTime="2026-07-17 17:25:21.080922773 +0000 UTC m=+71.099699371"
Jul 17 17:25:22.449362 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.449324    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"]
Jul 17 17:25:22.451598 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.451565    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"
Jul 17 17:25:22.453968 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.453936    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 17 17:25:22.454150 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.454119    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 17 17:25:22.455248 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.455209    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 17 17:25:22.455371 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.455261    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 17 17:25:22.455371 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.455261    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 17 17:25:22.455371 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.455311    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 17 17:25:22.455371 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.455314    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 17 17:25:22.465904 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.465874    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"]
Jul 17 17:25:22.505260 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.505217    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccefbf20-b46d-4c4d-94be-a423f801181c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5799b59b97-96sdp\" (UID: \"ccefbf20-b46d-4c4d-94be-a423f801181c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"
Jul 17 17:25:22.505434 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.505291    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ccefbf20-b46d-4c4d-94be-a423f801181c-ca\") pod \"cluster-proxy-proxy-agent-5799b59b97-96sdp\" (UID: \"ccefbf20-b46d-4c4d-94be-a423f801181c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"
Jul 17 17:25:22.505434 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.505339    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ccefbf20-b46d-4c4d-94be-a423f801181c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5799b59b97-96sdp\" (UID: \"ccefbf20-b46d-4c4d-94be-a423f801181c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"
Jul 17 17:25:22.505528 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.505424    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ccefbf20-b46d-4c4d-94be-a423f801181c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5799b59b97-96sdp\" (UID: \"ccefbf20-b46d-4c4d-94be-a423f801181c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"
Jul 17 17:25:22.505528 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.505485    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ccefbf20-b46d-4c4d-94be-a423f801181c-hub\") pod \"cluster-proxy-proxy-agent-5799b59b97-96sdp\" (UID: \"ccefbf20-b46d-4c4d-94be-a423f801181c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"
Jul 17 17:25:22.505528 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.505522    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzflj\" (UniqueName: \"kubernetes.io/projected/ccefbf20-b46d-4c4d-94be-a423f801181c-kube-api-access-mzflj\") pod \"cluster-proxy-proxy-agent-5799b59b97-96sdp\" (UID: \"ccefbf20-b46d-4c4d-94be-a423f801181c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"
Jul 17 17:25:22.563660 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.563626    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-594dfb5cc5-4zxww"]
Jul 17 17:25:22.570201 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.570144    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pvr5x"]
Jul 17 17:25:22.572442 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.572419    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pvr5x"
Jul 17 17:25:22.577190 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.577142    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 17 17:25:22.577352 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.577205    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 17 17:25:22.577473 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.577449    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 17 17:25:22.577855 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.577836    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 17 17:25:22.577987 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.577907    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j69cs\""
Jul 17 17:25:22.606937 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.606905    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccefbf20-b46d-4c4d-94be-a423f801181c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5799b59b97-96sdp\" (UID: \"ccefbf20-b46d-4c4d-94be-a423f801181c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"
Jul 17 17:25:22.607125 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.606960    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ccefbf20-b46d-4c4d-94be-a423f801181c-ca\") pod \"cluster-proxy-proxy-agent-5799b59b97-96sdp\" (UID: \"ccefbf20-b46d-4c4d-94be-a423f801181c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"
Jul 17 17:25:22.607125 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.607006    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ccefbf20-b46d-4c4d-94be-a423f801181c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5799b59b97-96sdp\" (UID: \"ccefbf20-b46d-4c4d-94be-a423f801181c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"
Jul 17 17:25:22.607125 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.607039    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ccefbf20-b46d-4c4d-94be-a423f801181c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5799b59b97-96sdp\" (UID: \"ccefbf20-b46d-4c4d-94be-a423f801181c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"
Jul 17 17:25:22.607125 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.607084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ccefbf20-b46d-4c4d-94be-a423f801181c-hub\") pod \"cluster-proxy-proxy-agent-5799b59b97-96sdp\" (UID: \"ccefbf20-b46d-4c4d-94be-a423f801181c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"
Jul 17 17:25:22.607125 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.607114    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzflj\" (UniqueName: \"kubernetes.io/projected/ccefbf20-b46d-4c4d-94be-a423f801181c-kube-api-access-mzflj\") pod \"cluster-proxy-proxy-agent-5799b59b97-96sdp\" (UID: \"ccefbf20-b46d-4c4d-94be-a423f801181c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"
Jul 17 17:25:22.607776 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.607725    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccefbf20-b46d-4c4d-94be-a423f801181c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5799b59b97-96sdp\" (UID: \"ccefbf20-b46d-4c4d-94be-a423f801181c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"
Jul 17 17:25:22.610512 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.610464    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ccefbf20-b46d-4c4d-94be-a423f801181c-hub\") pod \"cluster-proxy-proxy-agent-5799b59b97-96sdp\" (UID: \"ccefbf20-b46d-4c4d-94be-a423f801181c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"
Jul 17 17:25:22.610636 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.610613    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ccefbf20-b46d-4c4d-94be-a423f801181c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5799b59b97-96sdp\" (UID: \"ccefbf20-b46d-4c4d-94be-a423f801181c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"
Jul 17 17:25:22.610764 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.610739    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ccefbf20-b46d-4c4d-94be-a423f801181c-ca\") pod \"cluster-proxy-proxy-agent-5799b59b97-96sdp\" (UID: \"ccefbf20-b46d-4c4d-94be-a423f801181c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"
Jul 17 17:25:22.610943 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.610919    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ccefbf20-b46d-4c4d-94be-a423f801181c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5799b59b97-96sdp\" (UID: \"ccefbf20-b46d-4c4d-94be-a423f801181c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"
Jul 17 17:25:22.627301 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.627218    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pvr5x"]
Jul 17 17:25:22.631876 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.631821    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzflj\" (UniqueName: \"kubernetes.io/projected/ccefbf20-b46d-4c4d-94be-a423f801181c-kube-api-access-mzflj\") pod \"cluster-proxy-proxy-agent-5799b59b97-96sdp\" (UID: \"ccefbf20-b46d-4c4d-94be-a423f801181c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"
Jul 17 17:25:22.661968 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.661872    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"]
Jul 17 17:25:22.664545 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.664521    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.677386 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.677355    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"]
Jul 17 17:25:22.708100 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.708046    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3476683f-19c4-4cbd-92c6-40968a1250dc-data-volume\") pod \"insights-runtime-extractor-pvr5x\" (UID: \"3476683f-19c4-4cbd-92c6-40968a1250dc\") " pod="openshift-insights/insights-runtime-extractor-pvr5x"
Jul 17 17:25:22.708286 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.708106    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3476683f-19c4-4cbd-92c6-40968a1250dc-crio-socket\") pod \"insights-runtime-extractor-pvr5x\" (UID: \"3476683f-19c4-4cbd-92c6-40968a1250dc\") " pod="openshift-insights/insights-runtime-extractor-pvr5x"
Jul 17 17:25:22.708286 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.708133    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3476683f-19c4-4cbd-92c6-40968a1250dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pvr5x\" (UID: \"3476683f-19c4-4cbd-92c6-40968a1250dc\") " pod="openshift-insights/insights-runtime-extractor-pvr5x"
Jul 17 17:25:22.708286 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.708206    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3476683f-19c4-4cbd-92c6-40968a1250dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pvr5x\" (UID: \"3476683f-19c4-4cbd-92c6-40968a1250dc\") " pod="openshift-insights/insights-runtime-extractor-pvr5x"
Jul 17 17:25:22.708286 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.708263    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7hvl\" (UniqueName: \"kubernetes.io/projected/3476683f-19c4-4cbd-92c6-40968a1250dc-kube-api-access-p7hvl\") pod \"insights-runtime-extractor-pvr5x\" (UID: \"3476683f-19c4-4cbd-92c6-40968a1250dc\") " pod="openshift-insights/insights-runtime-extractor-pvr5x"
Jul 17 17:25:22.773361 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.773327    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"
Jul 17 17:25:22.809624 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.809591    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rctqn\" (UniqueName: \"kubernetes.io/projected/c8031931-8203-48d0-8c47-25412b3d89a6-kube-api-access-rctqn\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.809806 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.809635    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3476683f-19c4-4cbd-92c6-40968a1250dc-crio-socket\") pod \"insights-runtime-extractor-pvr5x\" (UID: \"3476683f-19c4-4cbd-92c6-40968a1250dc\") " pod="openshift-insights/insights-runtime-extractor-pvr5x"
Jul 17 17:25:22.809806 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.809666    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3476683f-19c4-4cbd-92c6-40968a1250dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pvr5x\" (UID: \"3476683f-19c4-4cbd-92c6-40968a1250dc\") " pod="openshift-insights/insights-runtime-extractor-pvr5x"
Jul 17 17:25:22.809806 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.809691    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8031931-8203-48d0-8c47-25412b3d89a6-registry-tls\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.809806 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.809720    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3476683f-19c4-4cbd-92c6-40968a1250dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pvr5x\" (UID: \"3476683f-19c4-4cbd-92c6-40968a1250dc\") " pod="openshift-insights/insights-runtime-extractor-pvr5x"
Jul 17 17:25:22.809806 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.809733    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3476683f-19c4-4cbd-92c6-40968a1250dc-crio-socket\") pod \"insights-runtime-extractor-pvr5x\" (UID: \"3476683f-19c4-4cbd-92c6-40968a1250dc\") " pod="openshift-insights/insights-runtime-extractor-pvr5x"
Jul 17 17:25:22.809806 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.809758    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8031931-8203-48d0-8c47-25412b3d89a6-bound-sa-token\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.809806 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.809789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7hvl\" (UniqueName: \"kubernetes.io/projected/3476683f-19c4-4cbd-92c6-40968a1250dc-kube-api-access-p7hvl\") pod \"insights-runtime-extractor-pvr5x\" (UID: \"3476683f-19c4-4cbd-92c6-40968a1250dc\") " pod="openshift-insights/insights-runtime-extractor-pvr5x"
Jul 17 17:25:22.810213 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.809824    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8031931-8203-48d0-8c47-25412b3d89a6-image-registry-private-configuration\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.810213 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.809842    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8031931-8203-48d0-8c47-25412b3d89a6-installation-pull-secrets\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.810213 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.809862    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8031931-8203-48d0-8c47-25412b3d89a6-registry-certificates\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.810213 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.809892    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3476683f-19c4-4cbd-92c6-40968a1250dc-data-volume\") pod \"insights-runtime-extractor-pvr5x\" (UID: \"3476683f-19c4-4cbd-92c6-40968a1250dc\") " pod="openshift-insights/insights-runtime-extractor-pvr5x"
Jul 17 17:25:22.810213 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.809968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8031931-8203-48d0-8c47-25412b3d89a6-ca-trust-extracted\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.810213 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.810042    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8031931-8203-48d0-8c47-25412b3d89a6-trusted-ca\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.810490 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.810224    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3476683f-19c4-4cbd-92c6-40968a1250dc-data-volume\") pod \"insights-runtime-extractor-pvr5x\" (UID: \"3476683f-19c4-4cbd-92c6-40968a1250dc\") " pod="openshift-insights/insights-runtime-extractor-pvr5x"
Jul 17 17:25:22.810490 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.810388    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3476683f-19c4-4cbd-92c6-40968a1250dc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pvr5x\" (UID: \"3476683f-19c4-4cbd-92c6-40968a1250dc\") " pod="openshift-insights/insights-runtime-extractor-pvr5x"
Jul 17 17:25:22.812134 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.812116    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3476683f-19c4-4cbd-92c6-40968a1250dc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pvr5x\" (UID: \"3476683f-19c4-4cbd-92c6-40968a1250dc\") " pod="openshift-insights/insights-runtime-extractor-pvr5x"
Jul 17 17:25:22.818931 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.818893    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7hvl\" (UniqueName: \"kubernetes.io/projected/3476683f-19c4-4cbd-92c6-40968a1250dc-kube-api-access-p7hvl\") pod \"insights-runtime-extractor-pvr5x\" (UID: \"3476683f-19c4-4cbd-92c6-40968a1250dc\") " pod="openshift-insights/insights-runtime-extractor-pvr5x"
Jul 17 17:25:22.884484 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.884233    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pvr5x"
Jul 17 17:25:22.911234 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.911202    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rctqn\" (UniqueName: \"kubernetes.io/projected/c8031931-8203-48d0-8c47-25412b3d89a6-kube-api-access-rctqn\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.911395 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.911246    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8031931-8203-48d0-8c47-25412b3d89a6-registry-tls\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.911395 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.911285    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8031931-8203-48d0-8c47-25412b3d89a6-bound-sa-token\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.911395 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.911327    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8031931-8203-48d0-8c47-25412b3d89a6-image-registry-private-configuration\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.911395 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.911350    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8031931-8203-48d0-8c47-25412b3d89a6-installation-pull-secrets\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.911395 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.911378    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8031931-8203-48d0-8c47-25412b3d89a6-registry-certificates\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.911658 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.911413    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8031931-8203-48d0-8c47-25412b3d89a6-ca-trust-extracted\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.912026 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.911819    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c8031931-8203-48d0-8c47-25412b3d89a6-ca-trust-extracted\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.912331 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.912296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8031931-8203-48d0-8c47-25412b3d89a6-trusted-ca\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.912643 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.912621    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c8031931-8203-48d0-8c47-25412b3d89a6-registry-certificates\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.913440 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.913414    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c8031931-8203-48d0-8c47-25412b3d89a6-trusted-ca\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.914505 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.914449    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c8031931-8203-48d0-8c47-25412b3d89a6-registry-tls\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.914682 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.914660    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c8031931-8203-48d0-8c47-25412b3d89a6-image-registry-private-configuration\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.915084 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.915065    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c8031931-8203-48d0-8c47-25412b3d89a6-installation-pull-secrets\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.929237 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.929155    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c8031931-8203-48d0-8c47-25412b3d89a6-bound-sa-token\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.930292 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.930272    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rctqn\" (UniqueName: \"kubernetes.io/projected/c8031931-8203-48d0-8c47-25412b3d89a6-kube-api-access-rctqn\") pod \"image-registry-59ccb7fcdd-gp8dc\" (UID: \"c8031931-8203-48d0-8c47-25412b3d89a6\") " pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:22.939289 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.939260    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp"]
Jul 17 17:25:22.946885 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:25:22.946303    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podccefbf20_b46d_4c4d_94be_a423f801181c.slice/crio-e6384a7f007d0006af30a712d2c088e7b8838fe13f7dd6e078535efc778de313 WatchSource:0}: Error finding container e6384a7f007d0006af30a712d2c088e7b8838fe13f7dd6e078535efc778de313: Status 404 returned error can't find the container with id e6384a7f007d0006af30a712d2c088e7b8838fe13f7dd6e078535efc778de313
Jul 17 17:25:22.976965 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:22.976658    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:23.027363 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:23.027317    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pvr5x"]
Jul 17 17:25:23.030573 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:25:23.030512    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3476683f_19c4_4cbd_92c6_40968a1250dc.slice/crio-d6f98242d7ec18339bdf0cfede74d38048645a656755e6d6e08aa800e2dacc99 WatchSource:0}: Error finding container d6f98242d7ec18339bdf0cfede74d38048645a656755e6d6e08aa800e2dacc99: Status 404 returned error can't find the container with id d6f98242d7ec18339bdf0cfede74d38048645a656755e6d6e08aa800e2dacc99
Jul 17 17:25:23.060745 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:23.060706    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b6srd" event={"ID":"8b45e0ab-c974-4125-af1b-72d77697f266","Type":"ContainerStarted","Data":"cb6aa50f7a003aec5baa54917a0c5971d8ce7e35762abefb33a992b97c06d4e0"}
Jul 17 17:25:23.060919 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:23.060858    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b6srd"
Jul 17 17:25:23.060919 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:23.060903    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b6srd" event={"ID":"8b45e0ab-c974-4125-af1b-72d77697f266","Type":"ContainerStarted","Data":"350040fcde22d503e9888e38db3bb82c326b48a037bfee6c7b03c82f1e7095eb"}
Jul 17 17:25:23.061945 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:23.061918    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp" event={"ID":"ccefbf20-b46d-4c4d-94be-a423f801181c","Type":"ContainerStarted","Data":"e6384a7f007d0006af30a712d2c088e7b8838fe13f7dd6e078535efc778de313"}
Jul 17 17:25:23.063103 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:23.063074    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pvr5x" event={"ID":"3476683f-19c4-4cbd-92c6-40968a1250dc","Type":"ContainerStarted","Data":"d6f98242d7ec18339bdf0cfede74d38048645a656755e6d6e08aa800e2dacc99"}
Jul 17 17:25:23.079004 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:23.078947    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b6srd" podStartSLOduration=35.313067235 podStartE2EDuration="37.078929622s" totalImagesPullingTime="1.765862387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:24:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:25:23.07832671 +0000 UTC m=+73.097103309" watchObservedRunningTime="2026-07-17 17:25:23.078929622 +0000 UTC m=+73.097706220"
Jul 17 17:25:23.115690 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:23.115657    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"]
Jul 17 17:25:23.118641 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:25:23.118613    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8031931_8203_48d0_8c47_25412b3d89a6.slice/crio-4333b681158ebbe1248e543580209f459d7a5b412b06ad36fb565327b4d9e3a1 WatchSource:0}: Error finding container 4333b681158ebbe1248e543580209f459d7a5b412b06ad36fb565327b4d9e3a1: Status 404 returned error can't find the container with id 4333b681158ebbe1248e543580209f459d7a5b412b06ad36fb565327b4d9e3a1
Jul 17 17:25:24.069961 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:24.069859    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc" event={"ID":"c8031931-8203-48d0-8c47-25412b3d89a6","Type":"ContainerStarted","Data":"375b71adce6efc335ba79e9041b24912fa8623a2b0d2d93612f489292c2c80e3"}
Jul 17 17:25:24.069961 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:24.069926    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc" event={"ID":"c8031931-8203-48d0-8c47-25412b3d89a6","Type":"ContainerStarted","Data":"4333b681158ebbe1248e543580209f459d7a5b412b06ad36fb565327b4d9e3a1"}
Jul 17 17:25:24.070990 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:24.070098    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:24.089930 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:24.089865    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc" podStartSLOduration=2.089844393 podStartE2EDuration="2.089844393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:25:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:25:24.089380285 +0000 UTC m=+74.108156886" watchObservedRunningTime="2026-07-17 17:25:24.089844393 +0000 UTC m=+74.108620970"
Jul 17 17:25:25.942342 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:25.942303    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53a3cf11-c213-41a8-9f95-0c1563f42f3a-service-ca-bundle\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:25:25.943003 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:25.942979    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53a3cf11-c213-41a8-9f95-0c1563f42f3a-service-ca-bundle\") pod \"router-default-ccd4cd878-b9n7t\" (UID: \"53a3cf11-c213-41a8-9f95-0c1563f42f3a\") " pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:25:26.180811 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:26.180770    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xjfjt\""
Jul 17 17:25:26.189091 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:26.189054    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:25:29.987084 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:29.987053    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-ccd4cd878-b9n7t"]
Jul 17 17:25:29.989757 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:25:29.989729    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53a3cf11_c213_41a8_9f95_0c1563f42f3a.slice/crio-c09cb5f503505d89598ba251466db76ca33908dbc2090fa0030d5cd1adec6270 WatchSource:0}: Error finding container c09cb5f503505d89598ba251466db76ca33908dbc2090fa0030d5cd1adec6270: Status 404 returned error can't find the container with id c09cb5f503505d89598ba251466db76ca33908dbc2090fa0030d5cd1adec6270
Jul 17 17:25:30.096325 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:30.096298    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pvr5x" event={"ID":"3476683f-19c4-4cbd-92c6-40968a1250dc","Type":"ContainerStarted","Data":"89dddeb80e78b47680bff9158e2a5b2cfe81bd15c474bfc9789247c33994e10c"}
Jul 17 17:25:30.097962 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:30.097906    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-ccd4cd878-b9n7t" event={"ID":"53a3cf11-c213-41a8-9f95-0c1563f42f3a","Type":"ContainerStarted","Data":"331095bb6fe39539facc41f6fd8c3b29f80771394db6ef1b33a4c9fe1eb388be"}
Jul 17 17:25:30.097962 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:30.097952    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-ccd4cd878-b9n7t" event={"ID":"53a3cf11-c213-41a8-9f95-0c1563f42f3a","Type":"ContainerStarted","Data":"c09cb5f503505d89598ba251466db76ca33908dbc2090fa0030d5cd1adec6270"}
Jul 17 17:25:30.100095 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:30.100067    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp" event={"ID":"ccefbf20-b46d-4c4d-94be-a423f801181c","Type":"ContainerStarted","Data":"d3f0f4e634384d32d22855bce9797c4d3ebaf32e54ec853fed7dbf9a58161794"}
Jul 17 17:25:30.100206 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:30.100105    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp" event={"ID":"ccefbf20-b46d-4c4d-94be-a423f801181c","Type":"ContainerStarted","Data":"e5d8edc7c81070b5abeba8782d991a0c7a033820fd3d8a42c91f220aebd863b2"}
Jul 17 17:25:30.115633 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:30.115420    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-ccd4cd878-b9n7t" podStartSLOduration=36.115402785 podStartE2EDuration="36.115402785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:24:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:25:30.114810045 +0000 UTC m=+80.133586643" watchObservedRunningTime="2026-07-17 17:25:30.115402785 +0000 UTC m=+80.134179383"
Jul 17 17:25:30.189588 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:30.189553    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:25:30.192109 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:30.192073    2576 patch_prober.go:28] interesting pod/router-default-ccd4cd878-b9n7t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld
Jul 17 17:25:30.192109 ip-10-0-143-187 kubenswrapper[2576]: [+]has-synced ok
Jul 17 17:25:30.192109 ip-10-0-143-187 kubenswrapper[2576]: [+]process-running ok
Jul 17 17:25:30.192109 ip-10-0-143-187 kubenswrapper[2576]: healthz check failed
Jul 17 17:25:30.192390 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:30.192138    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-ccd4cd878-b9n7t" podUID="53a3cf11-c213-41a8-9f95-0c1563f42f3a" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 17 17:25:31.106209 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:31.106144    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp" event={"ID":"ccefbf20-b46d-4c4d-94be-a423f801181c","Type":"ContainerStarted","Data":"2d26f597b389eb34ab5ca8f009cc10a24b2f54dc85fd0e9e29dbda3ef1a8ec18"}
Jul 17 17:25:31.125506 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:31.125446    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5799b59b97-96sdp" podStartSLOduration=2.176891507 podStartE2EDuration="9.125426857s" totalImagesPullingTime="6.94853535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:25:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:25:31.124287241 +0000 UTC m=+81.143063849" watchObservedRunningTime="2026-07-17 17:25:31.125426857 +0000 UTC m=+81.144203454"
Jul 17 17:25:31.191004 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:31.190973    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:25:32.111280 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:32.111242    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:25:32.112595 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:32.112573    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-ccd4cd878-b9n7t"
Jul 17 17:25:32.569516 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:32.569394    2576 patch_prober.go:28] interesting pod/image-registry-594dfb5cc5-4zxww container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 17 17:25:32.569516 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:32.569462    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww" podUID="9fdae5cb-898e-4d87-a602-2032a59bb948" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 17:25:33.072696 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:33.072657    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b6srd"
Jul 17 17:25:34.121711 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:34.121655    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pvr5x" event={"ID":"3476683f-19c4-4cbd-92c6-40968a1250dc","Type":"ContainerStarted","Data":"0ed7ca78f03235b0ea2147f9d0661fe4db759bc71979c6407bfa995859fada54"}
Jul 17 17:25:37.138581 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:37.138486    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pvr5x" event={"ID":"3476683f-19c4-4cbd-92c6-40968a1250dc","Type":"ContainerStarted","Data":"962c1a8163f0492dae471d5ae774f1d720bc533549da5ae5bbbcde62dadd96df"}
Jul 17 17:25:37.157427 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:37.157371    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pvr5x" podStartSLOduration=1.483410937 podStartE2EDuration="15.157356053s" totalImagesPullingTime="13.673945116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:25:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:25:37.155309232 +0000 UTC m=+87.174085830" watchObservedRunningTime="2026-07-17 17:25:37.157356053 +0000 UTC m=+87.176132650"
Jul 17 17:25:42.568513 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:42.568484    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:25:45.079764 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:45.079736    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59ccb7fcdd-gp8dc"
Jul 17 17:25:47.589142 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:47.589076    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww" podUID="9fdae5cb-898e-4d87-a602-2032a59bb948" containerName="registry" containerID="cri-o://f29eee02473065aa10830616b11b901dadf0132b57a5b96e3559aec182e52f3d" gracePeriod=30
Jul 17 17:25:47.832156 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:47.832132    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:25:48.018080 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.018044    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9fdae5cb-898e-4d87-a602-2032a59bb948-installation-pull-secrets\") pod \"9fdae5cb-898e-4d87-a602-2032a59bb948\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") "
Jul 17 17:25:48.018080 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.018084    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9fdae5cb-898e-4d87-a602-2032a59bb948-ca-trust-extracted\") pod \"9fdae5cb-898e-4d87-a602-2032a59bb948\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") "
Jul 17 17:25:48.018384 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.018115    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-tls\") pod \"9fdae5cb-898e-4d87-a602-2032a59bb948\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") "
Jul 17 17:25:48.018384 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.018139    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-certificates\") pod \"9fdae5cb-898e-4d87-a602-2032a59bb948\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") "
Jul 17 17:25:48.018384 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.018159    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9fdae5cb-898e-4d87-a602-2032a59bb948-image-registry-private-configuration\") pod \"9fdae5cb-898e-4d87-a602-2032a59bb948\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") "
Jul 17 17:25:48.018384 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.018203    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsmmk\" (UniqueName: \"kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-kube-api-access-vsmmk\") pod \"9fdae5cb-898e-4d87-a602-2032a59bb948\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") "
Jul 17 17:25:48.018384 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.018218    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9fdae5cb-898e-4d87-a602-2032a59bb948-trusted-ca\") pod \"9fdae5cb-898e-4d87-a602-2032a59bb948\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") "
Jul 17 17:25:48.018384 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.018263    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-bound-sa-token\") pod \"9fdae5cb-898e-4d87-a602-2032a59bb948\" (UID: \"9fdae5cb-898e-4d87-a602-2032a59bb948\") "
Jul 17 17:25:48.018909 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.018851    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9fdae5cb-898e-4d87-a602-2032a59bb948" (UID: "9fdae5cb-898e-4d87-a602-2032a59bb948"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:25:48.018909 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.018863    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fdae5cb-898e-4d87-a602-2032a59bb948-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9fdae5cb-898e-4d87-a602-2032a59bb948" (UID: "9fdae5cb-898e-4d87-a602-2032a59bb948"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:25:48.021195 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.021140    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9fdae5cb-898e-4d87-a602-2032a59bb948" (UID: "9fdae5cb-898e-4d87-a602-2032a59bb948"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:25:48.021195 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.021154    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fdae5cb-898e-4d87-a602-2032a59bb948-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9fdae5cb-898e-4d87-a602-2032a59bb948" (UID: "9fdae5cb-898e-4d87-a602-2032a59bb948"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 17:25:48.021347 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.021256    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fdae5cb-898e-4d87-a602-2032a59bb948-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9fdae5cb-898e-4d87-a602-2032a59bb948" (UID: "9fdae5cb-898e-4d87-a602-2032a59bb948"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 17:25:48.021347 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.021236    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-kube-api-access-vsmmk" (OuterVolumeSpecName: "kube-api-access-vsmmk") pod "9fdae5cb-898e-4d87-a602-2032a59bb948" (UID: "9fdae5cb-898e-4d87-a602-2032a59bb948"). InnerVolumeSpecName "kube-api-access-vsmmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:25:48.021347 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.021286    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9fdae5cb-898e-4d87-a602-2032a59bb948" (UID: "9fdae5cb-898e-4d87-a602-2032a59bb948"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:25:48.027399 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.027375    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fdae5cb-898e-4d87-a602-2032a59bb948-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9fdae5cb-898e-4d87-a602-2032a59bb948" (UID: "9fdae5cb-898e-4d87-a602-2032a59bb948"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:25:48.119312 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.119275    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-bound-sa-token\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:25:48.119312 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.119307    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9fdae5cb-898e-4d87-a602-2032a59bb948-installation-pull-secrets\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:25:48.119312 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.119319    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9fdae5cb-898e-4d87-a602-2032a59bb948-ca-trust-extracted\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:25:48.119518 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.119328    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-tls\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:25:48.119518 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.119337    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9fdae5cb-898e-4d87-a602-2032a59bb948-registry-certificates\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:25:48.119518 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.119347    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9fdae5cb-898e-4d87-a602-2032a59bb948-image-registry-private-configuration\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:25:48.119518 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.119357    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsmmk\" (UniqueName: \"kubernetes.io/projected/9fdae5cb-898e-4d87-a602-2032a59bb948-kube-api-access-vsmmk\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:25:48.119518 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.119365    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9fdae5cb-898e-4d87-a602-2032a59bb948-trusted-ca\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:25:48.180634 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.180602    2576 generic.go:356] "Generic (PLEG): container finished" podID="9fdae5cb-898e-4d87-a602-2032a59bb948" containerID="f29eee02473065aa10830616b11b901dadf0132b57a5b96e3559aec182e52f3d" exitCode=0
Jul 17 17:25:48.180803 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.180653    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww"
Jul 17 17:25:48.180803 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.180665    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww" event={"ID":"9fdae5cb-898e-4d87-a602-2032a59bb948","Type":"ContainerDied","Data":"f29eee02473065aa10830616b11b901dadf0132b57a5b96e3559aec182e52f3d"}
Jul 17 17:25:48.180803 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.180726    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-594dfb5cc5-4zxww" event={"ID":"9fdae5cb-898e-4d87-a602-2032a59bb948","Type":"ContainerDied","Data":"91f0b08f5d122b94730770d93883010d4eb0a97e348548ba7889f92c9acc408d"}
Jul 17 17:25:48.180803 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.180746    2576 scope.go:117] "RemoveContainer" containerID="f29eee02473065aa10830616b11b901dadf0132b57a5b96e3559aec182e52f3d"
Jul 17 17:25:48.189422 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.189402    2576 scope.go:117] "RemoveContainer" containerID="f29eee02473065aa10830616b11b901dadf0132b57a5b96e3559aec182e52f3d"
Jul 17 17:25:48.189674 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:25:48.189654    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f29eee02473065aa10830616b11b901dadf0132b57a5b96e3559aec182e52f3d\": container with ID starting with f29eee02473065aa10830616b11b901dadf0132b57a5b96e3559aec182e52f3d not found: ID does not exist" containerID="f29eee02473065aa10830616b11b901dadf0132b57a5b96e3559aec182e52f3d"
Jul 17 17:25:48.189726 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.189684    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f29eee02473065aa10830616b11b901dadf0132b57a5b96e3559aec182e52f3d"} err="failed to get container status \"f29eee02473065aa10830616b11b901dadf0132b57a5b96e3559aec182e52f3d\": rpc error: code = NotFound desc = could not find container \"f29eee02473065aa10830616b11b901dadf0132b57a5b96e3559aec182e52f3d\": container with ID starting with f29eee02473065aa10830616b11b901dadf0132b57a5b96e3559aec182e52f3d not found: ID does not exist"
Jul 17 17:25:48.201554 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.201527    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-594dfb5cc5-4zxww"]
Jul 17 17:25:48.205514 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.205489    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-594dfb5cc5-4zxww"]
Jul 17 17:25:48.520968 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:48.520922    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fdae5cb-898e-4d87-a602-2032a59bb948" path="/var/lib/kubelet/pods/9fdae5cb-898e-4d87-a602-2032a59bb948/volumes"
Jul 17 17:25:52.057661 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:52.057629    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f828l"
Jul 17 17:25:57.180243 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.180206    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cqgrw"]
Jul 17 17:25:57.180741 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.180453    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fdae5cb-898e-4d87-a602-2032a59bb948" containerName="registry"
Jul 17 17:25:57.180741 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.180463    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fdae5cb-898e-4d87-a602-2032a59bb948" containerName="registry"
Jul 17 17:25:57.180741 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.180513    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fdae5cb-898e-4d87-a602-2032a59bb948" containerName="registry"
Jul 17 17:25:57.184550 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.184528    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.192565 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.192539    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 17 17:25:57.193982 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.193962    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 17 17:25:57.194088 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.193966    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 17 17:25:57.194088 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.194017    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2zmsl\""
Jul 17 17:25:57.194286 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.194268    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 17 17:25:57.194382 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.194303    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 17 17:25:57.194443 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.194430    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 17 17:25:57.272671 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.272628    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a852985-eef4-45f9-88da-2373e6404a22-node-exporter-tls\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.272671 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.272670    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a852985-eef4-45f9-88da-2373e6404a22-node-exporter-wtmp\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.272917 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.272689    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a852985-eef4-45f9-88da-2373e6404a22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.272917 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.272759    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a852985-eef4-45f9-88da-2373e6404a22-node-exporter-textfile\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.272917 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.272802    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a852985-eef4-45f9-88da-2373e6404a22-node-exporter-accelerators-collector-config\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.272917 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.272824    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a852985-eef4-45f9-88da-2373e6404a22-sys\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.272917 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.272873    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a852985-eef4-45f9-88da-2373e6404a22-root\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.272917 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.272909    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a852985-eef4-45f9-88da-2373e6404a22-metrics-client-ca\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.273132 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.272934    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx6bm\" (UniqueName: \"kubernetes.io/projected/5a852985-eef4-45f9-88da-2373e6404a22-kube-api-access-hx6bm\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.373625 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.373583    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a852985-eef4-45f9-88da-2373e6404a22-metrics-client-ca\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.373625 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.373632    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx6bm\" (UniqueName: \"kubernetes.io/projected/5a852985-eef4-45f9-88da-2373e6404a22-kube-api-access-hx6bm\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.373874 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.373797    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a852985-eef4-45f9-88da-2373e6404a22-node-exporter-tls\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.373874 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.373836    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a852985-eef4-45f9-88da-2373e6404a22-node-exporter-wtmp\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.373874 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.373855    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a852985-eef4-45f9-88da-2373e6404a22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.374069 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.373899    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a852985-eef4-45f9-88da-2373e6404a22-node-exporter-textfile\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.374069 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.373922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a852985-eef4-45f9-88da-2373e6404a22-node-exporter-accelerators-collector-config\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.374069 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.373956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a852985-eef4-45f9-88da-2373e6404a22-sys\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.374069 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.373989    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a852985-eef4-45f9-88da-2373e6404a22-root\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.374069 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.374008    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a852985-eef4-45f9-88da-2373e6404a22-node-exporter-wtmp\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.374069 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.374065    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a852985-eef4-45f9-88da-2373e6404a22-root\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.374381 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.374106    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a852985-eef4-45f9-88da-2373e6404a22-sys\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.374381 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.374320    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a852985-eef4-45f9-88da-2373e6404a22-metrics-client-ca\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.374381 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.374369    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a852985-eef4-45f9-88da-2373e6404a22-node-exporter-textfile\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.374586 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.374562    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a852985-eef4-45f9-88da-2373e6404a22-node-exporter-accelerators-collector-config\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.376347 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.376325    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a852985-eef4-45f9-88da-2373e6404a22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.376490 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.376468    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a852985-eef4-45f9-88da-2373e6404a22-node-exporter-tls\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.382577 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.382551    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx6bm\" (UniqueName: \"kubernetes.io/projected/5a852985-eef4-45f9-88da-2373e6404a22-kube-api-access-hx6bm\") pod \"node-exporter-cqgrw\" (UID: \"5a852985-eef4-45f9-88da-2373e6404a22\") " pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.493921 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:57.493883    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cqgrw"
Jul 17 17:25:57.504438 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:25:57.504409    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a852985_eef4_45f9_88da_2373e6404a22.slice/crio-d84ec83fb53931c6709b511f119d2b3aa402738c67eb90c3857770d89026878b WatchSource:0}: Error finding container d84ec83fb53931c6709b511f119d2b3aa402738c67eb90c3857770d89026878b: Status 404 returned error can't find the container with id d84ec83fb53931c6709b511f119d2b3aa402738c67eb90c3857770d89026878b
Jul 17 17:25:58.216598 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:58.216559    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cqgrw" event={"ID":"5a852985-eef4-45f9-88da-2373e6404a22","Type":"ContainerStarted","Data":"d84ec83fb53931c6709b511f119d2b3aa402738c67eb90c3857770d89026878b"}
Jul 17 17:25:59.221764 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:59.221723    2576 generic.go:356] "Generic (PLEG): container finished" podID="5a852985-eef4-45f9-88da-2373e6404a22" containerID="b3fa02f85ca74b99deb66fa1574f9ecac3bd35e1dabf338bb2022e523044baf7" exitCode=0
Jul 17 17:25:59.222142 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:25:59.221799    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cqgrw" event={"ID":"5a852985-eef4-45f9-88da-2373e6404a22","Type":"ContainerDied","Data":"b3fa02f85ca74b99deb66fa1574f9ecac3bd35e1dabf338bb2022e523044baf7"}
Jul 17 17:26:00.227501 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:26:00.227462    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cqgrw" event={"ID":"5a852985-eef4-45f9-88da-2373e6404a22","Type":"ContainerStarted","Data":"63f3d980bc94820daf7672ebdaa49b73cc8cfb534c363c3a2ee9aaf39bdf7dca"}
Jul 17 17:26:00.227908 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:26:00.227524    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cqgrw" event={"ID":"5a852985-eef4-45f9-88da-2373e6404a22","Type":"ContainerStarted","Data":"d792d87443a37a9eede6b668d6f5f781783374445ec399a2cded8f9ba2c172d7"}
Jul 17 17:26:22.133045 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:26:22.133008    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ccd4cd878-b9n7t_53a3cf11-c213-41a8-9f95-0c1563f42f3a/router/0.log"
Jul 17 17:26:22.145824 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:26:22.145788    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hndwr_dea89e0b-2f80-4f56-a41b-707e580fca42/serve-healthcheck-canary/0.log"
Jul 17 17:26:23.305953 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:26:23.305919    2576 generic.go:356] "Generic (PLEG): container finished" podID="8589fbe7-8408-49d1-9197-bc82c6f3c7c4" containerID="3ca3d8886baf30fbd96cee6f791b7b6fa91c0b683ec734a3f955a08645debcce" exitCode=0
Jul 17 17:26:23.306377 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:26:23.305968    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-jbhqq" event={"ID":"8589fbe7-8408-49d1-9197-bc82c6f3c7c4","Type":"ContainerDied","Data":"3ca3d8886baf30fbd96cee6f791b7b6fa91c0b683ec734a3f955a08645debcce"}
Jul 17 17:26:23.306377 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:26:23.306298    2576 scope.go:117] "RemoveContainer" containerID="3ca3d8886baf30fbd96cee6f791b7b6fa91c0b683ec734a3f955a08645debcce"
Jul 17 17:26:23.322813 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:26:23.322758    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cqgrw" podStartSLOduration=25.206510351 podStartE2EDuration="26.3227397s" totalImagesPullingTime="1.048491095s" totalInitContainerRuntime="67.738254ms" isStatefulPod=true podCreationTimestamp="2026-07-17 17:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:26:00.249614697 +0000 UTC m=+110.268391296" watchObservedRunningTime="2026-07-17 17:26:23.3227397 +0000 UTC m=+133.341516297"
Jul 17 17:26:24.310842 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:26:24.310805    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-jbhqq" event={"ID":"8589fbe7-8408-49d1-9197-bc82c6f3c7c4","Type":"ContainerStarted","Data":"98536d361bec0291f730ff14eb90cc0a568ab0f9417a2152fb7519b345833040"}
Jul 17 17:26:33.345099 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:26:33.345050    2576 generic.go:356] "Generic (PLEG): container finished" podID="5fe08929-8648-486b-9bcc-0d3f5c7645b1" containerID="8f47e35d4a9124dad8571d547c4025bd9bc339afe9f998cf8d855f2ffc0a7296" exitCode=0
Jul 17 17:26:33.345601 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:26:33.345119    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kfm4v" event={"ID":"5fe08929-8648-486b-9bcc-0d3f5c7645b1","Type":"ContainerDied","Data":"8f47e35d4a9124dad8571d547c4025bd9bc339afe9f998cf8d855f2ffc0a7296"}
Jul 17 17:26:33.345601 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:26:33.345520    2576 scope.go:117] "RemoveContainer" containerID="8f47e35d4a9124dad8571d547c4025bd9bc339afe9f998cf8d855f2ffc0a7296"
Jul 17 17:26:34.357910 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:26:34.357869    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kfm4v" event={"ID":"5fe08929-8648-486b-9bcc-0d3f5c7645b1","Type":"ContainerStarted","Data":"a32990f749d4f0db315b38fd442db30e537b2b75b5043dcdf693b6765145c8a9"}
Jul 17 17:29:10.413229 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:10.413142    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 17 17:29:45.415346 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.415316    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx"]
Jul 17 17:29:45.418470 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.418454    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx"
Jul 17 17:29:45.421499 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.421478    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 17 17:29:45.421739 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.421723    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 17 17:29:45.421897 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.421874    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l7hd7\""
Jul 17 17:29:45.422288 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.422266    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 17 17:29:45.422408 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.422372    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 17 17:29:45.432989 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.432968    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx"]
Jul 17 17:29:45.477097 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.477069    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/580be012-2cdd-49c6-8b3b-6bbd8390019d-tmp\") pod \"opendatahub-operator-controller-manager-6cbb795d5f-7p7kx\" (UID: \"580be012-2cdd-49c6-8b3b-6bbd8390019d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx"
Jul 17 17:29:45.477230 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.477106    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7ldw\" (UniqueName: \"kubernetes.io/projected/580be012-2cdd-49c6-8b3b-6bbd8390019d-kube-api-access-b7ldw\") pod \"opendatahub-operator-controller-manager-6cbb795d5f-7p7kx\" (UID: \"580be012-2cdd-49c6-8b3b-6bbd8390019d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx"
Jul 17 17:29:45.477230 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.477133    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/580be012-2cdd-49c6-8b3b-6bbd8390019d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cbb795d5f-7p7kx\" (UID: \"580be012-2cdd-49c6-8b3b-6bbd8390019d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx"
Jul 17 17:29:45.477230 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.477184    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/580be012-2cdd-49c6-8b3b-6bbd8390019d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cbb795d5f-7p7kx\" (UID: \"580be012-2cdd-49c6-8b3b-6bbd8390019d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx"
Jul 17 17:29:45.477358 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.477253    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/580be012-2cdd-49c6-8b3b-6bbd8390019d-manifests\") pod \"opendatahub-operator-controller-manager-6cbb795d5f-7p7kx\" (UID: \"580be012-2cdd-49c6-8b3b-6bbd8390019d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx"
Jul 17 17:29:45.578022 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.577984    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/580be012-2cdd-49c6-8b3b-6bbd8390019d-tmp\") pod \"opendatahub-operator-controller-manager-6cbb795d5f-7p7kx\" (UID: \"580be012-2cdd-49c6-8b3b-6bbd8390019d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx"
Jul 17 17:29:45.578141 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.578037    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7ldw\" (UniqueName: \"kubernetes.io/projected/580be012-2cdd-49c6-8b3b-6bbd8390019d-kube-api-access-b7ldw\") pod \"opendatahub-operator-controller-manager-6cbb795d5f-7p7kx\" (UID: \"580be012-2cdd-49c6-8b3b-6bbd8390019d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx"
Jul 17 17:29:45.578141 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.578077    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/580be012-2cdd-49c6-8b3b-6bbd8390019d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cbb795d5f-7p7kx\" (UID: \"580be012-2cdd-49c6-8b3b-6bbd8390019d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx"
Jul 17 17:29:45.578141 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.578110    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/580be012-2cdd-49c6-8b3b-6bbd8390019d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cbb795d5f-7p7kx\" (UID: \"580be012-2cdd-49c6-8b3b-6bbd8390019d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx"
Jul 17 17:29:45.578308 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.578154    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/580be012-2cdd-49c6-8b3b-6bbd8390019d-manifests\") pod \"opendatahub-operator-controller-manager-6cbb795d5f-7p7kx\" (UID: \"580be012-2cdd-49c6-8b3b-6bbd8390019d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx"
Jul 17 17:29:45.578501 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.578481    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/580be012-2cdd-49c6-8b3b-6bbd8390019d-manifests\") pod \"opendatahub-operator-controller-manager-6cbb795d5f-7p7kx\" (UID: \"580be012-2cdd-49c6-8b3b-6bbd8390019d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx"
Jul 17 17:29:45.580360 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.580335    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/580be012-2cdd-49c6-8b3b-6bbd8390019d-tmp\") pod \"opendatahub-operator-controller-manager-6cbb795d5f-7p7kx\" (UID: \"580be012-2cdd-49c6-8b3b-6bbd8390019d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx"
Jul 17 17:29:45.580509 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.580491    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/580be012-2cdd-49c6-8b3b-6bbd8390019d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cbb795d5f-7p7kx\" (UID: \"580be012-2cdd-49c6-8b3b-6bbd8390019d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx"
Jul 17 17:29:45.580679 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.580658    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/580be012-2cdd-49c6-8b3b-6bbd8390019d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cbb795d5f-7p7kx\" (UID: \"580be012-2cdd-49c6-8b3b-6bbd8390019d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx"
Jul 17 17:29:45.586600 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.586577    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7ldw\" (UniqueName: \"kubernetes.io/projected/580be012-2cdd-49c6-8b3b-6bbd8390019d-kube-api-access-b7ldw\") pod \"opendatahub-operator-controller-manager-6cbb795d5f-7p7kx\" (UID: \"580be012-2cdd-49c6-8b3b-6bbd8390019d\") " pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx"
Jul 17 17:29:45.728435 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.728412    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx"
Jul 17 17:29:45.857438 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.857407    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx"]
Jul 17 17:29:45.862384 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:29:45.862352    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod580be012_2cdd_49c6_8b3b_6bbd8390019d.slice/crio-fc4a6d838cd6e1eced684c725cddfeb85eebf561b9188c133014246ede9c025c WatchSource:0}: Error finding container fc4a6d838cd6e1eced684c725cddfeb85eebf561b9188c133014246ede9c025c: Status 404 returned error can't find the container with id fc4a6d838cd6e1eced684c725cddfeb85eebf561b9188c133014246ede9c025c
Jul 17 17:29:45.864259 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:45.864241    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 17:29:46.015756 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:46.015684    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx" event={"ID":"580be012-2cdd-49c6-8b3b-6bbd8390019d","Type":"ContainerStarted","Data":"fc4a6d838cd6e1eced684c725cddfeb85eebf561b9188c133014246ede9c025c"}
Jul 17 17:29:49.030038 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:49.029999    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx" event={"ID":"580be012-2cdd-49c6-8b3b-6bbd8390019d","Type":"ContainerStarted","Data":"193b202c55f81d4f897df1c93e4070245b22ed25e05dce296f38728121658595"}
Jul 17 17:29:50.034395 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:50.034356    2576 generic.go:356] "Generic (PLEG): container finished" podID="580be012-2cdd-49c6-8b3b-6bbd8390019d" containerID="193b202c55f81d4f897df1c93e4070245b22ed25e05dce296f38728121658595" exitCode=0
Jul 17 17:29:50.034758 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:50.034444    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx" event={"ID":"580be012-2cdd-49c6-8b3b-6bbd8390019d","Type":"ContainerDied","Data":"193b202c55f81d4f897df1c93e4070245b22ed25e05dce296f38728121658595"}
Jul 17 17:29:51.040401 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:51.040365    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx" event={"ID":"580be012-2cdd-49c6-8b3b-6bbd8390019d","Type":"ContainerStarted","Data":"60a29db2ba251725b2edf76d9b2c3b108801b95b1c26f0802101c24b9e7fe583"}
Jul 17 17:29:51.040889 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:51.040462    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx"
Jul 17 17:29:51.062509 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:29:51.062448    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx" podStartSLOduration=1.654965925 podStartE2EDuration="6.062428242s" totalImagesPullingTime="3.324738256s" totalInitContainerRuntime="1.082724061s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:29:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:29:51.060931881 +0000 UTC m=+341.079708479" watchObservedRunningTime="2026-07-17 17:29:51.062428242 +0000 UTC m=+341.081204832"
Jul 17 17:30:02.046652 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:02.046612    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6cbb795d5f-7p7kx"
Jul 17 17:30:09.830742 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:09.830707    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fjmjn"]
Jul 17 17:30:09.834065 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:09.834045    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fjmjn"
Jul 17 17:30:09.837197 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:09.837157    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 17 17:30:09.837324 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:09.837217    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-v54sg\""
Jul 17 17:30:09.844949 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:09.844924    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fjmjn"]
Jul 17 17:30:09.965300 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:09.965259    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wl84\" (UniqueName: \"kubernetes.io/projected/57c93eef-4752-4139-a123-9377a3661828-kube-api-access-2wl84\") pod \"odh-model-controller-7998c67dc4-fjmjn\" (UID: \"57c93eef-4752-4139-a123-9377a3661828\") " pod="opendatahub/odh-model-controller-7998c67dc4-fjmjn"
Jul 17 17:30:09.965507 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:09.965368    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57c93eef-4752-4139-a123-9377a3661828-cert\") pod \"odh-model-controller-7998c67dc4-fjmjn\" (UID: \"57c93eef-4752-4139-a123-9377a3661828\") " pod="opendatahub/odh-model-controller-7998c67dc4-fjmjn"
Jul 17 17:30:10.066496 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:10.066463    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57c93eef-4752-4139-a123-9377a3661828-cert\") pod \"odh-model-controller-7998c67dc4-fjmjn\" (UID: \"57c93eef-4752-4139-a123-9377a3661828\") " pod="opendatahub/odh-model-controller-7998c67dc4-fjmjn"
Jul 17 17:30:10.066651 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:10.066528    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wl84\" (UniqueName: \"kubernetes.io/projected/57c93eef-4752-4139-a123-9377a3661828-kube-api-access-2wl84\") pod \"odh-model-controller-7998c67dc4-fjmjn\" (UID: \"57c93eef-4752-4139-a123-9377a3661828\") " pod="opendatahub/odh-model-controller-7998c67dc4-fjmjn"
Jul 17 17:30:10.066651 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:30:10.066619    2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 17 17:30:10.066735 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:30:10.066699    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57c93eef-4752-4139-a123-9377a3661828-cert podName:57c93eef-4752-4139-a123-9377a3661828 nodeName:}" failed. No retries permitted until 2026-07-17 17:30:10.566678854 +0000 UTC m=+360.585455441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/57c93eef-4752-4139-a123-9377a3661828-cert") pod "odh-model-controller-7998c67dc4-fjmjn" (UID: "57c93eef-4752-4139-a123-9377a3661828") : secret "odh-model-controller-webhook-cert" not found
Jul 17 17:30:10.079364 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:10.079326    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wl84\" (UniqueName: \"kubernetes.io/projected/57c93eef-4752-4139-a123-9377a3661828-kube-api-access-2wl84\") pod \"odh-model-controller-7998c67dc4-fjmjn\" (UID: \"57c93eef-4752-4139-a123-9377a3661828\") " pod="opendatahub/odh-model-controller-7998c67dc4-fjmjn"
Jul 17 17:30:10.523494 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:10.523463    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lv4nm"]
Jul 17 17:30:10.527981 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:10.527962    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lv4nm"
Jul 17 17:30:10.530499 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:10.530476    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 17 17:30:10.530894 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:10.530877    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-gdlxt\""
Jul 17 17:30:10.538778 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:10.538756    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lv4nm"]
Jul 17 17:30:10.570261 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:10.570229    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57c93eef-4752-4139-a123-9377a3661828-cert\") pod \"odh-model-controller-7998c67dc4-fjmjn\" (UID: \"57c93eef-4752-4139-a123-9377a3661828\") " pod="opendatahub/odh-model-controller-7998c67dc4-fjmjn"
Jul 17 17:30:10.572751 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:10.572722    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57c93eef-4752-4139-a123-9377a3661828-cert\") pod \"odh-model-controller-7998c67dc4-fjmjn\" (UID: \"57c93eef-4752-4139-a123-9377a3661828\") " pod="opendatahub/odh-model-controller-7998c67dc4-fjmjn"
Jul 17 17:30:10.671131 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:10.671088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20b6149a-0774-47af-bcff-b5a61d9abef1-tls-certs\") pod \"model-serving-api-54d89bd5fc-lv4nm\" (UID: \"20b6149a-0774-47af-bcff-b5a61d9abef1\") " pod="opendatahub/model-serving-api-54d89bd5fc-lv4nm"
Jul 17 17:30:10.671350 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:10.671287    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz6nz\" (UniqueName: \"kubernetes.io/projected/20b6149a-0774-47af-bcff-b5a61d9abef1-kube-api-access-tz6nz\") pod \"model-serving-api-54d89bd5fc-lv4nm\" (UID: \"20b6149a-0774-47af-bcff-b5a61d9abef1\") " pod="opendatahub/model-serving-api-54d89bd5fc-lv4nm"
Jul 17 17:30:10.747100 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:10.747062    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-v54sg\""
Jul 17 17:30:10.755427 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:10.755393    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fjmjn"
Jul 17 17:30:10.771966 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:10.771926    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20b6149a-0774-47af-bcff-b5a61d9abef1-tls-certs\") pod \"model-serving-api-54d89bd5fc-lv4nm\" (UID: \"20b6149a-0774-47af-bcff-b5a61d9abef1\") " pod="opendatahub/model-serving-api-54d89bd5fc-lv4nm"
Jul 17 17:30:10.772106 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:10.772034    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz6nz\" (UniqueName: \"kubernetes.io/projected/20b6149a-0774-47af-bcff-b5a61d9abef1-kube-api-access-tz6nz\") pod \"model-serving-api-54d89bd5fc-lv4nm\" (UID: \"20b6149a-0774-47af-bcff-b5a61d9abef1\") " pod="opendatahub/model-serving-api-54d89bd5fc-lv4nm"
Jul 17 17:30:10.772106 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:30:10.772090    2576 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 17 17:30:10.772254 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:30:10.772187    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20b6149a-0774-47af-bcff-b5a61d9abef1-tls-certs podName:20b6149a-0774-47af-bcff-b5a61d9abef1 nodeName:}" failed. No retries permitted until 2026-07-17 17:30:11.272148639 +0000 UTC m=+361.290925220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/20b6149a-0774-47af-bcff-b5a61d9abef1-tls-certs") pod "model-serving-api-54d89bd5fc-lv4nm" (UID: "20b6149a-0774-47af-bcff-b5a61d9abef1") : secret "model-serving-api-tls" not found
Jul 17 17:30:10.781188 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:10.781106    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz6nz\" (UniqueName: \"kubernetes.io/projected/20b6149a-0774-47af-bcff-b5a61d9abef1-kube-api-access-tz6nz\") pod \"model-serving-api-54d89bd5fc-lv4nm\" (UID: \"20b6149a-0774-47af-bcff-b5a61d9abef1\") " pod="opendatahub/model-serving-api-54d89bd5fc-lv4nm"
Jul 17 17:30:10.889797 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:10.889749    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fjmjn"]
Jul 17 17:30:10.892001 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:30:10.891974    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57c93eef_4752_4139_a123_9377a3661828.slice/crio-30cc79239de0b457f05ff5410fdfa2592ae841fe08619d4a31a838c40954e8f0 WatchSource:0}: Error finding container 30cc79239de0b457f05ff5410fdfa2592ae841fe08619d4a31a838c40954e8f0: Status 404 returned error can't find the container with id 30cc79239de0b457f05ff5410fdfa2592ae841fe08619d4a31a838c40954e8f0
Jul 17 17:30:11.110135 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:11.110050    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fjmjn" event={"ID":"57c93eef-4752-4139-a123-9377a3661828","Type":"ContainerStarted","Data":"30cc79239de0b457f05ff5410fdfa2592ae841fe08619d4a31a838c40954e8f0"}
Jul 17 17:30:11.275726 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:11.275687    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20b6149a-0774-47af-bcff-b5a61d9abef1-tls-certs\") pod \"model-serving-api-54d89bd5fc-lv4nm\" (UID: \"20b6149a-0774-47af-bcff-b5a61d9abef1\") " pod="opendatahub/model-serving-api-54d89bd5fc-lv4nm"
Jul 17 17:30:11.278305 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:11.278273    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20b6149a-0774-47af-bcff-b5a61d9abef1-tls-certs\") pod \"model-serving-api-54d89bd5fc-lv4nm\" (UID: \"20b6149a-0774-47af-bcff-b5a61d9abef1\") " pod="opendatahub/model-serving-api-54d89bd5fc-lv4nm"
Jul 17 17:30:11.437841 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:11.437738    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lv4nm"
Jul 17 17:30:11.576365 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:11.576326    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lv4nm"]
Jul 17 17:30:11.580718 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:30:11.580689    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20b6149a_0774_47af_bcff_b5a61d9abef1.slice/crio-1a0356b9ab3608dd2d149a5d95b44ae5cd8393ec67656c8d8faef714051645eb WatchSource:0}: Error finding container 1a0356b9ab3608dd2d149a5d95b44ae5cd8393ec67656c8d8faef714051645eb: Status 404 returned error can't find the container with id 1a0356b9ab3608dd2d149a5d95b44ae5cd8393ec67656c8d8faef714051645eb
Jul 17 17:30:12.116540 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:12.116497    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lv4nm" event={"ID":"20b6149a-0774-47af-bcff-b5a61d9abef1","Type":"ContainerStarted","Data":"1a0356b9ab3608dd2d149a5d95b44ae5cd8393ec67656c8d8faef714051645eb"}
Jul 17 17:30:14.129950 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:14.129910    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fjmjn" event={"ID":"57c93eef-4752-4139-a123-9377a3661828","Type":"ContainerStarted","Data":"34e456946fd4493ba99d890d21a77307f74452c173e7b1ce5057366b443bb953"}
Jul 17 17:30:14.130471 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:14.129981    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-fjmjn"
Jul 17 17:30:14.131302 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:14.131270    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lv4nm" event={"ID":"20b6149a-0774-47af-bcff-b5a61d9abef1","Type":"ContainerStarted","Data":"f7865b9ef807f66134699f3250a3e31f20f922249bfc879dd758a650d544723e"}
Jul 17 17:30:14.131456 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:14.131392    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-lv4nm"
Jul 17 17:30:14.147620 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:14.147565    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-fjmjn" podStartSLOduration=2.082098273 podStartE2EDuration="5.147544835s" totalImagesPullingTime="3.065446562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:30:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:30:14.145856456 +0000 UTC m=+364.164633055" watchObservedRunningTime="2026-07-17 17:30:14.147544835 +0000 UTC m=+364.166321433"
Jul 17 17:30:14.162284 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:14.162228    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-lv4nm" podStartSLOduration=1.7898116659999999 podStartE2EDuration="4.162210694s" totalImagesPullingTime="2.372399028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:30:14.161923489 +0000 UTC m=+364.180700084" watchObservedRunningTime="2026-07-17 17:30:14.162210694 +0000 UTC m=+364.180987292"
Jul 17 17:30:14.895554 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:14.895518    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d88846968-bmt5v"]
Jul 17 17:30:14.898723 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:14.898703    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d88846968-bmt5v"
Jul 17 17:30:14.901420 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:14.901396    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 17 17:30:14.901536 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:14.901403    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 17 17:30:14.901693 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:14.901677    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-nkdjw\""
Jul 17 17:30:14.911419 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:14.911396    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d88846968-bmt5v"]
Jul 17 17:30:15.007768 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:15.007733    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97ffc\" (UniqueName: \"kubernetes.io/projected/bcb137bf-21c7-46e1-acce-c6fe80aa6e23-kube-api-access-97ffc\") pod \"kube-auth-proxy-7d88846968-bmt5v\" (UID: \"bcb137bf-21c7-46e1-acce-c6fe80aa6e23\") " pod="openshift-ingress/kube-auth-proxy-7d88846968-bmt5v"
Jul 17 17:30:15.007935 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:15.007779    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcb137bf-21c7-46e1-acce-c6fe80aa6e23-tls-certs\") pod \"kube-auth-proxy-7d88846968-bmt5v\" (UID: \"bcb137bf-21c7-46e1-acce-c6fe80aa6e23\") " pod="openshift-ingress/kube-auth-proxy-7d88846968-bmt5v"
Jul 17 17:30:15.007935 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:15.007826    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcb137bf-21c7-46e1-acce-c6fe80aa6e23-tmp\") pod \"kube-auth-proxy-7d88846968-bmt5v\" (UID: \"bcb137bf-21c7-46e1-acce-c6fe80aa6e23\") " pod="openshift-ingress/kube-auth-proxy-7d88846968-bmt5v"
Jul 17 17:30:15.108374 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:15.108336    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcb137bf-21c7-46e1-acce-c6fe80aa6e23-tls-certs\") pod \"kube-auth-proxy-7d88846968-bmt5v\" (UID: \"bcb137bf-21c7-46e1-acce-c6fe80aa6e23\") " pod="openshift-ingress/kube-auth-proxy-7d88846968-bmt5v"
Jul 17 17:30:15.108374 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:15.108377    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcb137bf-21c7-46e1-acce-c6fe80aa6e23-tmp\") pod \"kube-auth-proxy-7d88846968-bmt5v\" (UID: \"bcb137bf-21c7-46e1-acce-c6fe80aa6e23\") " pod="openshift-ingress/kube-auth-proxy-7d88846968-bmt5v"
Jul 17 17:30:15.108585 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:15.108428    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97ffc\" (UniqueName: \"kubernetes.io/projected/bcb137bf-21c7-46e1-acce-c6fe80aa6e23-kube-api-access-97ffc\") pod \"kube-auth-proxy-7d88846968-bmt5v\" (UID: \"bcb137bf-21c7-46e1-acce-c6fe80aa6e23\") " pod="openshift-ingress/kube-auth-proxy-7d88846968-bmt5v"
Jul 17 17:30:15.108585 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:30:15.108486    2576 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 17 17:30:15.108585 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:30:15.108559    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcb137bf-21c7-46e1-acce-c6fe80aa6e23-tls-certs podName:bcb137bf-21c7-46e1-acce-c6fe80aa6e23 nodeName:}" failed. No retries permitted until 2026-07-17 17:30:15.60853891 +0000 UTC m=+365.627315489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/bcb137bf-21c7-46e1-acce-c6fe80aa6e23-tls-certs") pod "kube-auth-proxy-7d88846968-bmt5v" (UID: "bcb137bf-21c7-46e1-acce-c6fe80aa6e23") : secret "kube-auth-proxy-tls" not found
Jul 17 17:30:15.110594 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:15.110573    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcb137bf-21c7-46e1-acce-c6fe80aa6e23-tmp\") pod \"kube-auth-proxy-7d88846968-bmt5v\" (UID: \"bcb137bf-21c7-46e1-acce-c6fe80aa6e23\") " pod="openshift-ingress/kube-auth-proxy-7d88846968-bmt5v"
Jul 17 17:30:15.119132 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:15.119106    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97ffc\" (UniqueName: \"kubernetes.io/projected/bcb137bf-21c7-46e1-acce-c6fe80aa6e23-kube-api-access-97ffc\") pod \"kube-auth-proxy-7d88846968-bmt5v\" (UID: \"bcb137bf-21c7-46e1-acce-c6fe80aa6e23\") " pod="openshift-ingress/kube-auth-proxy-7d88846968-bmt5v"
Jul 17 17:30:15.613531 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:15.613495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcb137bf-21c7-46e1-acce-c6fe80aa6e23-tls-certs\") pod \"kube-auth-proxy-7d88846968-bmt5v\" (UID: \"bcb137bf-21c7-46e1-acce-c6fe80aa6e23\") " pod="openshift-ingress/kube-auth-proxy-7d88846968-bmt5v"
Jul 17 17:30:15.615892 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:15.615862    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcb137bf-21c7-46e1-acce-c6fe80aa6e23-tls-certs\") pod \"kube-auth-proxy-7d88846968-bmt5v\" (UID: \"bcb137bf-21c7-46e1-acce-c6fe80aa6e23\") " pod="openshift-ingress/kube-auth-proxy-7d88846968-bmt5v"
Jul 17 17:30:15.808403 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:15.808360    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d88846968-bmt5v"
Jul 17 17:30:15.967072 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:15.967039    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d88846968-bmt5v"]
Jul 17 17:30:15.970546 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:30:15.970519    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcb137bf_21c7_46e1_acce_c6fe80aa6e23.slice/crio-3c355bbe3d99680b3179cbd5b2f0c06cd0903584a7a99753d0f0101c95356089 WatchSource:0}: Error finding container 3c355bbe3d99680b3179cbd5b2f0c06cd0903584a7a99753d0f0101c95356089: Status 404 returned error can't find the container with id 3c355bbe3d99680b3179cbd5b2f0c06cd0903584a7a99753d0f0101c95356089
Jul 17 17:30:16.083338 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.083306    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"]
Jul 17 17:30:16.087660 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.087641    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.093366 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.090659    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 17 17:30:16.093366 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.090964    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2m6c9\""
Jul 17 17:30:16.093366 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.090966    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 17 17:30:16.093366 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.091223    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 17 17:30:16.094578 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.093671    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 17 17:30:16.100506 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.100482    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"]
Jul 17 17:30:16.141330 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.141235    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d88846968-bmt5v" event={"ID":"bcb137bf-21c7-46e1-acce-c6fe80aa6e23","Type":"ContainerStarted","Data":"3c355bbe3d99680b3179cbd5b2f0c06cd0903584a7a99753d0f0101c95356089"}
Jul 17 17:30:16.218503 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.218464    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdp7k\" (UniqueName: \"kubernetes.io/projected/7ab4899c-85e0-4b1e-be30-ade35e19061d-kube-api-access-jdp7k\") pod \"istiod-openshift-gateway-7574459656-5qkzt\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.218679 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.218515    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-token\") pod \"istiod-openshift-gateway-7574459656-5qkzt\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.218679 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.218552    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ab4899c-85e0-4b1e-be30-ade35e19061d-local-certs\") pod \"istiod-openshift-gateway-7574459656-5qkzt\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.218679 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.218620    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-5qkzt\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.218679 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.218674    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-5qkzt\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.218815 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.218695    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-5qkzt\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.218815 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.218714    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7ab4899c-85e0-4b1e-be30-ade35e19061d-cacerts\") pod \"istiod-openshift-gateway-7574459656-5qkzt\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.319874 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.319834    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-5qkzt\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.319874 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.319875    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-5qkzt\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.320126 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.319896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7ab4899c-85e0-4b1e-be30-ade35e19061d-cacerts\") pod \"istiod-openshift-gateway-7574459656-5qkzt\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.320126 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.319927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdp7k\" (UniqueName: \"kubernetes.io/projected/7ab4899c-85e0-4b1e-be30-ade35e19061d-kube-api-access-jdp7k\") pod \"istiod-openshift-gateway-7574459656-5qkzt\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.320306 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.320283    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-token\") pod \"istiod-openshift-gateway-7574459656-5qkzt\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.320368 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.320354    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ab4899c-85e0-4b1e-be30-ade35e19061d-local-certs\") pod \"istiod-openshift-gateway-7574459656-5qkzt\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.320424 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.320390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-5qkzt\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.320669 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.320611    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-5qkzt\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.322680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.322629    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-5qkzt\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.322806 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.322786    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-5qkzt\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.322866 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.322794    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ab4899c-85e0-4b1e-be30-ade35e19061d-local-certs\") pod \"istiod-openshift-gateway-7574459656-5qkzt\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.323182 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.323144    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7ab4899c-85e0-4b1e-be30-ade35e19061d-cacerts\") pod \"istiod-openshift-gateway-7574459656-5qkzt\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.336062 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.336037    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdp7k\" (UniqueName: \"kubernetes.io/projected/7ab4899c-85e0-4b1e-be30-ade35e19061d-kube-api-access-jdp7k\") pod \"istiod-openshift-gateway-7574459656-5qkzt\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.336184 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.336150    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-token\") pod \"istiod-openshift-gateway-7574459656-5qkzt\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.404080 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.403997    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:16.535828 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:16.535796    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"]
Jul 17 17:30:16.539450 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:30:16.539422    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ab4899c_85e0_4b1e_be30_ade35e19061d.slice/crio-6045f7c6efb023a040fe32c09bb9537a0b6b9b381a5d863af060219aad55678f WatchSource:0}: Error finding container 6045f7c6efb023a040fe32c09bb9537a0b6b9b381a5d863af060219aad55678f: Status 404 returned error can't find the container with id 6045f7c6efb023a040fe32c09bb9537a0b6b9b381a5d863af060219aad55678f
Jul 17 17:30:17.146854 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:17.146817    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt" event={"ID":"7ab4899c-85e0-4b1e-be30-ade35e19061d","Type":"ContainerStarted","Data":"6045f7c6efb023a040fe32c09bb9537a0b6b9b381a5d863af060219aad55678f"}
Jul 17 17:30:19.837354 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:19.837317    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:30:19.837642 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:19.837384    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 17:30:20.162197 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:20.162080    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d88846968-bmt5v" event={"ID":"bcb137bf-21c7-46e1-acce-c6fe80aa6e23","Type":"ContainerStarted","Data":"d0911e2dbfde4260496768099dcf925be97a55ef98a8c7ab3cf3a9edbb5c59f8"}
Jul 17 17:30:20.163799 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:20.163773    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt" event={"ID":"7ab4899c-85e0-4b1e-be30-ade35e19061d","Type":"ContainerStarted","Data":"1b84891be39bd118a62d4c96410dccea58edb192b010e26bda6775c60289b816"}
Jul 17 17:30:20.163968 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:20.163956    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:20.165699 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:20.165672    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-5qkzt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 17:30:20.165807 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:20.165730    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt" podUID="7ab4899c-85e0-4b1e-be30-ade35e19061d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 17:30:20.193356 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:20.193306    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d88846968-bmt5v" podStartSLOduration=2.33035219 podStartE2EDuration="6.193291043s" totalImagesPullingTime="3.862938853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:30:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:30:20.191622587 +0000 UTC m=+370.210399186" watchObservedRunningTime="2026-07-17 17:30:20.193291043 +0000 UTC m=+370.212067641"
Jul 17 17:30:20.233835 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:20.233774    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt" podStartSLOduration=0.938136596 podStartE2EDuration="4.233751106s" totalImagesPullingTime="3.29561451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:30:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:30:20.233451097 +0000 UTC m=+370.252227698" watchObservedRunningTime="2026-07-17 17:30:20.233751106 +0000 UTC m=+370.252527718"
Jul 17 17:30:21.168840 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.168807    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-5qkzt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 17:30:21.169226 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.168883    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt" podUID="7ab4899c-85e0-4b1e-be30-ade35e19061d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 17:30:21.483376 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.483340    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-c8lx8"]
Jul 17 17:30:21.486659 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.486642    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c8lx8"
Jul 17 17:30:21.490223 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.490202    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 17 17:30:21.490652 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.490636    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-wqm48\""
Jul 17 17:30:21.498536 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.498512    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-c8lx8"]
Jul 17 17:30:21.512485 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.512457    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-bxx5j"]
Jul 17 17:30:21.516110 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.516085    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bxx5j"
Jul 17 17:30:21.521486 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.521466    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-zh27b\""
Jul 17 17:30:21.522034 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.521515    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 17 17:30:21.547050 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.547019    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-bxx5j"]
Jul 17 17:30:21.564802 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.564743    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ed9660b-3c7c-4ec6-a4ab-9f8bd5730ec3-cert\") pod \"kserve-controller-manager-d6f4b65b8-c8lx8\" (UID: \"8ed9660b-3c7c-4ec6-a4ab-9f8bd5730ec3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c8lx8"
Jul 17 17:30:21.564978 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.564881    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcmb4\" (UniqueName: \"kubernetes.io/projected/8ed9660b-3c7c-4ec6-a4ab-9f8bd5730ec3-kube-api-access-vcmb4\") pod \"kserve-controller-manager-d6f4b65b8-c8lx8\" (UID: \"8ed9660b-3c7c-4ec6-a4ab-9f8bd5730ec3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c8lx8"
Jul 17 17:30:21.665978 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.665940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z978n\" (UniqueName: \"kubernetes.io/projected/96f67c09-4757-4c92-86e6-dcb0eea52a41-kube-api-access-z978n\") pod \"llmisvc-controller-manager-777c6bd7d5-bxx5j\" (UID: \"96f67c09-4757-4c92-86e6-dcb0eea52a41\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bxx5j"
Jul 17 17:30:21.665978 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.665991    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96f67c09-4757-4c92-86e6-dcb0eea52a41-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-bxx5j\" (UID: \"96f67c09-4757-4c92-86e6-dcb0eea52a41\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bxx5j"
Jul 17 17:30:21.666215 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.666019    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ed9660b-3c7c-4ec6-a4ab-9f8bd5730ec3-cert\") pod \"kserve-controller-manager-d6f4b65b8-c8lx8\" (UID: \"8ed9660b-3c7c-4ec6-a4ab-9f8bd5730ec3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c8lx8"
Jul 17 17:30:21.666215 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.666094    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcmb4\" (UniqueName: \"kubernetes.io/projected/8ed9660b-3c7c-4ec6-a4ab-9f8bd5730ec3-kube-api-access-vcmb4\") pod \"kserve-controller-manager-d6f4b65b8-c8lx8\" (UID: \"8ed9660b-3c7c-4ec6-a4ab-9f8bd5730ec3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c8lx8"
Jul 17 17:30:21.668392 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.668370    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ed9660b-3c7c-4ec6-a4ab-9f8bd5730ec3-cert\") pod \"kserve-controller-manager-d6f4b65b8-c8lx8\" (UID: \"8ed9660b-3c7c-4ec6-a4ab-9f8bd5730ec3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c8lx8"
Jul 17 17:30:21.687304 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.687269    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcmb4\" (UniqueName: \"kubernetes.io/projected/8ed9660b-3c7c-4ec6-a4ab-9f8bd5730ec3-kube-api-access-vcmb4\") pod \"kserve-controller-manager-d6f4b65b8-c8lx8\" (UID: \"8ed9660b-3c7c-4ec6-a4ab-9f8bd5730ec3\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-c8lx8"
Jul 17 17:30:21.766975 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.766862    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z978n\" (UniqueName: \"kubernetes.io/projected/96f67c09-4757-4c92-86e6-dcb0eea52a41-kube-api-access-z978n\") pod \"llmisvc-controller-manager-777c6bd7d5-bxx5j\" (UID: \"96f67c09-4757-4c92-86e6-dcb0eea52a41\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bxx5j"
Jul 17 17:30:21.766975 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.766939    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96f67c09-4757-4c92-86e6-dcb0eea52a41-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-bxx5j\" (UID: \"96f67c09-4757-4c92-86e6-dcb0eea52a41\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bxx5j"
Jul 17 17:30:21.769335 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.769310    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96f67c09-4757-4c92-86e6-dcb0eea52a41-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-bxx5j\" (UID: \"96f67c09-4757-4c92-86e6-dcb0eea52a41\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bxx5j"
Jul 17 17:30:21.784229 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.784199    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z978n\" (UniqueName: \"kubernetes.io/projected/96f67c09-4757-4c92-86e6-dcb0eea52a41-kube-api-access-z978n\") pod \"llmisvc-controller-manager-777c6bd7d5-bxx5j\" (UID: \"96f67c09-4757-4c92-86e6-dcb0eea52a41\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bxx5j"
Jul 17 17:30:21.797203 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.797147    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c8lx8"
Jul 17 17:30:21.826288 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.826256    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bxx5j"
Jul 17 17:30:21.950674 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:21.950637    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-c8lx8"]
Jul 17 17:30:21.954516 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:30:21.954484    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed9660b_3c7c_4ec6_a4ab_9f8bd5730ec3.slice/crio-370756dcf23d3a71467a614ad12b76ad72c594df4794ae7eef5a8347bbd9cf31 WatchSource:0}: Error finding container 370756dcf23d3a71467a614ad12b76ad72c594df4794ae7eef5a8347bbd9cf31: Status 404 returned error can't find the container with id 370756dcf23d3a71467a614ad12b76ad72c594df4794ae7eef5a8347bbd9cf31
Jul 17 17:30:22.004027 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:30:22.003998    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod96f67c09_4757_4c92_86e6_dcb0eea52a41.slice/crio-153bef35de6f636d21c3a3a998b3852bd59c7436ab677d0b5dc5057f9a3fe6f0 WatchSource:0}: Error finding container 153bef35de6f636d21c3a3a998b3852bd59c7436ab677d0b5dc5057f9a3fe6f0: Status 404 returned error can't find the container with id 153bef35de6f636d21c3a3a998b3852bd59c7436ab677d0b5dc5057f9a3fe6f0
Jul 17 17:30:22.006808 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:22.006784    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-bxx5j"]
Jul 17 17:30:22.174758 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:22.174673    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c8lx8" event={"ID":"8ed9660b-3c7c-4ec6-a4ab-9f8bd5730ec3","Type":"ContainerStarted","Data":"370756dcf23d3a71467a614ad12b76ad72c594df4794ae7eef5a8347bbd9cf31"}
Jul 17 17:30:22.175728 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:22.175702    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bxx5j" event={"ID":"96f67c09-4757-4c92-86e6-dcb0eea52a41","Type":"ContainerStarted","Data":"153bef35de6f636d21c3a3a998b3852bd59c7436ab677d0b5dc5057f9a3fe6f0"}
Jul 17 17:30:23.453357 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.453318    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"]
Jul 17 17:30:23.453795 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.453630    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt" podUID="7ab4899c-85e0-4b1e-be30-ade35e19061d" containerName="discovery" containerID="cri-o://1b84891be39bd118a62d4c96410dccea58edb192b010e26bda6775c60289b816" gracePeriod=30
Jul 17 17:30:23.454585 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.454560    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:23.715853 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.715822    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:23.883072 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.883035    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-kubeconfig\") pod \"7ab4899c-85e0-4b1e-be30-ade35e19061d\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") "
Jul 17 17:30:23.883246 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.883100    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7ab4899c-85e0-4b1e-be30-ade35e19061d-cacerts\") pod \"7ab4899c-85e0-4b1e-be30-ade35e19061d\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") "
Jul 17 17:30:23.883246 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.883121    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdp7k\" (UniqueName: \"kubernetes.io/projected/7ab4899c-85e0-4b1e-be30-ade35e19061d-kube-api-access-jdp7k\") pod \"7ab4899c-85e0-4b1e-be30-ade35e19061d\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") "
Jul 17 17:30:23.883342 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.883236    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-csr-dns-cert\") pod \"7ab4899c-85e0-4b1e-be30-ade35e19061d\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") "
Jul 17 17:30:23.883342 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.883296    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-csr-ca-configmap\") pod \"7ab4899c-85e0-4b1e-be30-ade35e19061d\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") "
Jul 17 17:30:23.883342 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.883335    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ab4899c-85e0-4b1e-be30-ade35e19061d-local-certs\") pod \"7ab4899c-85e0-4b1e-be30-ade35e19061d\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") "
Jul 17 17:30:23.883514 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.883377    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-token\") pod \"7ab4899c-85e0-4b1e-be30-ade35e19061d\" (UID: \"7ab4899c-85e0-4b1e-be30-ade35e19061d\") "
Jul 17 17:30:23.883649 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.883617    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "7ab4899c-85e0-4b1e-be30-ade35e19061d" (UID: "7ab4899c-85e0-4b1e-be30-ade35e19061d"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:30:23.885546 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.885502    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ab4899c-85e0-4b1e-be30-ade35e19061d-cacerts" (OuterVolumeSpecName: "cacerts") pod "7ab4899c-85e0-4b1e-be30-ade35e19061d" (UID: "7ab4899c-85e0-4b1e-be30-ade35e19061d"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 17:30:23.885680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.885632    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "7ab4899c-85e0-4b1e-be30-ade35e19061d" (UID: "7ab4899c-85e0-4b1e-be30-ade35e19061d"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 17:30:23.885745 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.885717    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "7ab4899c-85e0-4b1e-be30-ade35e19061d" (UID: "7ab4899c-85e0-4b1e-be30-ade35e19061d"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 17:30:23.885798 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.885778    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ab4899c-85e0-4b1e-be30-ade35e19061d-local-certs" (OuterVolumeSpecName: "local-certs") pod "7ab4899c-85e0-4b1e-be30-ade35e19061d" (UID: "7ab4899c-85e0-4b1e-be30-ade35e19061d"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:30:23.885853 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.885800    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ab4899c-85e0-4b1e-be30-ade35e19061d-kube-api-access-jdp7k" (OuterVolumeSpecName: "kube-api-access-jdp7k") pod "7ab4899c-85e0-4b1e-be30-ade35e19061d" (UID: "7ab4899c-85e0-4b1e-be30-ade35e19061d"). InnerVolumeSpecName "kube-api-access-jdp7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:30:23.885910 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.885870    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-token" (OuterVolumeSpecName: "istio-token") pod "7ab4899c-85e0-4b1e-be30-ade35e19061d" (UID: "7ab4899c-85e0-4b1e-be30-ade35e19061d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:30:23.984143 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.984057    2576 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-kubeconfig\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:30:23.984143 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.984096    2576 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7ab4899c-85e0-4b1e-be30-ade35e19061d-cacerts\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:30:23.984143 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.984115    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdp7k\" (UniqueName: \"kubernetes.io/projected/7ab4899c-85e0-4b1e-be30-ade35e19061d-kube-api-access-jdp7k\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:30:23.984143 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.984131    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-csr-dns-cert\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:30:23.984143 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.984145    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-csr-ca-configmap\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:30:23.984469 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.984158    2576 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ab4899c-85e0-4b1e-be30-ade35e19061d-local-certs\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:30:23.984469 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:23.984188    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ab4899c-85e0-4b1e-be30-ade35e19061d-istio-token\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:30:24.195011 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:24.194962    2576 generic.go:356] "Generic (PLEG): container finished" podID="7ab4899c-85e0-4b1e-be30-ade35e19061d" containerID="1b84891be39bd118a62d4c96410dccea58edb192b010e26bda6775c60289b816" exitCode=0
Jul 17 17:30:24.195011 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:24.195009    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt" event={"ID":"7ab4899c-85e0-4b1e-be30-ade35e19061d","Type":"ContainerDied","Data":"1b84891be39bd118a62d4c96410dccea58edb192b010e26bda6775c60289b816"}
Jul 17 17:30:24.195269 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:24.195020    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"
Jul 17 17:30:24.195269 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:24.195063    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt" event={"ID":"7ab4899c-85e0-4b1e-be30-ade35e19061d","Type":"ContainerDied","Data":"6045f7c6efb023a040fe32c09bb9537a0b6b9b381a5d863af060219aad55678f"}
Jul 17 17:30:24.195269 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:24.195090    2576 scope.go:117] "RemoveContainer" containerID="1b84891be39bd118a62d4c96410dccea58edb192b010e26bda6775c60289b816"
Jul 17 17:30:24.227783 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:24.227752    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"]
Jul 17 17:30:24.236941 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:24.236877    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5qkzt"]
Jul 17 17:30:24.523715 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:24.523629    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ab4899c-85e0-4b1e-be30-ade35e19061d" path="/var/lib/kubelet/pods/7ab4899c-85e0-4b1e-be30-ade35e19061d/volumes"
Jul 17 17:30:25.138572 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:25.138539    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-fjmjn"
Jul 17 17:30:25.140644 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:25.140619    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-lv4nm"
Jul 17 17:30:25.197187 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:25.197092    2576 scope.go:117] "RemoveContainer" containerID="1b84891be39bd118a62d4c96410dccea58edb192b010e26bda6775c60289b816"
Jul 17 17:30:25.197528 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:30:25.197497    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b84891be39bd118a62d4c96410dccea58edb192b010e26bda6775c60289b816\": container with ID starting with 1b84891be39bd118a62d4c96410dccea58edb192b010e26bda6775c60289b816 not found: ID does not exist" containerID="1b84891be39bd118a62d4c96410dccea58edb192b010e26bda6775c60289b816"
Jul 17 17:30:25.197654 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:25.197538    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b84891be39bd118a62d4c96410dccea58edb192b010e26bda6775c60289b816"} err="failed to get container status \"1b84891be39bd118a62d4c96410dccea58edb192b010e26bda6775c60289b816\": rpc error: code = NotFound desc = could not find container \"1b84891be39bd118a62d4c96410dccea58edb192b010e26bda6775c60289b816\": container with ID starting with 1b84891be39bd118a62d4c96410dccea58edb192b010e26bda6775c60289b816 not found: ID does not exist"
Jul 17 17:30:26.206941 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:26.206902    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c8lx8" event={"ID":"8ed9660b-3c7c-4ec6-a4ab-9f8bd5730ec3","Type":"ContainerStarted","Data":"594983306c1c2ca6b6c2796a075033e3e1d59dc6e1a00f572bbb1eb3307a7e14"}
Jul 17 17:30:26.207400 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:26.207122    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c8lx8"
Jul 17 17:30:26.208371 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:26.208346    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bxx5j" event={"ID":"96f67c09-4757-4c92-86e6-dcb0eea52a41","Type":"ContainerStarted","Data":"f1ec419024fda08047fd46be5c21af3558fb34591b48b8f5a23efa3943851c81"}
Jul 17 17:30:26.208509 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:26.208461    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bxx5j"
Jul 17 17:30:26.249140 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:26.249083    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c8lx8" podStartSLOduration=1.998325215 podStartE2EDuration="5.249064838s" totalImagesPullingTime="3.250739623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:30:26.248042026 +0000 UTC m=+376.266818635" watchObservedRunningTime="2026-07-17 17:30:26.249064838 +0000 UTC m=+376.267841436"
Jul 17 17:30:26.281584 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:26.281530    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bxx5j" podStartSLOduration=2.073542686 podStartE2EDuration="5.281512359s" totalImagesPullingTime="3.207969673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:30:26.280383617 +0000 UTC m=+376.299160227" watchObservedRunningTime="2026-07-17 17:30:26.281512359 +0000 UTC m=+376.300288956"
Jul 17 17:30:57.216006 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:57.215968    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bxx5j"
Jul 17 17:30:57.218930 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:30:57.218904    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-c8lx8"
Jul 17 17:31:05.595375 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:05.595340    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tfglg"]
Jul 17 17:31:05.595949 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:05.595806    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ab4899c-85e0-4b1e-be30-ade35e19061d" containerName="discovery"
Jul 17 17:31:05.595949 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:05.595826    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ab4899c-85e0-4b1e-be30-ade35e19061d" containerName="discovery"
Jul 17 17:31:05.595949 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:05.595902    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ab4899c-85e0-4b1e-be30-ade35e19061d" containerName="discovery"
Jul 17 17:31:05.598998 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:05.598976    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tfglg"
Jul 17 17:31:05.604777 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:05.604758    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-r7wrj\""
Jul 17 17:31:05.605992 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:05.605969    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 17:31:05.606100 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:05.606000    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 17:31:05.626127 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:05.626094    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tfglg"]
Jul 17 17:31:05.712371 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:05.712335    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vwrj\" (UniqueName: \"kubernetes.io/projected/8042096e-b76f-41ab-a8e4-cf4d6f0ff950-kube-api-access-2vwrj\") pod \"kuadrant-operator-catalog-tfglg\" (UID: \"8042096e-b76f-41ab-a8e4-cf4d6f0ff950\") " pod="kuadrant-system/kuadrant-operator-catalog-tfglg"
Jul 17 17:31:05.808550 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:05.808510    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tfglg"]
Jul 17 17:31:05.808799 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:31:05.808775    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2vwrj], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-catalog-tfglg" podUID="8042096e-b76f-41ab-a8e4-cf4d6f0ff950"
Jul 17 17:31:05.813410 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:05.813384    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vwrj\" (UniqueName: \"kubernetes.io/projected/8042096e-b76f-41ab-a8e4-cf4d6f0ff950-kube-api-access-2vwrj\") pod \"kuadrant-operator-catalog-tfglg\" (UID: \"8042096e-b76f-41ab-a8e4-cf4d6f0ff950\") " pod="kuadrant-system/kuadrant-operator-catalog-tfglg"
Jul 17 17:31:05.826458 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:05.826426    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vwrj\" (UniqueName: \"kubernetes.io/projected/8042096e-b76f-41ab-a8e4-cf4d6f0ff950-kube-api-access-2vwrj\") pod \"kuadrant-operator-catalog-tfglg\" (UID: \"8042096e-b76f-41ab-a8e4-cf4d6f0ff950\") " pod="kuadrant-system/kuadrant-operator-catalog-tfglg"
Jul 17 17:31:06.044638 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:06.044599    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zchwr"]
Jul 17 17:31:06.047788 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:06.047764    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zchwr"
Jul 17 17:31:06.092215 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:06.092177    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zchwr"]
Jul 17 17:31:06.117092 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:06.117056    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4ptg\" (UniqueName: \"kubernetes.io/projected/2d1dbbde-1738-4957-80cc-4d1d21d6e445-kube-api-access-f4ptg\") pod \"kuadrant-operator-catalog-zchwr\" (UID: \"2d1dbbde-1738-4957-80cc-4d1d21d6e445\") " pod="kuadrant-system/kuadrant-operator-catalog-zchwr"
Jul 17 17:31:06.218050 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:06.218010    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4ptg\" (UniqueName: \"kubernetes.io/projected/2d1dbbde-1738-4957-80cc-4d1d21d6e445-kube-api-access-f4ptg\") pod \"kuadrant-operator-catalog-zchwr\" (UID: \"2d1dbbde-1738-4957-80cc-4d1d21d6e445\") " pod="kuadrant-system/kuadrant-operator-catalog-zchwr"
Jul 17 17:31:06.250088 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:06.250048    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4ptg\" (UniqueName: \"kubernetes.io/projected/2d1dbbde-1738-4957-80cc-4d1d21d6e445-kube-api-access-f4ptg\") pod \"kuadrant-operator-catalog-zchwr\" (UID: \"2d1dbbde-1738-4957-80cc-4d1d21d6e445\") " pod="kuadrant-system/kuadrant-operator-catalog-zchwr"
Jul 17 17:31:06.356784 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:06.356697    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zchwr"
Jul 17 17:31:06.375932 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:06.375902    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tfglg"
Jul 17 17:31:06.383018 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:06.382995    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tfglg"
Jul 17 17:31:06.422668 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:06.420578    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vwrj\" (UniqueName: \"kubernetes.io/projected/8042096e-b76f-41ab-a8e4-cf4d6f0ff950-kube-api-access-2vwrj\") pod \"8042096e-b76f-41ab-a8e4-cf4d6f0ff950\" (UID: \"8042096e-b76f-41ab-a8e4-cf4d6f0ff950\") "
Jul 17 17:31:06.424452 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:06.424414    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8042096e-b76f-41ab-a8e4-cf4d6f0ff950-kube-api-access-2vwrj" (OuterVolumeSpecName: "kube-api-access-2vwrj") pod "8042096e-b76f-41ab-a8e4-cf4d6f0ff950" (UID: "8042096e-b76f-41ab-a8e4-cf4d6f0ff950"). InnerVolumeSpecName "kube-api-access-2vwrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:31:06.503899 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:06.503868    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zchwr"]
Jul 17 17:31:06.507792 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:31:06.507765    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d1dbbde_1738_4957_80cc_4d1d21d6e445.slice/crio-19f0aff5e9684ac2f541c2d002b517217ff688d667061c741dca0ff0e488a065 WatchSource:0}: Error finding container 19f0aff5e9684ac2f541c2d002b517217ff688d667061c741dca0ff0e488a065: Status 404 returned error can't find the container with id 19f0aff5e9684ac2f541c2d002b517217ff688d667061c741dca0ff0e488a065
Jul 17 17:31:06.521847 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:06.521822    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vwrj\" (UniqueName: \"kubernetes.io/projected/8042096e-b76f-41ab-a8e4-cf4d6f0ff950-kube-api-access-2vwrj\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:31:07.381523 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:07.381497    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tfglg"
Jul 17 17:31:07.381913 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:07.381500    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zchwr" event={"ID":"2d1dbbde-1738-4957-80cc-4d1d21d6e445","Type":"ContainerStarted","Data":"19f0aff5e9684ac2f541c2d002b517217ff688d667061c741dca0ff0e488a065"}
Jul 17 17:31:07.421317 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:07.421278    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tfglg"]
Jul 17 17:31:07.422585 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:07.422552    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tfglg"]
Jul 17 17:31:08.521578 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:08.521547    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8042096e-b76f-41ab-a8e4-cf4d6f0ff950" path="/var/lib/kubelet/pods/8042096e-b76f-41ab-a8e4-cf4d6f0ff950/volumes"
Jul 17 17:31:09.390871 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:09.390831    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zchwr" event={"ID":"2d1dbbde-1738-4957-80cc-4d1d21d6e445","Type":"ContainerStarted","Data":"96912499720e336e851759bd31a27a13fbcdd02b421067639fa52de751853c58"}
Jul 17 17:31:09.412313 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:09.412255    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zchwr" podStartSLOduration=1.458126152 podStartE2EDuration="3.412239623s" totalImagesPullingTime="1.954113471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:09.411311701 +0000 UTC m=+419.430088300" watchObservedRunningTime="2026-07-17 17:31:09.412239623 +0000 UTC m=+419.431016230"
Jul 17 17:31:16.357543 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:16.357504    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-zchwr"
Jul 17 17:31:16.358051 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:16.357566    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-zchwr"
Jul 17 17:31:16.379919 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:16.379892    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-zchwr"
Jul 17 17:31:16.441952 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:16.441922    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-zchwr"
Jul 17 17:31:35.680781 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:35.680705    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6d4ql"]
Jul 17 17:31:35.684338 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:35.684316    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6d4ql"
Jul 17 17:31:35.689735 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:35.689712    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 17 17:31:35.689825 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:35.689754    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-7mj22\""
Jul 17 17:31:35.781967 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:35.781941    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6d4ql"]
Jul 17 17:31:35.850763 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:35.850736    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mgvq\" (UniqueName: \"kubernetes.io/projected/5a217bc6-7a38-4c8e-a37b-b75cf455f900-kube-api-access-5mgvq\") pod \"dns-operator-controller-manager-864dd78c4c-6d4ql\" (UID: \"5a217bc6-7a38-4c8e-a37b-b75cf455f900\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6d4ql"
Jul 17 17:31:35.951911 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:35.951841    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mgvq\" (UniqueName: \"kubernetes.io/projected/5a217bc6-7a38-4c8e-a37b-b75cf455f900-kube-api-access-5mgvq\") pod \"dns-operator-controller-manager-864dd78c4c-6d4ql\" (UID: \"5a217bc6-7a38-4c8e-a37b-b75cf455f900\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6d4ql"
Jul 17 17:31:35.972502 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:35.972481    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mgvq\" (UniqueName: \"kubernetes.io/projected/5a217bc6-7a38-4c8e-a37b-b75cf455f900-kube-api-access-5mgvq\") pod \"dns-operator-controller-manager-864dd78c4c-6d4ql\" (UID: \"5a217bc6-7a38-4c8e-a37b-b75cf455f900\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6d4ql"
Jul 17 17:31:35.994418 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:35.994397    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6d4ql"
Jul 17 17:31:36.154702 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:36.154676    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6d4ql"]
Jul 17 17:31:36.157097 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:31:36.157070    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a217bc6_7a38_4c8e_a37b_b75cf455f900.slice/crio-24b8add893d8c73aead474df597dad103b85b4b069fbb41985ab9b4ef528637c WatchSource:0}: Error finding container 24b8add893d8c73aead474df597dad103b85b4b069fbb41985ab9b4ef528637c: Status 404 returned error can't find the container with id 24b8add893d8c73aead474df597dad103b85b4b069fbb41985ab9b4ef528637c
Jul 17 17:31:36.502300 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:36.502265    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6d4ql" event={"ID":"5a217bc6-7a38-4c8e-a37b-b75cf455f900","Type":"ContainerStarted","Data":"24b8add893d8c73aead474df597dad103b85b4b069fbb41985ab9b4ef528637c"}
Jul 17 17:31:38.512826 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:38.512791    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6d4ql" event={"ID":"5a217bc6-7a38-4c8e-a37b-b75cf455f900","Type":"ContainerStarted","Data":"a4a1749d2b6d52290c313631815f521aec980eebb34d179f9b75088a5470f5fc"}
Jul 17 17:31:38.513243 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:38.512905    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6d4ql"
Jul 17 17:31:38.553724 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:38.553670    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6d4ql" podStartSLOduration=1.712890728 podStartE2EDuration="3.553656655s" totalImagesPullingTime="1.840765927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:38.553461314 +0000 UTC m=+448.572237912" watchObservedRunningTime="2026-07-17 17:31:38.553656655 +0000 UTC m=+448.572433252"
Jul 17 17:31:39.789140 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:39.789105    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2whvn"]
Jul 17 17:31:39.792472 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:39.792451    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2whvn"
Jul 17 17:31:39.796269 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:39.796246    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-n66k2\""
Jul 17 17:31:39.812176 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:39.812142    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2whvn"]
Jul 17 17:31:39.883515 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:39.883488    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkk25\" (UniqueName: \"kubernetes.io/projected/1051965d-3105-43ca-aa22-ee952a261453-kube-api-access-wkk25\") pod \"authorino-operator-75cc8d5cb7-2whvn\" (UID: \"1051965d-3105-43ca-aa22-ee952a261453\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2whvn"
Jul 17 17:31:39.984561 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:39.984526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkk25\" (UniqueName: \"kubernetes.io/projected/1051965d-3105-43ca-aa22-ee952a261453-kube-api-access-wkk25\") pod \"authorino-operator-75cc8d5cb7-2whvn\" (UID: \"1051965d-3105-43ca-aa22-ee952a261453\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2whvn"
Jul 17 17:31:40.016627 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:40.016597    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkk25\" (UniqueName: \"kubernetes.io/projected/1051965d-3105-43ca-aa22-ee952a261453-kube-api-access-wkk25\") pod \"authorino-operator-75cc8d5cb7-2whvn\" (UID: \"1051965d-3105-43ca-aa22-ee952a261453\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2whvn"
Jul 17 17:31:40.102546 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:40.102468    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2whvn"
Jul 17 17:31:40.250835 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:40.250777    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2whvn"]
Jul 17 17:31:40.253503 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:31:40.253470    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1051965d_3105_43ca_aa22_ee952a261453.slice/crio-fe07111f188df034a7fe8af28c70ae16b1a1c215c405b953d3500c55d24df2be WatchSource:0}: Error finding container fe07111f188df034a7fe8af28c70ae16b1a1c215c405b953d3500c55d24df2be: Status 404 returned error can't find the container with id fe07111f188df034a7fe8af28c70ae16b1a1c215c405b953d3500c55d24df2be
Jul 17 17:31:40.525713 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:40.525680    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2whvn" event={"ID":"1051965d-3105-43ca-aa22-ee952a261453","Type":"ContainerStarted","Data":"fe07111f188df034a7fe8af28c70ae16b1a1c215c405b953d3500c55d24df2be"}
Jul 17 17:31:43.019115 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:43.019037    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6"]
Jul 17 17:31:43.021093 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:43.021076    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6"
Jul 17 17:31:43.027024 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:43.026998    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-bt447\""
Jul 17 17:31:43.071621 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:43.071595    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6"]
Jul 17 17:31:43.108896 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:43.108872    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v6wt\" (UniqueName: \"kubernetes.io/projected/11f07184-c773-40c5-94ee-b15ac3e0884f-kube-api-access-4v6wt\") pod \"limitador-operator-controller-manager-859d7b78bd-bvvn6\" (UID: \"11f07184-c773-40c5-94ee-b15ac3e0884f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6"
Jul 17 17:31:43.210277 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:43.210250    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v6wt\" (UniqueName: \"kubernetes.io/projected/11f07184-c773-40c5-94ee-b15ac3e0884f-kube-api-access-4v6wt\") pod \"limitador-operator-controller-manager-859d7b78bd-bvvn6\" (UID: \"11f07184-c773-40c5-94ee-b15ac3e0884f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6"
Jul 17 17:31:43.230011 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:43.229982    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v6wt\" (UniqueName: \"kubernetes.io/projected/11f07184-c773-40c5-94ee-b15ac3e0884f-kube-api-access-4v6wt\") pod \"limitador-operator-controller-manager-859d7b78bd-bvvn6\" (UID: \"11f07184-c773-40c5-94ee-b15ac3e0884f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6"
Jul 17 17:31:43.331255 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:43.331197    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6"
Jul 17 17:31:43.486042 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:43.486012    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6"]
Jul 17 17:31:43.489509 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:31:43.489483    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f07184_c773_40c5_94ee_b15ac3e0884f.slice/crio-30b97245c601fb9cddbcf5658ae6d0e70025b33aa3a36609e351b29edae89b25 WatchSource:0}: Error finding container 30b97245c601fb9cddbcf5658ae6d0e70025b33aa3a36609e351b29edae89b25: Status 404 returned error can't find the container with id 30b97245c601fb9cddbcf5658ae6d0e70025b33aa3a36609e351b29edae89b25
Jul 17 17:31:43.541271 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:43.541205    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2whvn" event={"ID":"1051965d-3105-43ca-aa22-ee952a261453","Type":"ContainerStarted","Data":"55800583136fb4a9f6dbcbbd48df9caff9521de59ba1b8c3db3d6209fd493b4a"}
Jul 17 17:31:43.546480 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:43.541724    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2whvn"
Jul 17 17:31:43.547704 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:43.547678    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6" event={"ID":"11f07184-c773-40c5-94ee-b15ac3e0884f","Type":"ContainerStarted","Data":"30b97245c601fb9cddbcf5658ae6d0e70025b33aa3a36609e351b29edae89b25"}
Jul 17 17:31:43.583133 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:43.583059    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2whvn" podStartSLOduration=2.101156449 podStartE2EDuration="4.583045641s" totalImagesPullingTime="2.481889192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:43.581702527 +0000 UTC m=+453.600479126" watchObservedRunningTime="2026-07-17 17:31:43.583045641 +0000 UTC m=+453.601822239"
Jul 17 17:31:45.557314 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:45.557275    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6" event={"ID":"11f07184-c773-40c5-94ee-b15ac3e0884f","Type":"ContainerStarted","Data":"3f9c6b6e3e613dfd667f0396614ad5283df49bc94ae6a65bf4a1b77c68af44a6"}
Jul 17 17:31:45.557711 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:45.557398    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6"
Jul 17 17:31:45.581282 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:45.581224    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6" podStartSLOduration=2.007997028 podStartE2EDuration="3.581211346s" totalImagesPullingTime="1.573214318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:45.580967231 +0000 UTC m=+455.599743845" watchObservedRunningTime="2026-07-17 17:31:45.581211346 +0000 UTC m=+455.599987943"
Jul 17 17:31:48.488931 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:48.488897    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"]
Jul 17 17:31:48.491115 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:48.491098    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"
Jul 17 17:31:48.494033 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:48.494012    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fkc44\""
Jul 17 17:31:48.512004 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:48.511980    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"]
Jul 17 17:31:48.653048 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:48.653012    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdjc7\" (UniqueName: \"kubernetes.io/projected/3fbceab9-35b5-4455-ad57-b16320198dd6-kube-api-access-zdjc7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cqv5q\" (UID: \"3fbceab9-35b5-4455-ad57-b16320198dd6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"
Jul 17 17:31:48.653048 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:48.653049    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fbceab9-35b5-4455-ad57-b16320198dd6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cqv5q\" (UID: \"3fbceab9-35b5-4455-ad57-b16320198dd6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"
Jul 17 17:31:48.753652 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:48.753573    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdjc7\" (UniqueName: \"kubernetes.io/projected/3fbceab9-35b5-4455-ad57-b16320198dd6-kube-api-access-zdjc7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cqv5q\" (UID: \"3fbceab9-35b5-4455-ad57-b16320198dd6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"
Jul 17 17:31:48.753652 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:48.753611    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fbceab9-35b5-4455-ad57-b16320198dd6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cqv5q\" (UID: \"3fbceab9-35b5-4455-ad57-b16320198dd6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"
Jul 17 17:31:48.754091 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:48.754071    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fbceab9-35b5-4455-ad57-b16320198dd6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cqv5q\" (UID: \"3fbceab9-35b5-4455-ad57-b16320198dd6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"
Jul 17 17:31:48.774583 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:48.774552    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdjc7\" (UniqueName: \"kubernetes.io/projected/3fbceab9-35b5-4455-ad57-b16320198dd6-kube-api-access-zdjc7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cqv5q\" (UID: \"3fbceab9-35b5-4455-ad57-b16320198dd6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"
Jul 17 17:31:48.801391 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:48.801360    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"
Jul 17 17:31:48.937718 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:48.937682    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"]
Jul 17 17:31:48.940278 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:31:48.940241    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fbceab9_35b5_4455_ad57_b16320198dd6.slice/crio-5bb82c9e3f53e22e786da38d968353d85119ee956375c74f08a9ae2c5a74d3ed WatchSource:0}: Error finding container 5bb82c9e3f53e22e786da38d968353d85119ee956375c74f08a9ae2c5a74d3ed: Status 404 returned error can't find the container with id 5bb82c9e3f53e22e786da38d968353d85119ee956375c74f08a9ae2c5a74d3ed
Jul 17 17:31:49.524000 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:49.523967    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6d4ql"
Jul 17 17:31:49.574525 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:49.574480    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q" event={"ID":"3fbceab9-35b5-4455-ad57-b16320198dd6","Type":"ContainerStarted","Data":"5bb82c9e3f53e22e786da38d968353d85119ee956375c74f08a9ae2c5a74d3ed"}
Jul 17 17:31:54.554215 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:54.554157    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2whvn"
Jul 17 17:31:55.604350 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:55.604321    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q" event={"ID":"3fbceab9-35b5-4455-ad57-b16320198dd6","Type":"ContainerStarted","Data":"bfc9f8e8f7801148e185924105d3a55da16183207972374fe937642240865c8f"}
Jul 17 17:31:55.604674 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:55.604408    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"
Jul 17 17:31:56.562919 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:56.562890    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6"
Jul 17 17:31:56.622646 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:56.622594    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q" podStartSLOduration=2.080519332 podStartE2EDuration="8.622579807s" totalImagesPullingTime="6.542060475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:31:55.673553721 +0000 UTC m=+465.692330319" watchObservedRunningTime="2026-07-17 17:31:56.622579807 +0000 UTC m=+466.641356405"
Jul 17 17:31:58.742948 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:58.742916    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5zwd5"]
Jul 17 17:31:58.745283 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:58.745261    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zwd5"
Jul 17 17:31:58.748492 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:58.748470    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4njl9\""
Jul 17 17:31:58.748681 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:58.748664    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 17 17:31:58.748731 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:58.748717    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 17 17:31:58.777967 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:58.777922    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5zwd5"]
Jul 17 17:31:58.839959 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:58.839928    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8g5z\" (UniqueName: \"kubernetes.io/projected/5905f3f2-d347-4590-a388-b3ba2fe36582-kube-api-access-w8g5z\") pod \"kuadrant-console-plugin-66b5774985-5zwd5\" (UID: \"5905f3f2-d347-4590-a388-b3ba2fe36582\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zwd5"
Jul 17 17:31:58.840095 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:58.839976    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5905f3f2-d347-4590-a388-b3ba2fe36582-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5zwd5\" (UID: \"5905f3f2-d347-4590-a388-b3ba2fe36582\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zwd5"
Jul 17 17:31:58.840095 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:58.840080    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5905f3f2-d347-4590-a388-b3ba2fe36582-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5zwd5\" (UID: \"5905f3f2-d347-4590-a388-b3ba2fe36582\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zwd5"
Jul 17 17:31:58.941323 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:58.941286    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8g5z\" (UniqueName: \"kubernetes.io/projected/5905f3f2-d347-4590-a388-b3ba2fe36582-kube-api-access-w8g5z\") pod \"kuadrant-console-plugin-66b5774985-5zwd5\" (UID: \"5905f3f2-d347-4590-a388-b3ba2fe36582\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zwd5"
Jul 17 17:31:58.941489 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:58.941339    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5905f3f2-d347-4590-a388-b3ba2fe36582-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5zwd5\" (UID: \"5905f3f2-d347-4590-a388-b3ba2fe36582\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zwd5"
Jul 17 17:31:58.941489 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:58.941378    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5905f3f2-d347-4590-a388-b3ba2fe36582-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5zwd5\" (UID: \"5905f3f2-d347-4590-a388-b3ba2fe36582\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zwd5"
Jul 17 17:31:58.941606 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:31:58.941489    2576 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 17 17:31:58.941606 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:31:58.941550    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5905f3f2-d347-4590-a388-b3ba2fe36582-plugin-serving-cert podName:5905f3f2-d347-4590-a388-b3ba2fe36582 nodeName:}" failed. No retries permitted until 2026-07-17 17:31:59.441533341 +0000 UTC m=+469.460309917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/5905f3f2-d347-4590-a388-b3ba2fe36582-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-5zwd5" (UID: "5905f3f2-d347-4590-a388-b3ba2fe36582") : secret "plugin-serving-cert" not found
Jul 17 17:31:58.942061 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:58.942039    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5905f3f2-d347-4590-a388-b3ba2fe36582-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5zwd5\" (UID: \"5905f3f2-d347-4590-a388-b3ba2fe36582\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zwd5"
Jul 17 17:31:58.961488 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:58.961457    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8g5z\" (UniqueName: \"kubernetes.io/projected/5905f3f2-d347-4590-a388-b3ba2fe36582-kube-api-access-w8g5z\") pod \"kuadrant-console-plugin-66b5774985-5zwd5\" (UID: \"5905f3f2-d347-4590-a388-b3ba2fe36582\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zwd5"
Jul 17 17:31:59.446423 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:59.446387    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5905f3f2-d347-4590-a388-b3ba2fe36582-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5zwd5\" (UID: \"5905f3f2-d347-4590-a388-b3ba2fe36582\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zwd5"
Jul 17 17:31:59.448695 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:59.448665    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5905f3f2-d347-4590-a388-b3ba2fe36582-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5zwd5\" (UID: \"5905f3f2-d347-4590-a388-b3ba2fe36582\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zwd5"
Jul 17 17:31:59.654277 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:59.654236    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zwd5"
Jul 17 17:31:59.803193 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:31:59.803151    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5zwd5"]
Jul 17 17:31:59.804568 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:31:59.804528    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5905f3f2_d347_4590_a388_b3ba2fe36582.slice/crio-89e76443d5345babb36df610d34750a64dae653726cf4afc2482f6c96a747742 WatchSource:0}: Error finding container 89e76443d5345babb36df610d34750a64dae653726cf4afc2482f6c96a747742: Status 404 returned error can't find the container with id 89e76443d5345babb36df610d34750a64dae653726cf4afc2482f6c96a747742
Jul 17 17:32:00.627389 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:00.627352    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zwd5" event={"ID":"5905f3f2-d347-4590-a388-b3ba2fe36582","Type":"ContainerStarted","Data":"89e76443d5345babb36df610d34750a64dae653726cf4afc2482f6c96a747742"}
Jul 17 17:32:06.611310 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:06.611278    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"
Jul 17 17:32:08.566691 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.566651    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"]
Jul 17 17:32:08.567158 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.566909    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q" podUID="3fbceab9-35b5-4455-ad57-b16320198dd6" containerName="manager" containerID="cri-o://bfc9f8e8f7801148e185924105d3a55da16183207972374fe937642240865c8f" gracePeriod=2
Jul 17 17:32:08.584689 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.584661    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"]
Jul 17 17:32:08.602315 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:32:08.602255    2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3fbceab9-35b5-4455-ad57-b16320198dd6\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-cqv5q\": pods \"kuadrant-operator-controller-manager-8684c9ff49-cqv5q\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"
Jul 17 17:32:08.614655 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.614616    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6"]
Jul 17 17:32:08.615043 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.614857    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6" podUID="11f07184-c773-40c5-94ee-b15ac3e0884f" containerName="manager" containerID="cri-o://3f9c6b6e3e613dfd667f0396614ad5283df49bc94ae6a65bf4a1b77c68af44a6" gracePeriod=2
Jul 17 17:32:08.617804 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:32:08.617767    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cqv5q\" is forbidden: User \"system:node:ip-10-0-143-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-187.ec2.internal' and this object" podUID="3fbceab9-35b5-4455-ad57-b16320198dd6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"
Jul 17 17:32:08.623845 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.623805    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv"]
Jul 17 17:32:08.624289 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.624264    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fbceab9-35b5-4455-ad57-b16320198dd6" containerName="manager"
Jul 17 17:32:08.624289 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.624291    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fbceab9-35b5-4455-ad57-b16320198dd6" containerName="manager"
Jul 17 17:32:08.624467 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.624453    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fbceab9-35b5-4455-ad57-b16320198dd6" containerName="manager"
Jul 17 17:32:08.629471 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.629287    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6"]
Jul 17 17:32:08.629471 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.629396    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv"
Jul 17 17:32:08.634298 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:32:08.634267    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bvvn6\" is forbidden: User \"system:node:ip-10-0-143-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-187.ec2.internal' and this object" podUID="11f07184-c773-40c5-94ee-b15ac3e0884f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6"
Jul 17 17:32:08.656676 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.656641    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv"]
Jul 17 17:32:08.662377 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.662347    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q2ggh"]
Jul 17 17:32:08.662683 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.662668    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f07184-c773-40c5-94ee-b15ac3e0884f" containerName="manager"
Jul 17 17:32:08.662683 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.662683    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f07184-c773-40c5-94ee-b15ac3e0884f" containerName="manager"
Jul 17 17:32:08.662820 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.662743    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="11f07184-c773-40c5-94ee-b15ac3e0884f" containerName="manager"
Jul 17 17:32:08.667656 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.667627    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q2ggh"
Jul 17 17:32:08.682603 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:32:08.682551    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cqv5q\" is forbidden: User \"system:node:ip-10-0-143-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-187.ec2.internal' and this object" podUID="3fbceab9-35b5-4455-ad57-b16320198dd6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"
Jul 17 17:32:08.682968 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.682900    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q2ggh"]
Jul 17 17:32:08.685771 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:32:08.685671    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bvvn6\" is forbidden: User \"system:node:ip-10-0-143-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-187.ec2.internal' and this object" podUID="11f07184-c773-40c5-94ee-b15ac3e0884f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6"
Jul 17 17:32:08.715074 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:32:08.715037    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cqv5q\" is forbidden: User \"system:node:ip-10-0-143-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-187.ec2.internal' and this object" podUID="3fbceab9-35b5-4455-ad57-b16320198dd6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"
Jul 17 17:32:08.731512 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.731476    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/428db439-dc2c-43ca-a455-2bc884c18c4d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kdwkv\" (UID: \"428db439-dc2c-43ca-a455-2bc884c18c4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv"
Jul 17 17:32:08.731682 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.731606    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwdn8\" (UniqueName: \"kubernetes.io/projected/428db439-dc2c-43ca-a455-2bc884c18c4d-kube-api-access-wwdn8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kdwkv\" (UID: \"428db439-dc2c-43ca-a455-2bc884c18c4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv"
Jul 17 17:32:08.731682 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.731642    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq2ct\" (UniqueName: \"kubernetes.io/projected/008bb7e2-addb-45ca-be58-ac0aa377f3c1-kube-api-access-tq2ct\") pod \"limitador-operator-controller-manager-859d7b78bd-q2ggh\" (UID: \"008bb7e2-addb-45ca-be58-ac0aa377f3c1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q2ggh"
Jul 17 17:32:08.832591 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.832497    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/428db439-dc2c-43ca-a455-2bc884c18c4d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kdwkv\" (UID: \"428db439-dc2c-43ca-a455-2bc884c18c4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv"
Jul 17 17:32:08.832748 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.832618    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwdn8\" (UniqueName: \"kubernetes.io/projected/428db439-dc2c-43ca-a455-2bc884c18c4d-kube-api-access-wwdn8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kdwkv\" (UID: \"428db439-dc2c-43ca-a455-2bc884c18c4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv"
Jul 17 17:32:08.832748 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.832647    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq2ct\" (UniqueName: \"kubernetes.io/projected/008bb7e2-addb-45ca-be58-ac0aa377f3c1-kube-api-access-tq2ct\") pod \"limitador-operator-controller-manager-859d7b78bd-q2ggh\" (UID: \"008bb7e2-addb-45ca-be58-ac0aa377f3c1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q2ggh"
Jul 17 17:32:08.832971 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.832937    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/428db439-dc2c-43ca-a455-2bc884c18c4d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kdwkv\" (UID: \"428db439-dc2c-43ca-a455-2bc884c18c4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv"
Jul 17 17:32:08.844106 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.844076    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq2ct\" (UniqueName: \"kubernetes.io/projected/008bb7e2-addb-45ca-be58-ac0aa377f3c1-kube-api-access-tq2ct\") pod \"limitador-operator-controller-manager-859d7b78bd-q2ggh\" (UID: \"008bb7e2-addb-45ca-be58-ac0aa377f3c1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q2ggh"
Jul 17 17:32:08.844431 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.844410    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwdn8\" (UniqueName: \"kubernetes.io/projected/428db439-dc2c-43ca-a455-2bc884c18c4d-kube-api-access-wwdn8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kdwkv\" (UID: \"428db439-dc2c-43ca-a455-2bc884c18c4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv"
Jul 17 17:32:08.994347 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:08.994278    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv"
Jul 17 17:32:09.003673 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:09.003644    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q2ggh"
Jul 17 17:32:10.521607 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:32:10.521558    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bvvn6\" is forbidden: User \"system:node:ip-10-0-143-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-187.ec2.internal' and this object" podUID="11f07184-c773-40c5-94ee-b15ac3e0884f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6"
Jul 17 17:32:10.526400 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:32:10.526343    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cqv5q\" is forbidden: User \"system:node:ip-10-0-143-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-187.ec2.internal' and this object" podUID="3fbceab9-35b5-4455-ad57-b16320198dd6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"
Jul 17 17:32:22.752141 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:22.752047    2576 generic.go:356] "Generic (PLEG): container finished" podID="3fbceab9-35b5-4455-ad57-b16320198dd6" containerID="bfc9f8e8f7801148e185924105d3a55da16183207972374fe937642240865c8f" exitCode=0
Jul 17 17:32:22.754801 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:22.754721    2576 generic.go:356] "Generic (PLEG): container finished" podID="11f07184-c773-40c5-94ee-b15ac3e0884f" containerID="3f9c6b6e3e613dfd667f0396614ad5283df49bc94ae6a65bf4a1b77c68af44a6" exitCode=0
Jul 17 17:32:22.900158 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:22.900125    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"
Jul 17 17:32:22.902941 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:32:22.902912    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cqv5q\" is forbidden: User \"system:node:ip-10-0-143-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-187.ec2.internal' and this object" podUID="3fbceab9-35b5-4455-ad57-b16320198dd6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"
Jul 17 17:32:22.908256 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:22.908197    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q2ggh"]
Jul 17 17:32:22.908592 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:32:22.908565    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod008bb7e2_addb_45ca_be58_ac0aa377f3c1.slice/crio-f4caeb06adcc1e94ad0c12dacf44afe468ce2c93ff8064f613d72bfd08438522 WatchSource:0}: Error finding container f4caeb06adcc1e94ad0c12dacf44afe468ce2c93ff8064f613d72bfd08438522: Status 404 returned error can't find the container with id f4caeb06adcc1e94ad0c12dacf44afe468ce2c93ff8064f613d72bfd08438522
Jul 17 17:32:22.913193 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:22.913088    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6"
Jul 17 17:32:22.915950 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:32:22.915919    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cqv5q\" is forbidden: User \"system:node:ip-10-0-143-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-187.ec2.internal' and this object" podUID="3fbceab9-35b5-4455-ad57-b16320198dd6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"
Jul 17 17:32:22.918331 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:32:22.918298    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bvvn6\" is forbidden: User \"system:node:ip-10-0-143-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-187.ec2.internal' and this object" podUID="11f07184-c773-40c5-94ee-b15ac3e0884f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6"
Jul 17 17:32:22.935854 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:22.935832    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv"]
Jul 17 17:32:22.937813 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:32:22.937783    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod428db439_dc2c_43ca_a455_2bc884c18c4d.slice/crio-3f447e909f212a52aed633ab65f4e86ab91c790b16d3128b9ff072dba8e2481f WatchSource:0}: Error finding container 3f447e909f212a52aed633ab65f4e86ab91c790b16d3128b9ff072dba8e2481f: Status 404 returned error can't find the container with id 3f447e909f212a52aed633ab65f4e86ab91c790b16d3128b9ff072dba8e2481f
Jul 17 17:32:23.058995 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:23.058960    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v6wt\" (UniqueName: \"kubernetes.io/projected/11f07184-c773-40c5-94ee-b15ac3e0884f-kube-api-access-4v6wt\") pod \"11f07184-c773-40c5-94ee-b15ac3e0884f\" (UID: \"11f07184-c773-40c5-94ee-b15ac3e0884f\") "
Jul 17 17:32:23.059204 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:23.059011    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdjc7\" (UniqueName: \"kubernetes.io/projected/3fbceab9-35b5-4455-ad57-b16320198dd6-kube-api-access-zdjc7\") pod \"3fbceab9-35b5-4455-ad57-b16320198dd6\" (UID: \"3fbceab9-35b5-4455-ad57-b16320198dd6\") "
Jul 17 17:32:23.059204 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:23.059048    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fbceab9-35b5-4455-ad57-b16320198dd6-extensions-socket-volume\") pod \"3fbceab9-35b5-4455-ad57-b16320198dd6\" (UID: \"3fbceab9-35b5-4455-ad57-b16320198dd6\") "
Jul 17 17:32:23.059567 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:23.059542    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fbceab9-35b5-4455-ad57-b16320198dd6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3fbceab9-35b5-4455-ad57-b16320198dd6" (UID: "3fbceab9-35b5-4455-ad57-b16320198dd6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:32:23.061246 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:23.061216    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fbceab9-35b5-4455-ad57-b16320198dd6-kube-api-access-zdjc7" (OuterVolumeSpecName: "kube-api-access-zdjc7") pod "3fbceab9-35b5-4455-ad57-b16320198dd6" (UID: "3fbceab9-35b5-4455-ad57-b16320198dd6"). InnerVolumeSpecName "kube-api-access-zdjc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:32:23.061344 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:23.061287    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11f07184-c773-40c5-94ee-b15ac3e0884f-kube-api-access-4v6wt" (OuterVolumeSpecName: "kube-api-access-4v6wt") pod "11f07184-c773-40c5-94ee-b15ac3e0884f" (UID: "11f07184-c773-40c5-94ee-b15ac3e0884f"). InnerVolumeSpecName "kube-api-access-4v6wt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:32:23.160132 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:23.160094    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdjc7\" (UniqueName: \"kubernetes.io/projected/3fbceab9-35b5-4455-ad57-b16320198dd6-kube-api-access-zdjc7\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:32:23.160132 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:23.160126    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fbceab9-35b5-4455-ad57-b16320198dd6-extensions-socket-volume\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:32:23.160132 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:23.160137    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v6wt\" (UniqueName: \"kubernetes.io/projected/11f07184-c773-40c5-94ee-b15ac3e0884f-kube-api-access-4v6wt\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:32:23.761344 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:23.761295    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv" event={"ID":"428db439-dc2c-43ca-a455-2bc884c18c4d","Type":"ContainerStarted","Data":"50d60172e026b42f14b7f8c16816f4688e81abfc2ad25571d096d225edcc09c4"}
Jul 17 17:32:23.761784 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:23.761360    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv" event={"ID":"428db439-dc2c-43ca-a455-2bc884c18c4d","Type":"ContainerStarted","Data":"3f447e909f212a52aed633ab65f4e86ab91c790b16d3128b9ff072dba8e2481f"}
Jul 17 17:32:23.761784 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:23.761390    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv"
Jul 17 17:32:23.763316 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:23.762854    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zwd5" event={"ID":"5905f3f2-d347-4590-a388-b3ba2fe36582","Type":"ContainerStarted","Data":"34bd7a7a78de4f8eaa08e8fe4bfdc2b10b9506620542f1cd535e818a54a50b55"}
Jul 17 17:32:23.768202 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:32:23.764282    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cqv5q\" is forbidden: User \"system:node:ip-10-0-143-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-187.ec2.internal' and this object" podUID="3fbceab9-35b5-4455-ad57-b16320198dd6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"
Jul 17 17:32:23.769565 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:23.769541    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6"
Jul 17 17:32:23.769680 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:23.769555    2576 scope.go:117] "RemoveContainer" containerID="3f9c6b6e3e613dfd667f0396614ad5283df49bc94ae6a65bf4a1b77c68af44a6"
Jul 17 17:32:23.771299 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:32:23.771264    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bvvn6\" is forbidden: User \"system:node:ip-10-0-143-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-187.ec2.internal' and this object" podUID="11f07184-c773-40c5-94ee-b15ac3e0884f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6"
Jul 17 17:32:23.771446 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:23.771418    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q2ggh" event={"ID":"008bb7e2-addb-45ca-be58-ac0aa377f3c1","Type":"ContainerStarted","Data":"2d82936091f1831115b69e6e9c1fe6b9c488da14d3e5b80175a0516b73c6198c"}
Jul 17 17:32:23.771518 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:23.771497    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q2ggh"
Jul 17 17:32:23.771573 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:23.771523    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q2ggh" event={"ID":"008bb7e2-addb-45ca-be58-ac0aa377f3c1","Type":"ContainerStarted","Data":"f4caeb06adcc1e94ad0c12dacf44afe468ce2c93ff8064f613d72bfd08438522"}
Jul 17 17:32:23.772814 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:23.772793    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"
Jul 17 17:32:23.779432 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:23.779411    2576 scope.go:117] "RemoveContainer" containerID="bfc9f8e8f7801148e185924105d3a55da16183207972374fe937642240865c8f"
Jul 17 17:32:23.815697 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:23.815642    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv" podStartSLOduration=15.815625704 podStartE2EDuration="15.815625704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:32:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:32:23.812849795 +0000 UTC m=+493.831626393" watchObservedRunningTime="2026-07-17 17:32:23.815625704 +0000 UTC m=+493.834402424"
Jul 17 17:32:23.816306 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:32:23.816276    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cqv5q\" is forbidden: User \"system:node:ip-10-0-143-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-187.ec2.internal' and this object" podUID="3fbceab9-35b5-4455-ad57-b16320198dd6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cqv5q"
Jul 17 17:32:23.881499 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:32:23.881455    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bvvn6\" is forbidden: User \"system:node:ip-10-0-143-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-187.ec2.internal' and this object" podUID="11f07184-c773-40c5-94ee-b15ac3e0884f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bvvn6"
Jul 17 17:32:23.921888 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:23.921822    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5zwd5" podStartSLOduration=2.892825034 podStartE2EDuration="25.921805059s" totalImagesPullingTime="23.028980025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:31:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:32:23.873380707 +0000 UTC m=+493.892157307" watchObservedRunningTime="2026-07-17 17:32:23.921805059 +0000 UTC m=+493.940581656"
Jul 17 17:32:24.524214 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:24.524158    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11f07184-c773-40c5-94ee-b15ac3e0884f" path="/var/lib/kubelet/pods/11f07184-c773-40c5-94ee-b15ac3e0884f/volumes"
Jul 17 17:32:24.524595 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:24.524579    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fbceab9-35b5-4455-ad57-b16320198dd6" path="/var/lib/kubelet/pods/3fbceab9-35b5-4455-ad57-b16320198dd6/volumes"
Jul 17 17:32:25.955187 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:25.955110    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q2ggh" podStartSLOduration=17.955086531 podStartE2EDuration="17.955086531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:32:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:32:23.921331994 +0000 UTC m=+493.940108593" watchObservedRunningTime="2026-07-17 17:32:25.955086531 +0000 UTC m=+495.973863131"
Jul 17 17:32:25.956825 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:25.956804    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv"]
Jul 17 17:32:25.957002 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:25.956979    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv" podUID="428db439-dc2c-43ca-a455-2bc884c18c4d" containerName="manager" containerID="cri-o://50d60172e026b42f14b7f8c16816f4688e81abfc2ad25571d096d225edcc09c4" gracePeriod=10
Jul 17 17:32:26.252836 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:26.252800    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv"
Jul 17 17:32:26.386220 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:26.386188    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwdn8\" (UniqueName: \"kubernetes.io/projected/428db439-dc2c-43ca-a455-2bc884c18c4d-kube-api-access-wwdn8\") pod \"428db439-dc2c-43ca-a455-2bc884c18c4d\" (UID: \"428db439-dc2c-43ca-a455-2bc884c18c4d\") "
Jul 17 17:32:26.386395 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:26.386279    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/428db439-dc2c-43ca-a455-2bc884c18c4d-extensions-socket-volume\") pod \"428db439-dc2c-43ca-a455-2bc884c18c4d\" (UID: \"428db439-dc2c-43ca-a455-2bc884c18c4d\") "
Jul 17 17:32:26.386623 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:26.386600    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/428db439-dc2c-43ca-a455-2bc884c18c4d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "428db439-dc2c-43ca-a455-2bc884c18c4d" (UID: "428db439-dc2c-43ca-a455-2bc884c18c4d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:32:26.388134 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:26.388110    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/428db439-dc2c-43ca-a455-2bc884c18c4d-kube-api-access-wwdn8" (OuterVolumeSpecName: "kube-api-access-wwdn8") pod "428db439-dc2c-43ca-a455-2bc884c18c4d" (UID: "428db439-dc2c-43ca-a455-2bc884c18c4d"). InnerVolumeSpecName "kube-api-access-wwdn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:32:26.487103 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:26.487020    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwdn8\" (UniqueName: \"kubernetes.io/projected/428db439-dc2c-43ca-a455-2bc884c18c4d-kube-api-access-wwdn8\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:32:26.487103 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:26.487049    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/428db439-dc2c-43ca-a455-2bc884c18c4d-extensions-socket-volume\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:32:26.789968 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:26.789881    2576 generic.go:356] "Generic (PLEG): container finished" podID="428db439-dc2c-43ca-a455-2bc884c18c4d" containerID="50d60172e026b42f14b7f8c16816f4688e81abfc2ad25571d096d225edcc09c4" exitCode=0
Jul 17 17:32:26.789968 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:26.789923    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv"
Jul 17 17:32:26.789968 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:26.789930    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv" event={"ID":"428db439-dc2c-43ca-a455-2bc884c18c4d","Type":"ContainerDied","Data":"50d60172e026b42f14b7f8c16816f4688e81abfc2ad25571d096d225edcc09c4"}
Jul 17 17:32:26.790235 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:26.789979    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv" event={"ID":"428db439-dc2c-43ca-a455-2bc884c18c4d","Type":"ContainerDied","Data":"3f447e909f212a52aed633ab65f4e86ab91c790b16d3128b9ff072dba8e2481f"}
Jul 17 17:32:26.790235 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:26.790004    2576 scope.go:117] "RemoveContainer" containerID="50d60172e026b42f14b7f8c16816f4688e81abfc2ad25571d096d225edcc09c4"
Jul 17 17:32:26.798597 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:26.798567    2576 scope.go:117] "RemoveContainer" containerID="50d60172e026b42f14b7f8c16816f4688e81abfc2ad25571d096d225edcc09c4"
Jul 17 17:32:26.798948 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:32:26.798926    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50d60172e026b42f14b7f8c16816f4688e81abfc2ad25571d096d225edcc09c4\": container with ID starting with 50d60172e026b42f14b7f8c16816f4688e81abfc2ad25571d096d225edcc09c4 not found: ID does not exist" containerID="50d60172e026b42f14b7f8c16816f4688e81abfc2ad25571d096d225edcc09c4"
Jul 17 17:32:26.799037 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:26.798968    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50d60172e026b42f14b7f8c16816f4688e81abfc2ad25571d096d225edcc09c4"} err="failed to get container status \"50d60172e026b42f14b7f8c16816f4688e81abfc2ad25571d096d225edcc09c4\": rpc error: code = NotFound desc = could not find container \"50d60172e026b42f14b7f8c16816f4688e81abfc2ad25571d096d225edcc09c4\": container with ID starting with 50d60172e026b42f14b7f8c16816f4688e81abfc2ad25571d096d225edcc09c4 not found: ID does not exist"
Jul 17 17:32:26.825903 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:26.825859    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv"]
Jul 17 17:32:26.830568 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:26.830539    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kdwkv"]
Jul 17 17:32:28.521641 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:28.521609    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="428db439-dc2c-43ca-a455-2bc884c18c4d" path="/var/lib/kubelet/pods/428db439-dc2c-43ca-a455-2bc884c18c4d/volumes"
Jul 17 17:32:34.781393 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:34.781323    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-q2ggh"
Jul 17 17:32:44.424748 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:44.424710    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4l4h"]
Jul 17 17:32:44.425154 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:44.425063    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="428db439-dc2c-43ca-a455-2bc884c18c4d" containerName="manager"
Jul 17 17:32:44.425154 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:44.425095    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="428db439-dc2c-43ca-a455-2bc884c18c4d" containerName="manager"
Jul 17 17:32:44.425284 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:44.425159    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="428db439-dc2c-43ca-a455-2bc884c18c4d" containerName="manager"
Jul 17 17:32:44.576741 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:44.576701    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4l4h"]
Jul 17 17:32:44.576741 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:44.576752    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4l4h"]
Jul 17 17:32:44.576986 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:44.576850    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4l4h"
Jul 17 17:32:44.581402 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:44.581370    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 17 17:32:44.740044 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:44.740006    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce8f754d-b530-4625-818c-dce09443e0c0-config-file\") pod \"limitador-limitador-64c94fd64f-l4l4h\" (UID: \"ce8f754d-b530-4625-818c-dce09443e0c0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4l4h"
Jul 17 17:32:44.740044 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:44.740046    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf9mm\" (UniqueName: \"kubernetes.io/projected/ce8f754d-b530-4625-818c-dce09443e0c0-kube-api-access-xf9mm\") pod \"limitador-limitador-64c94fd64f-l4l4h\" (UID: \"ce8f754d-b530-4625-818c-dce09443e0c0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4l4h"
Jul 17 17:32:44.840990 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:44.840949    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce8f754d-b530-4625-818c-dce09443e0c0-config-file\") pod \"limitador-limitador-64c94fd64f-l4l4h\" (UID: \"ce8f754d-b530-4625-818c-dce09443e0c0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4l4h"
Jul 17 17:32:44.841214 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:44.841005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf9mm\" (UniqueName: \"kubernetes.io/projected/ce8f754d-b530-4625-818c-dce09443e0c0-kube-api-access-xf9mm\") pod \"limitador-limitador-64c94fd64f-l4l4h\" (UID: \"ce8f754d-b530-4625-818c-dce09443e0c0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4l4h"
Jul 17 17:32:44.841639 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:44.841618    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce8f754d-b530-4625-818c-dce09443e0c0-config-file\") pod \"limitador-limitador-64c94fd64f-l4l4h\" (UID: \"ce8f754d-b530-4625-818c-dce09443e0c0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4l4h"
Jul 17 17:32:44.861527 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:44.861494    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf9mm\" (UniqueName: \"kubernetes.io/projected/ce8f754d-b530-4625-818c-dce09443e0c0-kube-api-access-xf9mm\") pod \"limitador-limitador-64c94fd64f-l4l4h\" (UID: \"ce8f754d-b530-4625-818c-dce09443e0c0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-l4l4h"
Jul 17 17:32:44.876558 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:44.876521    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:32:44.886982 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:44.886948    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4l4h"
Jul 17 17:32:44.910760 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:44.910719    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:32:44.910956 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:44.910780    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:32:44.910956 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:44.910859    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-82xqb"
Jul 17 17:32:45.042650 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:45.042611    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pcxx\" (UniqueName: \"kubernetes.io/projected/e5a96088-6bc2-444b-9610-a998b5491952-kube-api-access-9pcxx\") pod \"limitador-limitador-54d6d988d5-82xqb\" (UID: \"e5a96088-6bc2-444b-9610-a998b5491952\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-82xqb"
Jul 17 17:32:45.042650 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:45.042653    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5a96088-6bc2-444b-9610-a998b5491952-config-file\") pod \"limitador-limitador-54d6d988d5-82xqb\" (UID: \"e5a96088-6bc2-444b-9610-a998b5491952\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-82xqb"
Jul 17 17:32:45.058569 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:45.058537    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4l4h"]
Jul 17 17:32:45.060453 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:32:45.060420    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce8f754d_b530_4625_818c_dce09443e0c0.slice/crio-b0cbb5eef4185e3281ed0d3c66b6c00768914b54ef8f10a61dc53f23bde73866 WatchSource:0}: Error finding container b0cbb5eef4185e3281ed0d3c66b6c00768914b54ef8f10a61dc53f23bde73866: Status 404 returned error can't find the container with id b0cbb5eef4185e3281ed0d3c66b6c00768914b54ef8f10a61dc53f23bde73866
Jul 17 17:32:45.143674 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:45.143633    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pcxx\" (UniqueName: \"kubernetes.io/projected/e5a96088-6bc2-444b-9610-a998b5491952-kube-api-access-9pcxx\") pod \"limitador-limitador-54d6d988d5-82xqb\" (UID: \"e5a96088-6bc2-444b-9610-a998b5491952\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-82xqb"
Jul 17 17:32:45.143674 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:45.143668    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5a96088-6bc2-444b-9610-a998b5491952-config-file\") pod \"limitador-limitador-54d6d988d5-82xqb\" (UID: \"e5a96088-6bc2-444b-9610-a998b5491952\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-82xqb"
Jul 17 17:32:45.144327 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:45.144303    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5a96088-6bc2-444b-9610-a998b5491952-config-file\") pod \"limitador-limitador-54d6d988d5-82xqb\" (UID: \"e5a96088-6bc2-444b-9610-a998b5491952\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-82xqb"
Jul 17 17:32:45.160103 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:45.160070    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pcxx\" (UniqueName: \"kubernetes.io/projected/e5a96088-6bc2-444b-9610-a998b5491952-kube-api-access-9pcxx\") pod \"limitador-limitador-54d6d988d5-82xqb\" (UID: \"e5a96088-6bc2-444b-9610-a998b5491952\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-82xqb"
Jul 17 17:32:45.222355 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:45.222319    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-82xqb"
Jul 17 17:32:45.421301 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:45.421266    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:32:45.421495 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:32:45.421477    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a96088_6bc2_444b_9610_a998b5491952.slice/crio-de6799d40f4d832b1662c6e944c65f94d2d6e307a69991c32e6756b393554beb WatchSource:0}: Error finding container de6799d40f4d832b1662c6e944c65f94d2d6e307a69991c32e6756b393554beb: Status 404 returned error can't find the container with id de6799d40f4d832b1662c6e944c65f94d2d6e307a69991c32e6756b393554beb
Jul 17 17:32:45.661216 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:45.661126    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-dspcw"]
Jul 17 17:32:45.670397 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:45.670366    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dspcw"
Jul 17 17:32:45.673704 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:45.673681    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-766l6\""
Jul 17 17:32:45.680767 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:45.680738    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dspcw"]
Jul 17 17:32:45.848498 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:45.848463    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zqz5\" (UniqueName: \"kubernetes.io/projected/d2afd0ce-eae2-4ec2-bb71-4d9119af037b-kube-api-access-8zqz5\") pod \"authorino-75d556bd77-dspcw\" (UID: \"d2afd0ce-eae2-4ec2-bb71-4d9119af037b\") " pod="kuadrant-system/authorino-75d556bd77-dspcw"
Jul 17 17:32:45.877181 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:45.877133    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-82xqb" event={"ID":"e5a96088-6bc2-444b-9610-a998b5491952","Type":"ContainerStarted","Data":"de6799d40f4d832b1662c6e944c65f94d2d6e307a69991c32e6756b393554beb"}
Jul 17 17:32:45.878213 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:45.878192    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4l4h" event={"ID":"ce8f754d-b530-4625-818c-dce09443e0c0","Type":"ContainerStarted","Data":"b0cbb5eef4185e3281ed0d3c66b6c00768914b54ef8f10a61dc53f23bde73866"}
Jul 17 17:32:45.949754 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:45.949666    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zqz5\" (UniqueName: \"kubernetes.io/projected/d2afd0ce-eae2-4ec2-bb71-4d9119af037b-kube-api-access-8zqz5\") pod \"authorino-75d556bd77-dspcw\" (UID: \"d2afd0ce-eae2-4ec2-bb71-4d9119af037b\") " pod="kuadrant-system/authorino-75d556bd77-dspcw"
Jul 17 17:32:45.961767 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:45.961738    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zqz5\" (UniqueName: \"kubernetes.io/projected/d2afd0ce-eae2-4ec2-bb71-4d9119af037b-kube-api-access-8zqz5\") pod \"authorino-75d556bd77-dspcw\" (UID: \"d2afd0ce-eae2-4ec2-bb71-4d9119af037b\") " pod="kuadrant-system/authorino-75d556bd77-dspcw"
Jul 17 17:32:45.981299 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:45.981261    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dspcw"
Jul 17 17:32:46.173980 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:46.173955    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dspcw"]
Jul 17 17:32:46.176411 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:32:46.176380    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2afd0ce_eae2_4ec2_bb71_4d9119af037b.slice/crio-6c39d2107f22502dbfbc15a118994671eb954f133c6ab41a565689733e9e2013 WatchSource:0}: Error finding container 6c39d2107f22502dbfbc15a118994671eb954f133c6ab41a565689733e9e2013: Status 404 returned error can't find the container with id 6c39d2107f22502dbfbc15a118994671eb954f133c6ab41a565689733e9e2013
Jul 17 17:32:46.885058 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:46.885016    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dspcw" event={"ID":"d2afd0ce-eae2-4ec2-bb71-4d9119af037b","Type":"ContainerStarted","Data":"6c39d2107f22502dbfbc15a118994671eb954f133c6ab41a565689733e9e2013"}
Jul 17 17:32:49.913123 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:49.913077    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-82xqb" event={"ID":"e5a96088-6bc2-444b-9610-a998b5491952","Type":"ContainerStarted","Data":"ac86ceee9da10b4aa4bf7b3d16705f5bfdec03fa10f55da1db1bcae5bdea9a72"}
Jul 17 17:32:49.913603 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:49.913238    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-82xqb"
Jul 17 17:32:49.915090 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:49.915064    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4l4h" event={"ID":"ce8f754d-b530-4625-818c-dce09443e0c0","Type":"ContainerStarted","Data":"5feac6d545be5e4b4c790986b94353cc654ea5886ea17509bc8bfa553c8e1167"}
Jul 17 17:32:49.915233 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:49.915218    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4l4h"
Jul 17 17:32:49.942763 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:49.942702    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-82xqb" podStartSLOduration=2.229905901 podStartE2EDuration="5.942684088s" totalImagesPullingTime="3.712778187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:32:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:32:49.940726656 +0000 UTC m=+519.959503257" watchObservedRunningTime="2026-07-17 17:32:49.942684088 +0000 UTC m=+519.961460685"
Jul 17 17:32:49.972152 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:49.972082    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4l4h" podStartSLOduration=1.9076928149999999 podStartE2EDuration="5.972063275s" totalImagesPullingTime="4.06437046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:32:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:32:49.970233436 +0000 UTC m=+519.989010036" watchObservedRunningTime="2026-07-17 17:32:49.972063275 +0000 UTC m=+519.990839889"
Jul 17 17:32:52.938259 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:52.938214    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dspcw" event={"ID":"d2afd0ce-eae2-4ec2-bb71-4d9119af037b","Type":"ContainerStarted","Data":"788bd81683fd7ba8681bd9829e26f1fc5b30be9f91e14b6712dc8aa9795fe2c1"}
Jul 17 17:32:52.959256 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:32:52.959198    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-dspcw" podStartSLOduration=2.151320035 podStartE2EDuration="7.959180897s" totalImagesPullingTime="5.807860862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:32:52.957082145 +0000 UTC m=+522.975858745" watchObservedRunningTime="2026-07-17 17:32:52.959180897 +0000 UTC m=+522.977957486"
Jul 17 17:33:00.922000 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:00.921966    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-82xqb"
Jul 17 17:33:00.922483 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:00.922056    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4l4h"
Jul 17 17:33:00.996373 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:00.996342    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4l4h"]
Jul 17 17:33:00.996543 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:00.996516    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4l4h" podUID="ce8f754d-b530-4625-818c-dce09443e0c0" containerName="limitador" containerID="cri-o://5feac6d545be5e4b4c790986b94353cc654ea5886ea17509bc8bfa553c8e1167" gracePeriod=30
Jul 17 17:33:01.551068 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:01.551038    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4l4h"
Jul 17 17:33:01.594951 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:01.594856    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf9mm\" (UniqueName: \"kubernetes.io/projected/ce8f754d-b530-4625-818c-dce09443e0c0-kube-api-access-xf9mm\") pod \"ce8f754d-b530-4625-818c-dce09443e0c0\" (UID: \"ce8f754d-b530-4625-818c-dce09443e0c0\") "
Jul 17 17:33:01.594951 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:01.594928    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce8f754d-b530-4625-818c-dce09443e0c0-config-file\") pod \"ce8f754d-b530-4625-818c-dce09443e0c0\" (UID: \"ce8f754d-b530-4625-818c-dce09443e0c0\") "
Jul 17 17:33:01.595300 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:01.595274    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce8f754d-b530-4625-818c-dce09443e0c0-config-file" (OuterVolumeSpecName: "config-file") pod "ce8f754d-b530-4625-818c-dce09443e0c0" (UID: "ce8f754d-b530-4625-818c-dce09443e0c0"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:33:01.596959 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:01.596933    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce8f754d-b530-4625-818c-dce09443e0c0-kube-api-access-xf9mm" (OuterVolumeSpecName: "kube-api-access-xf9mm") pod "ce8f754d-b530-4625-818c-dce09443e0c0" (UID: "ce8f754d-b530-4625-818c-dce09443e0c0"). InnerVolumeSpecName "kube-api-access-xf9mm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:33:01.695591 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:01.695553    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf9mm\" (UniqueName: \"kubernetes.io/projected/ce8f754d-b530-4625-818c-dce09443e0c0-kube-api-access-xf9mm\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:33:01.695591 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:01.695580    2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce8f754d-b530-4625-818c-dce09443e0c0-config-file\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:33:01.982854 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:01.982816    2576 generic.go:356] "Generic (PLEG): container finished" podID="ce8f754d-b530-4625-818c-dce09443e0c0" containerID="5feac6d545be5e4b4c790986b94353cc654ea5886ea17509bc8bfa553c8e1167" exitCode=0
Jul 17 17:33:01.983379 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:01.982862    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4l4h"
Jul 17 17:33:01.983379 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:01.982891    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4l4h" event={"ID":"ce8f754d-b530-4625-818c-dce09443e0c0","Type":"ContainerDied","Data":"5feac6d545be5e4b4c790986b94353cc654ea5886ea17509bc8bfa553c8e1167"}
Jul 17 17:33:01.983379 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:01.982933    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-l4l4h" event={"ID":"ce8f754d-b530-4625-818c-dce09443e0c0","Type":"ContainerDied","Data":"b0cbb5eef4185e3281ed0d3c66b6c00768914b54ef8f10a61dc53f23bde73866"}
Jul 17 17:33:01.983379 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:01.982956    2576 scope.go:117] "RemoveContainer" containerID="5feac6d545be5e4b4c790986b94353cc654ea5886ea17509bc8bfa553c8e1167"
Jul 17 17:33:01.991677 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:01.991653    2576 scope.go:117] "RemoveContainer" containerID="5feac6d545be5e4b4c790986b94353cc654ea5886ea17509bc8bfa553c8e1167"
Jul 17 17:33:01.991972 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:33:01.991956    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5feac6d545be5e4b4c790986b94353cc654ea5886ea17509bc8bfa553c8e1167\": container with ID starting with 5feac6d545be5e4b4c790986b94353cc654ea5886ea17509bc8bfa553c8e1167 not found: ID does not exist" containerID="5feac6d545be5e4b4c790986b94353cc654ea5886ea17509bc8bfa553c8e1167"
Jul 17 17:33:01.992010 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:01.991982    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5feac6d545be5e4b4c790986b94353cc654ea5886ea17509bc8bfa553c8e1167"} err="failed to get container status \"5feac6d545be5e4b4c790986b94353cc654ea5886ea17509bc8bfa553c8e1167\": rpc error: code = NotFound desc = could not find container \"5feac6d545be5e4b4c790986b94353cc654ea5886ea17509bc8bfa553c8e1167\": container with ID starting with 5feac6d545be5e4b4c790986b94353cc654ea5886ea17509bc8bfa553c8e1167 not found: ID does not exist"
Jul 17 17:33:02.014411 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:02.014369    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4l4h"]
Jul 17 17:33:02.018447 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:02.018412    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-l4l4h"]
Jul 17 17:33:02.522472 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:02.522440    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce8f754d-b530-4625-818c-dce09443e0c0" path="/var/lib/kubelet/pods/ce8f754d-b530-4625-818c-dce09443e0c0/volumes"
Jul 17 17:33:18.992040 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:18.992001    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nfmb9"]
Jul 17 17:33:18.992473 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:18.992340    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce8f754d-b530-4625-818c-dce09443e0c0" containerName="limitador"
Jul 17 17:33:18.992473 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:18.992353    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce8f754d-b530-4625-818c-dce09443e0c0" containerName="limitador"
Jul 17 17:33:18.992473 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:18.992423    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce8f754d-b530-4625-818c-dce09443e0c0" containerName="limitador"
Jul 17 17:33:18.995042 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:18.995020    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nfmb9"
Jul 17 17:33:19.012262 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.012231    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nfmb9"]
Jul 17 17:33:19.151777 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.151732    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cbr6\" (UniqueName: \"kubernetes.io/projected/eb30bee8-67de-4740-968d-c69bc6bfc971-kube-api-access-9cbr6\") pod \"authorino-5d4b67c446-nfmb9\" (UID: \"eb30bee8-67de-4740-968d-c69bc6bfc971\") " pod="kuadrant-system/authorino-5d4b67c446-nfmb9"
Jul 17 17:33:19.253361 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.253257    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cbr6\" (UniqueName: \"kubernetes.io/projected/eb30bee8-67de-4740-968d-c69bc6bfc971-kube-api-access-9cbr6\") pod \"authorino-5d4b67c446-nfmb9\" (UID: \"eb30bee8-67de-4740-968d-c69bc6bfc971\") " pod="kuadrant-system/authorino-5d4b67c446-nfmb9"
Jul 17 17:33:19.272225 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.272185    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cbr6\" (UniqueName: \"kubernetes.io/projected/eb30bee8-67de-4740-968d-c69bc6bfc971-kube-api-access-9cbr6\") pod \"authorino-5d4b67c446-nfmb9\" (UID: \"eb30bee8-67de-4740-968d-c69bc6bfc971\") " pod="kuadrant-system/authorino-5d4b67c446-nfmb9"
Jul 17 17:33:19.272496 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.272478    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nfmb9"]
Jul 17 17:33:19.272716 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.272705    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nfmb9"
Jul 17 17:33:19.328091 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.328054    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b8b5ccf88-vjdnc"]
Jul 17 17:33:19.330940 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.330897    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b8b5ccf88-vjdnc"
Jul 17 17:33:19.355916 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.355879    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b8b5ccf88-vjdnc"]
Jul 17 17:33:19.419578 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.419552    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nfmb9"]
Jul 17 17:33:19.421205 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:33:19.421172    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb30bee8_67de_4740_968d_c69bc6bfc971.slice/crio-1478c7e1685fb4ba75aa07b168ddefea7fe49ca5d554d093c385471504959007 WatchSource:0}: Error finding container 1478c7e1685fb4ba75aa07b168ddefea7fe49ca5d554d093c385471504959007: Status 404 returned error can't find the container with id 1478c7e1685fb4ba75aa07b168ddefea7fe49ca5d554d093c385471504959007
Jul 17 17:33:19.455279 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.455242    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l52gt\" (UniqueName: \"kubernetes.io/projected/11650762-3497-491e-8eee-fbed6a8c885e-kube-api-access-l52gt\") pod \"authorino-b8b5ccf88-vjdnc\" (UID: \"11650762-3497-491e-8eee-fbed6a8c885e\") " pod="kuadrant-system/authorino-b8b5ccf88-vjdnc"
Jul 17 17:33:19.556404 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.556305    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l52gt\" (UniqueName: \"kubernetes.io/projected/11650762-3497-491e-8eee-fbed6a8c885e-kube-api-access-l52gt\") pod \"authorino-b8b5ccf88-vjdnc\" (UID: \"11650762-3497-491e-8eee-fbed6a8c885e\") " pod="kuadrant-system/authorino-b8b5ccf88-vjdnc"
Jul 17 17:33:19.581751 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.581714    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l52gt\" (UniqueName: \"kubernetes.io/projected/11650762-3497-491e-8eee-fbed6a8c885e-kube-api-access-l52gt\") pod \"authorino-b8b5ccf88-vjdnc\" (UID: \"11650762-3497-491e-8eee-fbed6a8c885e\") " pod="kuadrant-system/authorino-b8b5ccf88-vjdnc"
Jul 17 17:33:19.614465 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.614429    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b8b5ccf88-vjdnc"]
Jul 17 17:33:19.614700 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.614686    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b8b5ccf88-vjdnc"
Jul 17 17:33:19.663914 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.663876    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-799f9775bd-mk8vd"]
Jul 17 17:33:19.667468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.667399    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-799f9775bd-mk8vd"
Jul 17 17:33:19.671453 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.671419    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 17 17:33:19.682791 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.682751    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-799f9775bd-mk8vd"]
Jul 17 17:33:19.758278 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.758240    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/459c4a0a-4a5f-4ca5-8a96-60eee2e94f52-tls-cert\") pod \"authorino-799f9775bd-mk8vd\" (UID: \"459c4a0a-4a5f-4ca5-8a96-60eee2e94f52\") " pod="kuadrant-system/authorino-799f9775bd-mk8vd"
Jul 17 17:33:19.758426 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.758300    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-924f7\" (UniqueName: \"kubernetes.io/projected/459c4a0a-4a5f-4ca5-8a96-60eee2e94f52-kube-api-access-924f7\") pod \"authorino-799f9775bd-mk8vd\" (UID: \"459c4a0a-4a5f-4ca5-8a96-60eee2e94f52\") " pod="kuadrant-system/authorino-799f9775bd-mk8vd"
Jul 17 17:33:19.764919 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.764888    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b8b5ccf88-vjdnc"]
Jul 17 17:33:19.768035 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:33:19.768001    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11650762_3497_491e_8eee_fbed6a8c885e.slice/crio-17dd4d0bbb44a0c86c79e309402bb79169ff1cd3cd8b6fb1097049ecbaefe978 WatchSource:0}: Error finding container 17dd4d0bbb44a0c86c79e309402bb79169ff1cd3cd8b6fb1097049ecbaefe978: Status 404 returned error can't find the container with id 17dd4d0bbb44a0c86c79e309402bb79169ff1cd3cd8b6fb1097049ecbaefe978
Jul 17 17:33:19.859418 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.859318    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/459c4a0a-4a5f-4ca5-8a96-60eee2e94f52-tls-cert\") pod \"authorino-799f9775bd-mk8vd\" (UID: \"459c4a0a-4a5f-4ca5-8a96-60eee2e94f52\") " pod="kuadrant-system/authorino-799f9775bd-mk8vd"
Jul 17 17:33:19.859418 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.859391    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-924f7\" (UniqueName: \"kubernetes.io/projected/459c4a0a-4a5f-4ca5-8a96-60eee2e94f52-kube-api-access-924f7\") pod \"authorino-799f9775bd-mk8vd\" (UID: \"459c4a0a-4a5f-4ca5-8a96-60eee2e94f52\") " pod="kuadrant-system/authorino-799f9775bd-mk8vd"
Jul 17 17:33:19.862314 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.862286    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/459c4a0a-4a5f-4ca5-8a96-60eee2e94f52-tls-cert\") pod \"authorino-799f9775bd-mk8vd\" (UID: \"459c4a0a-4a5f-4ca5-8a96-60eee2e94f52\") " pod="kuadrant-system/authorino-799f9775bd-mk8vd"
Jul 17 17:33:19.875546 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.875515    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-924f7\" (UniqueName: \"kubernetes.io/projected/459c4a0a-4a5f-4ca5-8a96-60eee2e94f52-kube-api-access-924f7\") pod \"authorino-799f9775bd-mk8vd\" (UID: \"459c4a0a-4a5f-4ca5-8a96-60eee2e94f52\") " pod="kuadrant-system/authorino-799f9775bd-mk8vd"
Jul 17 17:33:19.979674 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:19.979630    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-799f9775bd-mk8vd"
Jul 17 17:33:20.067850 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:20.067805    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-nfmb9" event={"ID":"eb30bee8-67de-4740-968d-c69bc6bfc971","Type":"ContainerStarted","Data":"5e08f98f081eaf8bef6cd1822246094a4f8e9cb3101fde5930c2e2f4c18b6992"}
Jul 17 17:33:20.067850 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:20.067815    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-nfmb9" podUID="eb30bee8-67de-4740-968d-c69bc6bfc971" containerName="authorino" containerID="cri-o://5e08f98f081eaf8bef6cd1822246094a4f8e9cb3101fde5930c2e2f4c18b6992" gracePeriod=30
Jul 17 17:33:20.067850 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:20.067867    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-nfmb9" event={"ID":"eb30bee8-67de-4740-968d-c69bc6bfc971","Type":"ContainerStarted","Data":"1478c7e1685fb4ba75aa07b168ddefea7fe49ca5d554d093c385471504959007"}
Jul 17 17:33:20.069110 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:20.069083    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b8b5ccf88-vjdnc" event={"ID":"11650762-3497-491e-8eee-fbed6a8c885e","Type":"ContainerStarted","Data":"17dd4d0bbb44a0c86c79e309402bb79169ff1cd3cd8b6fb1097049ecbaefe978"}
Jul 17 17:33:20.104642 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:20.104578    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-nfmb9" podStartSLOduration=1.7952094939999999 podStartE2EDuration="2.104560571s" totalImagesPullingTime="309.351077ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:33:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:33:20.103582638 +0000 UTC m=+550.122359237" watchObservedRunningTime="2026-07-17 17:33:20.104560571 +0000 UTC m=+550.123337168"
Jul 17 17:33:20.143067 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:20.142979    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-799f9775bd-mk8vd"]
Jul 17 17:33:20.157269 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:33:20.157233    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod459c4a0a_4a5f_4ca5_8a96_60eee2e94f52.slice/crio-29307ff3ce63988377ebc7762bd7dab1b1309239c4f234a17460e1d4684d6944 WatchSource:0}: Error finding container 29307ff3ce63988377ebc7762bd7dab1b1309239c4f234a17460e1d4684d6944: Status 404 returned error can't find the container with id 29307ff3ce63988377ebc7762bd7dab1b1309239c4f234a17460e1d4684d6944
Jul 17 17:33:20.340314 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:20.340261    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nfmb9"
Jul 17 17:33:20.464804 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:20.464768    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cbr6\" (UniqueName: \"kubernetes.io/projected/eb30bee8-67de-4740-968d-c69bc6bfc971-kube-api-access-9cbr6\") pod \"eb30bee8-67de-4740-968d-c69bc6bfc971\" (UID: \"eb30bee8-67de-4740-968d-c69bc6bfc971\") "
Jul 17 17:33:20.466850 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:20.466821    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb30bee8-67de-4740-968d-c69bc6bfc971-kube-api-access-9cbr6" (OuterVolumeSpecName: "kube-api-access-9cbr6") pod "eb30bee8-67de-4740-968d-c69bc6bfc971" (UID: "eb30bee8-67de-4740-968d-c69bc6bfc971"). InnerVolumeSpecName "kube-api-access-9cbr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:33:20.565559 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:20.565521    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cbr6\" (UniqueName: \"kubernetes.io/projected/eb30bee8-67de-4740-968d-c69bc6bfc971-kube-api-access-9cbr6\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:33:21.076546 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.076500    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b8b5ccf88-vjdnc" event={"ID":"11650762-3497-491e-8eee-fbed6a8c885e","Type":"ContainerStarted","Data":"42ee2aaf0f3028f4cc0d7b996d9e5916eacb415b252d87066e9d980d0dab0c80"}
Jul 17 17:33:21.077001 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.076563    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b8b5ccf88-vjdnc" podUID="11650762-3497-491e-8eee-fbed6a8c885e" containerName="authorino" containerID="cri-o://42ee2aaf0f3028f4cc0d7b996d9e5916eacb415b252d87066e9d980d0dab0c80" gracePeriod=30
Jul 17 17:33:21.077687 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.077661    2576 generic.go:356] "Generic (PLEG): container finished" podID="eb30bee8-67de-4740-968d-c69bc6bfc971" containerID="5e08f98f081eaf8bef6cd1822246094a4f8e9cb3101fde5930c2e2f4c18b6992" exitCode=0
Jul 17 17:33:21.077799 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.077692    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-nfmb9" event={"ID":"eb30bee8-67de-4740-968d-c69bc6bfc971","Type":"ContainerDied","Data":"5e08f98f081eaf8bef6cd1822246094a4f8e9cb3101fde5930c2e2f4c18b6992"}
Jul 17 17:33:21.077799 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.077728    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-nfmb9" event={"ID":"eb30bee8-67de-4740-968d-c69bc6bfc971","Type":"ContainerDied","Data":"1478c7e1685fb4ba75aa07b168ddefea7fe49ca5d554d093c385471504959007"}
Jul 17 17:33:21.077799 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.077728    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nfmb9"
Jul 17 17:33:21.077799 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.077745    2576 scope.go:117] "RemoveContainer" containerID="5e08f98f081eaf8bef6cd1822246094a4f8e9cb3101fde5930c2e2f4c18b6992"
Jul 17 17:33:21.079585 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.079494    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-799f9775bd-mk8vd" event={"ID":"459c4a0a-4a5f-4ca5-8a96-60eee2e94f52","Type":"ContainerStarted","Data":"67597953ed22c78f6fee8193df78701f2306d964249277be2c5663bc4e71de24"}
Jul 17 17:33:21.079585 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.079534    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-799f9775bd-mk8vd" event={"ID":"459c4a0a-4a5f-4ca5-8a96-60eee2e94f52","Type":"ContainerStarted","Data":"29307ff3ce63988377ebc7762bd7dab1b1309239c4f234a17460e1d4684d6944"}
Jul 17 17:33:21.087546 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.087523    2576 scope.go:117] "RemoveContainer" containerID="5e08f98f081eaf8bef6cd1822246094a4f8e9cb3101fde5930c2e2f4c18b6992"
Jul 17 17:33:21.087870 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:33:21.087846    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e08f98f081eaf8bef6cd1822246094a4f8e9cb3101fde5930c2e2f4c18b6992\": container with ID starting with 5e08f98f081eaf8bef6cd1822246094a4f8e9cb3101fde5930c2e2f4c18b6992 not found: ID does not exist" containerID="5e08f98f081eaf8bef6cd1822246094a4f8e9cb3101fde5930c2e2f4c18b6992"
Jul 17 17:33:21.087931 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.087882    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e08f98f081eaf8bef6cd1822246094a4f8e9cb3101fde5930c2e2f4c18b6992"} err="failed to get container status \"5e08f98f081eaf8bef6cd1822246094a4f8e9cb3101fde5930c2e2f4c18b6992\": rpc error: code = NotFound desc = could not find container \"5e08f98f081eaf8bef6cd1822246094a4f8e9cb3101fde5930c2e2f4c18b6992\": container with ID starting with 5e08f98f081eaf8bef6cd1822246094a4f8e9cb3101fde5930c2e2f4c18b6992 not found: ID does not exist"
Jul 17 17:33:21.119153 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.119101    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b8b5ccf88-vjdnc" podStartSLOduration=1.509270954 podStartE2EDuration="2.119084309s" totalImagesPullingTime="609.813355ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:33:21.117697438 +0000 UTC m=+551.136474036" watchObservedRunningTime="2026-07-17 17:33:21.119084309 +0000 UTC m=+551.137860903"
Jul 17 17:33:21.153176 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.153120    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nfmb9"]
Jul 17 17:33:21.164094 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.164017    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nfmb9"]
Jul 17 17:33:21.185716 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.185665    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-799f9775bd-mk8vd" podStartSLOduration=1.452479194 podStartE2EDuration="2.18565055s" totalImagesPullingTime="733.171356ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:33:21.185144701 +0000 UTC m=+551.203921299" watchObservedRunningTime="2026-07-17 17:33:21.18565055 +0000 UTC m=+551.204427149"
Jul 17 17:33:21.238883 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.238840    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dspcw"]
Jul 17 17:33:21.239092 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.239065    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-dspcw" podUID="d2afd0ce-eae2-4ec2-bb71-4d9119af037b" containerName="authorino" containerID="cri-o://788bd81683fd7ba8681bd9829e26f1fc5b30be9f91e14b6712dc8aa9795fe2c1" gracePeriod=30
Jul 17 17:33:21.388811 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.388779    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b8b5ccf88-vjdnc"
Jul 17 17:33:21.474653 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.474604    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l52gt\" (UniqueName: \"kubernetes.io/projected/11650762-3497-491e-8eee-fbed6a8c885e-kube-api-access-l52gt\") pod \"11650762-3497-491e-8eee-fbed6a8c885e\" (UID: \"11650762-3497-491e-8eee-fbed6a8c885e\") "
Jul 17 17:33:21.476749 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.476715    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11650762-3497-491e-8eee-fbed6a8c885e-kube-api-access-l52gt" (OuterVolumeSpecName: "kube-api-access-l52gt") pod "11650762-3497-491e-8eee-fbed6a8c885e" (UID: "11650762-3497-491e-8eee-fbed6a8c885e"). InnerVolumeSpecName "kube-api-access-l52gt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:33:21.539013 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.538978    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dspcw"
Jul 17 17:33:21.576453 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.576320    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l52gt\" (UniqueName: \"kubernetes.io/projected/11650762-3497-491e-8eee-fbed6a8c885e-kube-api-access-l52gt\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:33:21.676950 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.676912    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zqz5\" (UniqueName: \"kubernetes.io/projected/d2afd0ce-eae2-4ec2-bb71-4d9119af037b-kube-api-access-8zqz5\") pod \"d2afd0ce-eae2-4ec2-bb71-4d9119af037b\" (UID: \"d2afd0ce-eae2-4ec2-bb71-4d9119af037b\") "
Jul 17 17:33:21.678972 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.678942    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2afd0ce-eae2-4ec2-bb71-4d9119af037b-kube-api-access-8zqz5" (OuterVolumeSpecName: "kube-api-access-8zqz5") pod "d2afd0ce-eae2-4ec2-bb71-4d9119af037b" (UID: "d2afd0ce-eae2-4ec2-bb71-4d9119af037b"). InnerVolumeSpecName "kube-api-access-8zqz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:33:21.777753 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:21.777709    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zqz5\" (UniqueName: \"kubernetes.io/projected/d2afd0ce-eae2-4ec2-bb71-4d9119af037b-kube-api-access-8zqz5\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:33:22.087628 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:22.087539    2576 generic.go:356] "Generic (PLEG): container finished" podID="11650762-3497-491e-8eee-fbed6a8c885e" containerID="42ee2aaf0f3028f4cc0d7b996d9e5916eacb415b252d87066e9d980d0dab0c80" exitCode=0
Jul 17 17:33:22.087628 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:22.087591    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b8b5ccf88-vjdnc"
Jul 17 17:33:22.087628 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:22.087616    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b8b5ccf88-vjdnc" event={"ID":"11650762-3497-491e-8eee-fbed6a8c885e","Type":"ContainerDied","Data":"42ee2aaf0f3028f4cc0d7b996d9e5916eacb415b252d87066e9d980d0dab0c80"}
Jul 17 17:33:22.088127 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:22.087654    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b8b5ccf88-vjdnc" event={"ID":"11650762-3497-491e-8eee-fbed6a8c885e","Type":"ContainerDied","Data":"17dd4d0bbb44a0c86c79e309402bb79169ff1cd3cd8b6fb1097049ecbaefe978"}
Jul 17 17:33:22.088127 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:22.087671    2576 scope.go:117] "RemoveContainer" containerID="42ee2aaf0f3028f4cc0d7b996d9e5916eacb415b252d87066e9d980d0dab0c80"
Jul 17 17:33:22.089938 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:22.089912    2576 generic.go:356] "Generic (PLEG): container finished" podID="d2afd0ce-eae2-4ec2-bb71-4d9119af037b" containerID="788bd81683fd7ba8681bd9829e26f1fc5b30be9f91e14b6712dc8aa9795fe2c1" exitCode=0
Jul 17 17:33:22.090090 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:22.089963    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dspcw"
Jul 17 17:33:22.090090 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:22.089994    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dspcw" event={"ID":"d2afd0ce-eae2-4ec2-bb71-4d9119af037b","Type":"ContainerDied","Data":"788bd81683fd7ba8681bd9829e26f1fc5b30be9f91e14b6712dc8aa9795fe2c1"}
Jul 17 17:33:22.090090 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:22.090039    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dspcw" event={"ID":"d2afd0ce-eae2-4ec2-bb71-4d9119af037b","Type":"ContainerDied","Data":"6c39d2107f22502dbfbc15a118994671eb954f133c6ab41a565689733e9e2013"}
Jul 17 17:33:22.097541 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:22.097517    2576 scope.go:117] "RemoveContainer" containerID="42ee2aaf0f3028f4cc0d7b996d9e5916eacb415b252d87066e9d980d0dab0c80"
Jul 17 17:33:22.097944 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:33:22.097913    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42ee2aaf0f3028f4cc0d7b996d9e5916eacb415b252d87066e9d980d0dab0c80\": container with ID starting with 42ee2aaf0f3028f4cc0d7b996d9e5916eacb415b252d87066e9d980d0dab0c80 not found: ID does not exist" containerID="42ee2aaf0f3028f4cc0d7b996d9e5916eacb415b252d87066e9d980d0dab0c80"
Jul 17 17:33:22.098010 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:22.097951    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42ee2aaf0f3028f4cc0d7b996d9e5916eacb415b252d87066e9d980d0dab0c80"} err="failed to get container status \"42ee2aaf0f3028f4cc0d7b996d9e5916eacb415b252d87066e9d980d0dab0c80\": rpc error: code = NotFound desc = could not find container \"42ee2aaf0f3028f4cc0d7b996d9e5916eacb415b252d87066e9d980d0dab0c80\": container with ID starting with 42ee2aaf0f3028f4cc0d7b996d9e5916eacb415b252d87066e9d980d0dab0c80 not found: ID does not exist"
Jul 17 17:33:22.098010 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:22.097976    2576 scope.go:117] "RemoveContainer" containerID="788bd81683fd7ba8681bd9829e26f1fc5b30be9f91e14b6712dc8aa9795fe2c1"
Jul 17 17:33:22.106839 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:22.106816    2576 scope.go:117] "RemoveContainer" containerID="788bd81683fd7ba8681bd9829e26f1fc5b30be9f91e14b6712dc8aa9795fe2c1"
Jul 17 17:33:22.107196 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:33:22.107154    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"788bd81683fd7ba8681bd9829e26f1fc5b30be9f91e14b6712dc8aa9795fe2c1\": container with ID starting with 788bd81683fd7ba8681bd9829e26f1fc5b30be9f91e14b6712dc8aa9795fe2c1 not found: ID does not exist" containerID="788bd81683fd7ba8681bd9829e26f1fc5b30be9f91e14b6712dc8aa9795fe2c1"
Jul 17 17:33:22.107254 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:22.107209    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"788bd81683fd7ba8681bd9829e26f1fc5b30be9f91e14b6712dc8aa9795fe2c1"} err="failed to get container status \"788bd81683fd7ba8681bd9829e26f1fc5b30be9f91e14b6712dc8aa9795fe2c1\": rpc error: code = NotFound desc = could not find container \"788bd81683fd7ba8681bd9829e26f1fc5b30be9f91e14b6712dc8aa9795fe2c1\": container with ID starting with 788bd81683fd7ba8681bd9829e26f1fc5b30be9f91e14b6712dc8aa9795fe2c1 not found: ID does not exist"
Jul 17 17:33:22.133601 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:22.133560    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dspcw"]
Jul 17 17:33:22.143018 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:22.142979    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dspcw"]
Jul 17 17:33:22.158985 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:22.158951    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b8b5ccf88-vjdnc"]
Jul 17 17:33:22.163556 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:22.163524    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b8b5ccf88-vjdnc"]
Jul 17 17:33:22.521920 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:22.521882    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11650762-3497-491e-8eee-fbed6a8c885e" path="/var/lib/kubelet/pods/11650762-3497-491e-8eee-fbed6a8c885e/volumes"
Jul 17 17:33:22.522231 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:22.522217    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2afd0ce-eae2-4ec2-bb71-4d9119af037b" path="/var/lib/kubelet/pods/d2afd0ce-eae2-4ec2-bb71-4d9119af037b/volumes"
Jul 17 17:33:22.522501 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:22.522489    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb30bee8-67de-4740-968d-c69bc6bfc971" path="/var/lib/kubelet/pods/eb30bee8-67de-4740-968d-c69bc6bfc971/volumes"
Jul 17 17:33:26.546453 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.546415    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54f8d57c9d-cwc94"]
Jul 17 17:33:26.546833 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.546743    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2afd0ce-eae2-4ec2-bb71-4d9119af037b" containerName="authorino"
Jul 17 17:33:26.546833 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.546753    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2afd0ce-eae2-4ec2-bb71-4d9119af037b" containerName="authorino"
Jul 17 17:33:26.546833 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.546768    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11650762-3497-491e-8eee-fbed6a8c885e" containerName="authorino"
Jul 17 17:33:26.546833 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.546774    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="11650762-3497-491e-8eee-fbed6a8c885e" containerName="authorino"
Jul 17 17:33:26.546833 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.546781    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb30bee8-67de-4740-968d-c69bc6bfc971" containerName="authorino"
Jul 17 17:33:26.546833 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.546786    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb30bee8-67de-4740-968d-c69bc6bfc971" containerName="authorino"
Jul 17 17:33:26.547011 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.546837    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2afd0ce-eae2-4ec2-bb71-4d9119af037b" containerName="authorino"
Jul 17 17:33:26.547011 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.546845    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="11650762-3497-491e-8eee-fbed6a8c885e" containerName="authorino"
Jul 17 17:33:26.547011 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.546853    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb30bee8-67de-4740-968d-c69bc6bfc971" containerName="authorino"
Jul 17 17:33:26.549654 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.549635    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54f8d57c9d-cwc94"
Jul 17 17:33:26.553728 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.553705    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vx4rq\""
Jul 17 17:33:26.553853 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.553705    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 17:33:26.553853 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.553747    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 17:33:26.589777 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.589740    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54f8d57c9d-cwc94"]
Jul 17 17:33:26.720677 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.720637    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmk24\" (UniqueName: \"kubernetes.io/projected/f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50-kube-api-access-xmk24\") pod \"maas-controller-54f8d57c9d-cwc94\" (UID: \"f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50\") " pod="opendatahub/maas-controller-54f8d57c9d-cwc94"
Jul 17 17:33:26.720847 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.720693    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50-webhook-cert\") pod \"maas-controller-54f8d57c9d-cwc94\" (UID: \"f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50\") " pod="opendatahub/maas-controller-54f8d57c9d-cwc94"
Jul 17 17:33:26.821918 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.821826    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmk24\" (UniqueName: \"kubernetes.io/projected/f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50-kube-api-access-xmk24\") pod \"maas-controller-54f8d57c9d-cwc94\" (UID: \"f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50\") " pod="opendatahub/maas-controller-54f8d57c9d-cwc94"
Jul 17 17:33:26.821918 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.821879    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50-webhook-cert\") pod \"maas-controller-54f8d57c9d-cwc94\" (UID: \"f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50\") " pod="opendatahub/maas-controller-54f8d57c9d-cwc94"
Jul 17 17:33:26.824266 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.824242    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50-webhook-cert\") pod \"maas-controller-54f8d57c9d-cwc94\" (UID: \"f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50\") " pod="opendatahub/maas-controller-54f8d57c9d-cwc94"
Jul 17 17:33:26.832504 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.832480    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmk24\" (UniqueName: \"kubernetes.io/projected/f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50-kube-api-access-xmk24\") pod \"maas-controller-54f8d57c9d-cwc94\" (UID: \"f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50\") " pod="opendatahub/maas-controller-54f8d57c9d-cwc94"
Jul 17 17:33:26.860351 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.860317    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54f8d57c9d-cwc94"
Jul 17 17:33:26.997910 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:26.997884    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54f8d57c9d-cwc94"]
Jul 17 17:33:26.999625 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:33:26.999597    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c9dfdc_3ef8_486d_9d33_5241cd1b7d50.slice/crio-3aadd3f3679d30ca361c37cf311039916d758655683bad6b49421b9c7cc336f4 WatchSource:0}: Error finding container 3aadd3f3679d30ca361c37cf311039916d758655683bad6b49421b9c7cc336f4: Status 404 returned error can't find the container with id 3aadd3f3679d30ca361c37cf311039916d758655683bad6b49421b9c7cc336f4
Jul 17 17:33:27.114517 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:27.114427    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54f8d57c9d-cwc94" event={"ID":"f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50","Type":"ContainerStarted","Data":"3aadd3f3679d30ca361c37cf311039916d758655683bad6b49421b9c7cc336f4"}
Jul 17 17:33:30.131405 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:30.131360    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54f8d57c9d-cwc94" event={"ID":"f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50","Type":"ContainerStarted","Data":"ad4c80c113202e2cbcbf89ad06ef96a321a71de9253c2e189fc877ef4c3f9559"}
Jul 17 17:33:30.131778 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:30.131459    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54f8d57c9d-cwc94"
Jul 17 17:33:30.177092 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:30.177034    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54f8d57c9d-cwc94" podStartSLOduration=1.7875723589999999 podStartE2EDuration="4.177017097s" totalImagesPullingTime="2.389444738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:33:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:33:30.175112824 +0000 UTC m=+560.193889424" watchObservedRunningTime="2026-07-17 17:33:30.177017097 +0000 UTC m=+560.195793695"
Jul 17 17:33:41.138888 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:33:41.138855    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54f8d57c9d-cwc94"
Jul 17 17:34:03.293207 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:03.293173    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:34:25.801975 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:25.801929    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:34:49.409672 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.409630    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"]
Jul 17 17:34:49.411901 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.411884    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:34:49.414881 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.414864    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 17 17:34:49.416093 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.416075    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 17 17:34:49.416231 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.416125    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 17 17:34:49.416231 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.416186    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wsgb4\""
Jul 17 17:34:49.424414 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.424387    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"]
Jul 17 17:34:49.524827 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.524790    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b37e3613-8f48-43b7-b644-43d45f349c55-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vhmb\" (UID: \"b37e3613-8f48-43b7-b644-43d45f349c55\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:34:49.525027 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.524848    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b37e3613-8f48-43b7-b644-43d45f349c55-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vhmb\" (UID: \"b37e3613-8f48-43b7-b644-43d45f349c55\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:34:49.525027 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.524918    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b37e3613-8f48-43b7-b644-43d45f349c55-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vhmb\" (UID: \"b37e3613-8f48-43b7-b644-43d45f349c55\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:34:49.525027 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.525004    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b37e3613-8f48-43b7-b644-43d45f349c55-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vhmb\" (UID: \"b37e3613-8f48-43b7-b644-43d45f349c55\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:34:49.525212 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.525040    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b37e3613-8f48-43b7-b644-43d45f349c55-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vhmb\" (UID: \"b37e3613-8f48-43b7-b644-43d45f349c55\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:34:49.525212 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.525069    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhnw8\" (UniqueName: \"kubernetes.io/projected/b37e3613-8f48-43b7-b644-43d45f349c55-kube-api-access-rhnw8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vhmb\" (UID: \"b37e3613-8f48-43b7-b644-43d45f349c55\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:34:49.626255 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.626209    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b37e3613-8f48-43b7-b644-43d45f349c55-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vhmb\" (UID: \"b37e3613-8f48-43b7-b644-43d45f349c55\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:34:49.626450 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.626266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b37e3613-8f48-43b7-b644-43d45f349c55-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vhmb\" (UID: \"b37e3613-8f48-43b7-b644-43d45f349c55\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:34:49.626450 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.626335    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b37e3613-8f48-43b7-b644-43d45f349c55-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vhmb\" (UID: \"b37e3613-8f48-43b7-b644-43d45f349c55\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:34:49.626450 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.626362    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b37e3613-8f48-43b7-b644-43d45f349c55-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vhmb\" (UID: \"b37e3613-8f48-43b7-b644-43d45f349c55\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:34:49.626638 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.626482    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhnw8\" (UniqueName: \"kubernetes.io/projected/b37e3613-8f48-43b7-b644-43d45f349c55-kube-api-access-rhnw8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vhmb\" (UID: \"b37e3613-8f48-43b7-b644-43d45f349c55\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:34:49.626638 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.626531    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b37e3613-8f48-43b7-b644-43d45f349c55-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vhmb\" (UID: \"b37e3613-8f48-43b7-b644-43d45f349c55\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:34:49.626818 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.626790    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b37e3613-8f48-43b7-b644-43d45f349c55-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vhmb\" (UID: \"b37e3613-8f48-43b7-b644-43d45f349c55\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:34:49.626949 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.626822    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b37e3613-8f48-43b7-b644-43d45f349c55-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vhmb\" (UID: \"b37e3613-8f48-43b7-b644-43d45f349c55\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:34:49.626949 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.626864    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b37e3613-8f48-43b7-b644-43d45f349c55-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vhmb\" (UID: \"b37e3613-8f48-43b7-b644-43d45f349c55\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:34:49.628754 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.628721    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b37e3613-8f48-43b7-b644-43d45f349c55-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vhmb\" (UID: \"b37e3613-8f48-43b7-b644-43d45f349c55\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:34:49.628868 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.628850    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b37e3613-8f48-43b7-b644-43d45f349c55-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vhmb\" (UID: \"b37e3613-8f48-43b7-b644-43d45f349c55\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:34:49.635662 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.635608    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhnw8\" (UniqueName: \"kubernetes.io/projected/b37e3613-8f48-43b7-b644-43d45f349c55-kube-api-access-rhnw8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-6vhmb\" (UID: \"b37e3613-8f48-43b7-b644-43d45f349c55\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:34:49.722253 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.722212    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:34:49.854010 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.853983    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"]
Jul 17 17:34:49.855587 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:34:49.855554    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb37e3613_8f48_43b7_b644_43d45f349c55.slice/crio-39af1947c2b3ddac6e8b12802357dbb52e8738efa1718f90cf33093b11a49c44 WatchSource:0}: Error finding container 39af1947c2b3ddac6e8b12802357dbb52e8738efa1718f90cf33093b11a49c44: Status 404 returned error can't find the container with id 39af1947c2b3ddac6e8b12802357dbb52e8738efa1718f90cf33093b11a49c44
Jul 17 17:34:49.856990 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:49.856971    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 17:34:50.283880 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:50.283846    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:34:50.503719 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:50.503642    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb" event={"ID":"b37e3613-8f48-43b7-b644-43d45f349c55","Type":"ContainerStarted","Data":"39af1947c2b3ddac6e8b12802357dbb52e8738efa1718f90cf33093b11a49c44"}
Jul 17 17:34:51.509466 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:51.509427    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb" event={"ID":"b37e3613-8f48-43b7-b644-43d45f349c55","Type":"ContainerStarted","Data":"25ff81ba20575e7b202557016fd45ddc75366911fa55f2939a9de05d6dc52802"}
Jul 17 17:34:51.529738 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:51.529657    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb" podStartSLOduration=1.471820674 podStartE2EDuration="2.529639452s" totalImagesPullingTime="1.057818778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:34:51.528797911 +0000 UTC m=+641.547574509" watchObservedRunningTime="2026-07-17 17:34:51.529639452 +0000 UTC m=+641.548416087"
Jul 17 17:34:59.723060 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:59.723007    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:34:59.723596 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:59.723073    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:34:59.736979 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:34:59.736950    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:35:00.560802 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.560763    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-6vhmb"
Jul 17 17:35:00.716445 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.716411    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"]
Jul 17 17:35:00.718713 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.718694    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:00.722736 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.722711    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 17 17:35:00.736957 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.736924    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"]
Jul 17 17:35:00.825419 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.825321    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cdb3f67-8dc6-4709-a4df-51fe084164a1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mmc\" (UID: \"3cdb3f67-8dc6-4709-a4df-51fe084164a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:00.825419 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.825372    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cdb3f67-8dc6-4709-a4df-51fe084164a1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mmc\" (UID: \"3cdb3f67-8dc6-4709-a4df-51fe084164a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:00.825612 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.825464    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cdb3f67-8dc6-4709-a4df-51fe084164a1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mmc\" (UID: \"3cdb3f67-8dc6-4709-a4df-51fe084164a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:00.825612 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.825499    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsbct\" (UniqueName: \"kubernetes.io/projected/3cdb3f67-8dc6-4709-a4df-51fe084164a1-kube-api-access-xsbct\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mmc\" (UID: \"3cdb3f67-8dc6-4709-a4df-51fe084164a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:00.825612 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.825576    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cdb3f67-8dc6-4709-a4df-51fe084164a1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mmc\" (UID: \"3cdb3f67-8dc6-4709-a4df-51fe084164a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:00.825711 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.825619    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cdb3f67-8dc6-4709-a4df-51fe084164a1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mmc\" (UID: \"3cdb3f67-8dc6-4709-a4df-51fe084164a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:00.927053 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.927016    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cdb3f67-8dc6-4709-a4df-51fe084164a1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mmc\" (UID: \"3cdb3f67-8dc6-4709-a4df-51fe084164a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:00.927247 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.927069    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cdb3f67-8dc6-4709-a4df-51fe084164a1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mmc\" (UID: \"3cdb3f67-8dc6-4709-a4df-51fe084164a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:00.927247 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.927093    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cdb3f67-8dc6-4709-a4df-51fe084164a1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mmc\" (UID: \"3cdb3f67-8dc6-4709-a4df-51fe084164a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:00.927247 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.927114    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cdb3f67-8dc6-4709-a4df-51fe084164a1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mmc\" (UID: \"3cdb3f67-8dc6-4709-a4df-51fe084164a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:00.927247 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.927144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cdb3f67-8dc6-4709-a4df-51fe084164a1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mmc\" (UID: \"3cdb3f67-8dc6-4709-a4df-51fe084164a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:00.927247 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.927181    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsbct\" (UniqueName: \"kubernetes.io/projected/3cdb3f67-8dc6-4709-a4df-51fe084164a1-kube-api-access-xsbct\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mmc\" (UID: \"3cdb3f67-8dc6-4709-a4df-51fe084164a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:00.927517 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.927440    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cdb3f67-8dc6-4709-a4df-51fe084164a1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mmc\" (UID: \"3cdb3f67-8dc6-4709-a4df-51fe084164a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:00.927575 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.927517    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3cdb3f67-8dc6-4709-a4df-51fe084164a1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mmc\" (UID: \"3cdb3f67-8dc6-4709-a4df-51fe084164a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:00.927616 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.927589    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3cdb3f67-8dc6-4709-a4df-51fe084164a1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mmc\" (UID: \"3cdb3f67-8dc6-4709-a4df-51fe084164a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:00.929460 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.929438    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3cdb3f67-8dc6-4709-a4df-51fe084164a1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mmc\" (UID: \"3cdb3f67-8dc6-4709-a4df-51fe084164a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:00.929839 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.929810    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3cdb3f67-8dc6-4709-a4df-51fe084164a1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mmc\" (UID: \"3cdb3f67-8dc6-4709-a4df-51fe084164a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:00.936613 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:00.936577    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsbct\" (UniqueName: \"kubernetes.io/projected/3cdb3f67-8dc6-4709-a4df-51fe084164a1-kube-api-access-xsbct\") pod \"e2e-trlp-test-simulated-kserve-598466548d-44mmc\" (UID: \"3cdb3f67-8dc6-4709-a4df-51fe084164a1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:01.028727 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:01.028682    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:01.166432 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:01.166406    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"]
Jul 17 17:35:01.168965 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:35:01.168928    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cdb3f67_8dc6_4709_a4df_51fe084164a1.slice/crio-0a61b9042894517ef48e39c098c3ebcfbec8e520f4c8614feaf37ebae8590d3a WatchSource:0}: Error finding container 0a61b9042894517ef48e39c098c3ebcfbec8e520f4c8614feaf37ebae8590d3a: Status 404 returned error can't find the container with id 0a61b9042894517ef48e39c098c3ebcfbec8e520f4c8614feaf37ebae8590d3a
Jul 17 17:35:01.555418 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:01.555380    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc" event={"ID":"3cdb3f67-8dc6-4709-a4df-51fe084164a1","Type":"ContainerStarted","Data":"280044d8b8df12776a5014be3909fa739a086c44840e61daff4911f6bdb788ae"}
Jul 17 17:35:01.555589 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:01.555438    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc" event={"ID":"3cdb3f67-8dc6-4709-a4df-51fe084164a1","Type":"ContainerStarted","Data":"0a61b9042894517ef48e39c098c3ebcfbec8e520f4c8614feaf37ebae8590d3a"}
Jul 17 17:35:01.576370 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:01.576311    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc" podStartSLOduration=1.381828187 podStartE2EDuration="1.576296076s" totalImagesPullingTime="194.467889ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:35:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:35:01.575663634 +0000 UTC m=+651.594440232" watchObservedRunningTime="2026-07-17 17:35:01.576296076 +0000 UTC m=+651.595072674"
Jul 17 17:35:01.988915 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:01.988880    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:35:08.591657 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.591623    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"]
Jul 17 17:35:08.594048 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.594025    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:08.596814 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.596791    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 17 17:35:08.604791 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.604764    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"]
Jul 17 17:35:08.697411 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.697367    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90db9070-4e87-4fb7-bd26-8701e41abc3b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96\" (UID: \"90db9070-4e87-4fb7-bd26-8701e41abc3b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:08.697592 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.697462    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k4bd\" (UniqueName: \"kubernetes.io/projected/90db9070-4e87-4fb7-bd26-8701e41abc3b-kube-api-access-6k4bd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96\" (UID: \"90db9070-4e87-4fb7-bd26-8701e41abc3b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:08.697592 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.697507    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90db9070-4e87-4fb7-bd26-8701e41abc3b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96\" (UID: \"90db9070-4e87-4fb7-bd26-8701e41abc3b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:08.697592 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.697582    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90db9070-4e87-4fb7-bd26-8701e41abc3b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96\" (UID: \"90db9070-4e87-4fb7-bd26-8701e41abc3b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:08.697728 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.697600    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90db9070-4e87-4fb7-bd26-8701e41abc3b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96\" (UID: \"90db9070-4e87-4fb7-bd26-8701e41abc3b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:08.697728 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.697637    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90db9070-4e87-4fb7-bd26-8701e41abc3b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96\" (UID: \"90db9070-4e87-4fb7-bd26-8701e41abc3b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:08.798980 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.798932    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90db9070-4e87-4fb7-bd26-8701e41abc3b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96\" (UID: \"90db9070-4e87-4fb7-bd26-8701e41abc3b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:08.798980 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.798979    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k4bd\" (UniqueName: \"kubernetes.io/projected/90db9070-4e87-4fb7-bd26-8701e41abc3b-kube-api-access-6k4bd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96\" (UID: \"90db9070-4e87-4fb7-bd26-8701e41abc3b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:08.799261 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.799010    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90db9070-4e87-4fb7-bd26-8701e41abc3b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96\" (UID: \"90db9070-4e87-4fb7-bd26-8701e41abc3b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:08.799261 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.799057    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90db9070-4e87-4fb7-bd26-8701e41abc3b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96\" (UID: \"90db9070-4e87-4fb7-bd26-8701e41abc3b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:08.799261 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.799072    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90db9070-4e87-4fb7-bd26-8701e41abc3b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96\" (UID: \"90db9070-4e87-4fb7-bd26-8701e41abc3b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:08.799261 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.799107    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90db9070-4e87-4fb7-bd26-8701e41abc3b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96\" (UID: \"90db9070-4e87-4fb7-bd26-8701e41abc3b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:08.799479 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.799458    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90db9070-4e87-4fb7-bd26-8701e41abc3b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96\" (UID: \"90db9070-4e87-4fb7-bd26-8701e41abc3b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:08.799548 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.799500    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90db9070-4e87-4fb7-bd26-8701e41abc3b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96\" (UID: \"90db9070-4e87-4fb7-bd26-8701e41abc3b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:08.799599 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.799541    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90db9070-4e87-4fb7-bd26-8701e41abc3b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96\" (UID: \"90db9070-4e87-4fb7-bd26-8701e41abc3b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:08.801818 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.801798    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90db9070-4e87-4fb7-bd26-8701e41abc3b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96\" (UID: \"90db9070-4e87-4fb7-bd26-8701e41abc3b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:08.802083 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.802065    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90db9070-4e87-4fb7-bd26-8701e41abc3b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96\" (UID: \"90db9070-4e87-4fb7-bd26-8701e41abc3b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:08.807408 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.807380    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k4bd\" (UniqueName: \"kubernetes.io/projected/90db9070-4e87-4fb7-bd26-8701e41abc3b-kube-api-access-6k4bd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96\" (UID: \"90db9070-4e87-4fb7-bd26-8701e41abc3b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:08.905834 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:08.905748    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:09.039324 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:09.039289    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"]
Jul 17 17:35:09.039479 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:35:09.039457    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90db9070_4e87_4fb7_bd26_8701e41abc3b.slice/crio-8622b9ab6365f3bef9445fbc741c769486ec5fbe63e7cdc58f39735b97880ad8 WatchSource:0}: Error finding container 8622b9ab6365f3bef9445fbc741c769486ec5fbe63e7cdc58f39735b97880ad8: Status 404 returned error can't find the container with id 8622b9ab6365f3bef9445fbc741c769486ec5fbe63e7cdc58f39735b97880ad8
Jul 17 17:35:09.592725 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:09.592637    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96" event={"ID":"90db9070-4e87-4fb7-bd26-8701e41abc3b","Type":"ContainerStarted","Data":"d8c67f59659e542456ac3d88b1e843b0ea272c380e1a4fcd18094146728ceec7"}
Jul 17 17:35:09.592725 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:09.592689    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96" event={"ID":"90db9070-4e87-4fb7-bd26-8701e41abc3b","Type":"ContainerStarted","Data":"8622b9ab6365f3bef9445fbc741c769486ec5fbe63e7cdc58f39735b97880ad8"}
Jul 17 17:35:09.615071 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:09.615014    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96" podStartSLOduration=1.445769338 podStartE2EDuration="1.614997608s" totalImagesPullingTime="169.22827ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:35:09.613015175 +0000 UTC m=+659.631791779" watchObservedRunningTime="2026-07-17 17:35:09.614997608 +0000 UTC m=+659.633774206"
Jul 17 17:35:10.393678 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:10.393578    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:35:11.028984 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:11.028941    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:11.029414 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:11.029004    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:11.045509 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:11.045473    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:11.614564 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:11.614533    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-44mmc"
Jul 17 17:35:16.199182 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.199136    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"]
Jul 17 17:35:16.204770 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.204746    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:16.207515 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.207488    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 17 17:35:16.216155 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.216125    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"]
Jul 17 17:35:16.368037 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.367999    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27357e2d-7fc9-4f6d-a1b9-a8ba5929368d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rk6ld\" (UID: \"27357e2d-7fc9-4f6d-a1b9-a8ba5929368d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:16.368037 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.368041    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27357e2d-7fc9-4f6d-a1b9-a8ba5929368d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rk6ld\" (UID: \"27357e2d-7fc9-4f6d-a1b9-a8ba5929368d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:16.368275 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.368060    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7l49\" (UniqueName: \"kubernetes.io/projected/27357e2d-7fc9-4f6d-a1b9-a8ba5929368d-kube-api-access-f7l49\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rk6ld\" (UID: \"27357e2d-7fc9-4f6d-a1b9-a8ba5929368d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:16.368275 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.368151    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27357e2d-7fc9-4f6d-a1b9-a8ba5929368d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rk6ld\" (UID: \"27357e2d-7fc9-4f6d-a1b9-a8ba5929368d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:16.368275 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.368219    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27357e2d-7fc9-4f6d-a1b9-a8ba5929368d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rk6ld\" (UID: \"27357e2d-7fc9-4f6d-a1b9-a8ba5929368d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:16.368382 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.368291    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27357e2d-7fc9-4f6d-a1b9-a8ba5929368d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rk6ld\" (UID: \"27357e2d-7fc9-4f6d-a1b9-a8ba5929368d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:16.468673 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.468638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27357e2d-7fc9-4f6d-a1b9-a8ba5929368d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rk6ld\" (UID: \"27357e2d-7fc9-4f6d-a1b9-a8ba5929368d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:16.468673 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.468673    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27357e2d-7fc9-4f6d-a1b9-a8ba5929368d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rk6ld\" (UID: \"27357e2d-7fc9-4f6d-a1b9-a8ba5929368d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:16.468924 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.468695    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7l49\" (UniqueName: \"kubernetes.io/projected/27357e2d-7fc9-4f6d-a1b9-a8ba5929368d-kube-api-access-f7l49\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rk6ld\" (UID: \"27357e2d-7fc9-4f6d-a1b9-a8ba5929368d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:16.468924 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.468745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27357e2d-7fc9-4f6d-a1b9-a8ba5929368d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rk6ld\" (UID: \"27357e2d-7fc9-4f6d-a1b9-a8ba5929368d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:16.468924 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.468776    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27357e2d-7fc9-4f6d-a1b9-a8ba5929368d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rk6ld\" (UID: \"27357e2d-7fc9-4f6d-a1b9-a8ba5929368d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:16.468924 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.468840    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27357e2d-7fc9-4f6d-a1b9-a8ba5929368d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rk6ld\" (UID: \"27357e2d-7fc9-4f6d-a1b9-a8ba5929368d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:16.469202 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.469159    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27357e2d-7fc9-4f6d-a1b9-a8ba5929368d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rk6ld\" (UID: \"27357e2d-7fc9-4f6d-a1b9-a8ba5929368d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:16.469296 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.469201    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27357e2d-7fc9-4f6d-a1b9-a8ba5929368d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rk6ld\" (UID: \"27357e2d-7fc9-4f6d-a1b9-a8ba5929368d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:16.469379 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.469298    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27357e2d-7fc9-4f6d-a1b9-a8ba5929368d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rk6ld\" (UID: \"27357e2d-7fc9-4f6d-a1b9-a8ba5929368d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:16.471561 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.471533    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27357e2d-7fc9-4f6d-a1b9-a8ba5929368d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rk6ld\" (UID: \"27357e2d-7fc9-4f6d-a1b9-a8ba5929368d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:16.471768 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.471751    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27357e2d-7fc9-4f6d-a1b9-a8ba5929368d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rk6ld\" (UID: \"27357e2d-7fc9-4f6d-a1b9-a8ba5929368d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:16.477896 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.477873    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7l49\" (UniqueName: \"kubernetes.io/projected/27357e2d-7fc9-4f6d-a1b9-a8ba5929368d-kube-api-access-f7l49\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rk6ld\" (UID: \"27357e2d-7fc9-4f6d-a1b9-a8ba5929368d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:16.516737 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.516701    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:16.654604 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:16.654581    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"]
Jul 17 17:35:16.656519 ip-10-0-143-187 kubenswrapper[2576]: W0717 17:35:16.656486    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27357e2d_7fc9_4f6d_a1b9_a8ba5929368d.slice/crio-0beea3089ad5dd2e9d80f88026abe6cea1c32f055b4fe7499adec4bb7b5c28ae WatchSource:0}: Error finding container 0beea3089ad5dd2e9d80f88026abe6cea1c32f055b4fe7499adec4bb7b5c28ae: Status 404 returned error can't find the container with id 0beea3089ad5dd2e9d80f88026abe6cea1c32f055b4fe7499adec4bb7b5c28ae
Jul 17 17:35:17.634150 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:17.634110    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld" event={"ID":"27357e2d-7fc9-4f6d-a1b9-a8ba5929368d","Type":"ContainerStarted","Data":"b8e2ff7821ae19783428bb20e0d6ec35625cf99bd9566c2ca8203692dc8fadb1"}
Jul 17 17:35:17.634549 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:17.634182    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld" event={"ID":"27357e2d-7fc9-4f6d-a1b9-a8ba5929368d","Type":"ContainerStarted","Data":"0beea3089ad5dd2e9d80f88026abe6cea1c32f055b4fe7499adec4bb7b5c28ae"}
Jul 17 17:35:17.652811 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:17.652758    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld" podStartSLOduration=1.463853671 podStartE2EDuration="1.652742916s" totalImagesPullingTime="188.889245ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:35:17.651349532 +0000 UTC m=+667.670126131" watchObservedRunningTime="2026-07-17 17:35:17.652742916 +0000 UTC m=+667.671519514"
Jul 17 17:35:18.793843 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:18.793810    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:35:18.906431 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:18.906392    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:18.906594 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:18.906465    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:18.919011 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:18.918981    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:19.655480 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:19.655444    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96"
Jul 17 17:35:26.522991 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:26.522957    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:26.523492 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:26.523022    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:26.529733 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:26.529708    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:26.688750 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:26.688717    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rk6ld"
Jul 17 17:35:34.844948 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:35:34.844913    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:36:55.559613 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:36:55.559579    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-799f9775bd-mk8vd"]
Jul 17 17:36:55.560147 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:36:55.559779    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-799f9775bd-mk8vd" podUID="459c4a0a-4a5f-4ca5-8a96-60eee2e94f52" containerName="authorino" containerID="cri-o://67597953ed22c78f6fee8193df78701f2306d964249277be2c5663bc4e71de24" gracePeriod=30
Jul 17 17:36:55.813747 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:36:55.813684    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-799f9775bd-mk8vd"
Jul 17 17:36:55.862003 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:36:55.861962    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-924f7\" (UniqueName: \"kubernetes.io/projected/459c4a0a-4a5f-4ca5-8a96-60eee2e94f52-kube-api-access-924f7\") pod \"459c4a0a-4a5f-4ca5-8a96-60eee2e94f52\" (UID: \"459c4a0a-4a5f-4ca5-8a96-60eee2e94f52\") "
Jul 17 17:36:55.862156 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:36:55.862070    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/459c4a0a-4a5f-4ca5-8a96-60eee2e94f52-tls-cert\") pod \"459c4a0a-4a5f-4ca5-8a96-60eee2e94f52\" (UID: \"459c4a0a-4a5f-4ca5-8a96-60eee2e94f52\") "
Jul 17 17:36:55.864005 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:36:55.863971    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/459c4a0a-4a5f-4ca5-8a96-60eee2e94f52-kube-api-access-924f7" (OuterVolumeSpecName: "kube-api-access-924f7") pod "459c4a0a-4a5f-4ca5-8a96-60eee2e94f52" (UID: "459c4a0a-4a5f-4ca5-8a96-60eee2e94f52"). InnerVolumeSpecName "kube-api-access-924f7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:36:55.872958 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:36:55.872926    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/459c4a0a-4a5f-4ca5-8a96-60eee2e94f52-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "459c4a0a-4a5f-4ca5-8a96-60eee2e94f52" (UID: "459c4a0a-4a5f-4ca5-8a96-60eee2e94f52"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 17:36:55.962786 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:36:55.962746    2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/459c4a0a-4a5f-4ca5-8a96-60eee2e94f52-tls-cert\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:36:55.962786 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:36:55.962777    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-924f7\" (UniqueName: \"kubernetes.io/projected/459c4a0a-4a5f-4ca5-8a96-60eee2e94f52-kube-api-access-924f7\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:36:56.094266 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:36:56.094157    2576 generic.go:356] "Generic (PLEG): container finished" podID="459c4a0a-4a5f-4ca5-8a96-60eee2e94f52" containerID="67597953ed22c78f6fee8193df78701f2306d964249277be2c5663bc4e71de24" exitCode=0
Jul 17 17:36:56.094266 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:36:56.094225    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-799f9775bd-mk8vd"
Jul 17 17:36:56.094439 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:36:56.094263    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-799f9775bd-mk8vd" event={"ID":"459c4a0a-4a5f-4ca5-8a96-60eee2e94f52","Type":"ContainerDied","Data":"67597953ed22c78f6fee8193df78701f2306d964249277be2c5663bc4e71de24"}
Jul 17 17:36:56.094439 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:36:56.094308    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-799f9775bd-mk8vd" event={"ID":"459c4a0a-4a5f-4ca5-8a96-60eee2e94f52","Type":"ContainerDied","Data":"29307ff3ce63988377ebc7762bd7dab1b1309239c4f234a17460e1d4684d6944"}
Jul 17 17:36:56.094439 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:36:56.094328    2576 scope.go:117] "RemoveContainer" containerID="67597953ed22c78f6fee8193df78701f2306d964249277be2c5663bc4e71de24"
Jul 17 17:36:56.103102 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:36:56.103080    2576 scope.go:117] "RemoveContainer" containerID="67597953ed22c78f6fee8193df78701f2306d964249277be2c5663bc4e71de24"
Jul 17 17:36:56.103401 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:36:56.103379    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67597953ed22c78f6fee8193df78701f2306d964249277be2c5663bc4e71de24\": container with ID starting with 67597953ed22c78f6fee8193df78701f2306d964249277be2c5663bc4e71de24 not found: ID does not exist" containerID="67597953ed22c78f6fee8193df78701f2306d964249277be2c5663bc4e71de24"
Jul 17 17:36:56.103480 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:36:56.103415    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67597953ed22c78f6fee8193df78701f2306d964249277be2c5663bc4e71de24"} err="failed to get container status \"67597953ed22c78f6fee8193df78701f2306d964249277be2c5663bc4e71de24\": rpc error: code = NotFound desc = could not find container \"67597953ed22c78f6fee8193df78701f2306d964249277be2c5663bc4e71de24\": container with ID starting with 67597953ed22c78f6fee8193df78701f2306d964249277be2c5663bc4e71de24 not found: ID does not exist"
Jul 17 17:36:56.131008 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:36:56.130971    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-799f9775bd-mk8vd"]
Jul 17 17:36:56.135709 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:36:56.135671    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-799f9775bd-mk8vd"]
Jul 17 17:36:56.523842 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:36:56.523799    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="459c4a0a-4a5f-4ca5-8a96-60eee2e94f52" path="/var/lib/kubelet/pods/459c4a0a-4a5f-4ca5-8a96-60eee2e94f52/volumes"
Jul 17 17:37:23.370629 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:37:23.370591    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:37:32.785515 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:37:32.785436    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:37:40.637605 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:37:40.637567    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54f8d57c9d-cwc94"]
Jul 17 17:37:40.638133 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:37:40.637776    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-54f8d57c9d-cwc94" podUID="f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50" containerName="manager" containerID="cri-o://ad4c80c113202e2cbcbf89ad06ef96a321a71de9253c2e189fc877ef4c3f9559" gracePeriod=30
Jul 17 17:37:40.897596 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:37:40.897529    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54f8d57c9d-cwc94"
Jul 17 17:37:40.978542 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:37:40.978502    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmk24\" (UniqueName: \"kubernetes.io/projected/f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50-kube-api-access-xmk24\") pod \"f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50\" (UID: \"f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50\") "
Jul 17 17:37:40.978706 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:37:40.978550    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50-webhook-cert\") pod \"f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50\" (UID: \"f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50\") "
Jul 17 17:37:40.980715 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:37:40.980685    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50-kube-api-access-xmk24" (OuterVolumeSpecName: "kube-api-access-xmk24") pod "f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50" (UID: "f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50"). InnerVolumeSpecName "kube-api-access-xmk24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:37:40.980715 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:37:40.980701    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50" (UID: "f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 17:37:41.079907 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:37:41.079864    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmk24\" (UniqueName: \"kubernetes.io/projected/f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50-kube-api-access-xmk24\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:37:41.079907 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:37:41.079896    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50-webhook-cert\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 17:37:41.300361 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:37:41.300324    2576 generic.go:356] "Generic (PLEG): container finished" podID="f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50" containerID="ad4c80c113202e2cbcbf89ad06ef96a321a71de9253c2e189fc877ef4c3f9559" exitCode=0
Jul 17 17:37:41.300544 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:37:41.300367    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54f8d57c9d-cwc94"
Jul 17 17:37:41.300544 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:37:41.300396    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54f8d57c9d-cwc94" event={"ID":"f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50","Type":"ContainerDied","Data":"ad4c80c113202e2cbcbf89ad06ef96a321a71de9253c2e189fc877ef4c3f9559"}
Jul 17 17:37:41.300544 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:37:41.300438    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54f8d57c9d-cwc94" event={"ID":"f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50","Type":"ContainerDied","Data":"3aadd3f3679d30ca361c37cf311039916d758655683bad6b49421b9c7cc336f4"}
Jul 17 17:37:41.300544 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:37:41.300460    2576 scope.go:117] "RemoveContainer" containerID="ad4c80c113202e2cbcbf89ad06ef96a321a71de9253c2e189fc877ef4c3f9559"
Jul 17 17:37:41.309644 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:37:41.309625    2576 scope.go:117] "RemoveContainer" containerID="ad4c80c113202e2cbcbf89ad06ef96a321a71de9253c2e189fc877ef4c3f9559"
Jul 17 17:37:41.309896 ip-10-0-143-187 kubenswrapper[2576]: E0717 17:37:41.309875    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad4c80c113202e2cbcbf89ad06ef96a321a71de9253c2e189fc877ef4c3f9559\": container with ID starting with ad4c80c113202e2cbcbf89ad06ef96a321a71de9253c2e189fc877ef4c3f9559 not found: ID does not exist" containerID="ad4c80c113202e2cbcbf89ad06ef96a321a71de9253c2e189fc877ef4c3f9559"
Jul 17 17:37:41.309941 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:37:41.309905    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad4c80c113202e2cbcbf89ad06ef96a321a71de9253c2e189fc877ef4c3f9559"} err="failed to get container status \"ad4c80c113202e2cbcbf89ad06ef96a321a71de9253c2e189fc877ef4c3f9559\": rpc error: code = NotFound desc = could not find container \"ad4c80c113202e2cbcbf89ad06ef96a321a71de9253c2e189fc877ef4c3f9559\": container with ID starting with ad4c80c113202e2cbcbf89ad06ef96a321a71de9253c2e189fc877ef4c3f9559 not found: ID does not exist"
Jul 17 17:37:41.322699 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:37:41.322674    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54f8d57c9d-cwc94"]
Jul 17 17:37:41.326636 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:37:41.326615    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54f8d57c9d-cwc94"]
Jul 17 17:37:42.522075 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:37:42.522032    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50" path="/var/lib/kubelet/pods/f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50/volumes"
Jul 17 17:37:43.889468 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:37:43.889424    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:39:23.309087 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:39:23.309042    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:39:36.783731 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:39:36.783690    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:40:12.378319 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:40:12.378281    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:40:21.989029 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:40:21.988982    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:40:34.190021 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:40:34.189932    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:40:46.305091 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:40:46.305050    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:41:01.192727 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:41:01.192683    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:41:12.983057 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:41:12.983023    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:41:24.684848 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:41:24.684803    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:41:34.681197 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:41:34.681138    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:41:59.787986 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:41:59.786435    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:42:11.186243 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:42:11.186197    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:42:35.590354 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:42:35.590300    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:42:46.492225 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:42:46.492181    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:43:01.383056 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:43:01.383008    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:43:13.384885 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:43:13.384838    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:43:29.188005 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:43:29.187964    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:43:42.378121 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:43:42.378031    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:45:28.493747 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:45:28.493708    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:45:42.096212 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:45:42.096174    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:45:51.384449 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:45:51.384410    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:46:03.688838 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:46:03.688797    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:46:13.878374 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:46:13.878337    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:46:25.684551 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:46:25.684505    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:46:34.490075 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:46:34.489991    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:46:45.788960 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:46:45.788918    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:46:55.275580 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:46:55.275537    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:47:05.279396 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:47:05.279353    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:47:16.640457 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:47:16.640418    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:47:37.827660 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:47:37.827626    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:47:46.896148 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:47:46.896109    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:47:56.792205 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:47:56.792154    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:48:06.785004 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:48:06.784925    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:48:17.879419 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:48:17.879377    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:48:27.177503 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:48:27.177462    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:48:39.187338 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:48:39.187300    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:48:48.678817 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:48:48.678779    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:49:01.509805 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:49:01.509766    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:49:11.089178 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:49:11.089136    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:49:24.096127 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:49:24.096085    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:49:32.092483 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:49:32.092442    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:49:42.589685 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:49:42.589578    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:49:56.988081 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:49:56.988043    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:50:09.087598 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:50:09.087561    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:50:26.588220 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:50:26.588158    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:50:40.005435 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:50:40.005396    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:50:49.297552 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:50:49.297512    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:51:01.887784 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:51:01.887743    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:51:16.488441 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:51:16.488402    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:51:27.094772 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:51:27.094738    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:54:31.588861 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:54:31.588820    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:54:46.293648 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:54:46.293600    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:55:50.593100 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:55:50.593062    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 17:56:03.590778 ip-10-0-143-187 kubenswrapper[2576]: I0717 17:56:03.590740    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:02:09.286460 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:02:09.286419    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:02:22.095347 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:02:22.095313    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:05:26.902701 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:05:26.902659    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:07:01.593778 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:07:01.593739    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:07:10.689990 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:07:10.689951    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:07:21.603906 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:07:21.603863    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:07:42.989839 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:07:42.989803    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:08:21.591059 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:21.591019    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:08:27.498273 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.498237    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"]
Jul 17 18:08:27.498680 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.498579    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="459c4a0a-4a5f-4ca5-8a96-60eee2e94f52" containerName="authorino"
Jul 17 18:08:27.498680 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.498590    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="459c4a0a-4a5f-4ca5-8a96-60eee2e94f52" containerName="authorino"
Jul 17 18:08:27.498680 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.498611    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50" containerName="manager"
Jul 17 18:08:27.498680 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.498617    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50" containerName="manager"
Jul 17 18:08:27.498680 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.498677    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="459c4a0a-4a5f-4ca5-8a96-60eee2e94f52" containerName="authorino"
Jul 17 18:08:27.498860 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.498686    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8c9dfdc-3ef8-486d-9d33-5241cd1b7d50" containerName="manager"
Jul 17 18:08:27.501869 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.501850    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:27.505025 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.504999    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a60650e8\"/\"default-dockercfg-dtlbc\""
Jul 17 18:08:27.505354 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.505336    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a60650e8\"/\"kube-root-ca.crt\""
Jul 17 18:08:27.506128 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.506109    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a60650e8\"/\"e2e-lifecycle-model-a60650e8-kserve-self-signed-certs\""
Jul 17 18:08:27.506229 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.506116    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a60650e8\"/\"openshift-service-ca.crt\""
Jul 17 18:08:27.515275 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.515244    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"]
Jul 17 18:08:27.680871 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.680831    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-tmp-dir\") pod \"e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") " pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:27.680871 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.680868    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chbn2\" (UniqueName: \"kubernetes.io/projected/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-kube-api-access-chbn2\") pod \"e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") " pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:27.681088 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.681030    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-home\") pod \"e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") " pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:27.681088 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.681063    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-dshm\") pod \"e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") " pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:27.681225 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.681152    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-model-cache\") pod \"e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") " pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:27.681225 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.681185    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-tls-certs\") pod \"e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") " pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:27.782566 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.782475    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-home\") pod \"e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") " pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:27.782566 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.782512    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-dshm\") pod \"e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") " pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:27.782566 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.782547    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-model-cache\") pod \"e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") " pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:27.782566 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.782566    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-tls-certs\") pod \"e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") " pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:27.782844 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.782605    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-tmp-dir\") pod \"e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") " pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:27.782844 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.782623    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chbn2\" (UniqueName: \"kubernetes.io/projected/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-kube-api-access-chbn2\") pod \"e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") " pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:27.782950 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.782931    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-home\") pod \"e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") " pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:27.783014 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.782961    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-model-cache\") pod \"e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") " pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:27.783094 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.783064    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-tmp-dir\") pod \"e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") " pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:27.784903 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.784883    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-dshm\") pod \"e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") " pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:27.785202 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.785154    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-tls-certs\") pod \"e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") " pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:27.791666 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.791637    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chbn2\" (UniqueName: \"kubernetes.io/projected/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-kube-api-access-chbn2\") pod \"e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") " pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:27.811148 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.811122    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:27.954961 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:27.954935    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"]
Jul 17 18:08:27.957200 ip-10-0-143-187 kubenswrapper[2576]: W0717 18:08:27.957150    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3d32e3b_8223_4a5e_ab27_5f93c6ecca2a.slice/crio-5e757de411a6036d22a474b23b071ceaa3aa9ded184d8ad08bb62b4b006c7beb WatchSource:0}: Error finding container 5e757de411a6036d22a474b23b071ceaa3aa9ded184d8ad08bb62b4b006c7beb: Status 404 returned error can't find the container with id 5e757de411a6036d22a474b23b071ceaa3aa9ded184d8ad08bb62b4b006c7beb
Jul 17 18:08:28.811729 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:28.811689    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs" event={"ID":"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a","Type":"ContainerStarted","Data":"661cc469f8d7d03b3332d3eebc4f06c2953575808d08ae120e6d16ceab27ab6f"}
Jul 17 18:08:28.812097 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:28.811740    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs" event={"ID":"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a","Type":"ContainerStarted","Data":"5e757de411a6036d22a474b23b071ceaa3aa9ded184d8ad08bb62b4b006c7beb"}
Jul 17 18:08:28.832864 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:28.832799    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs" podStartSLOduration=1.832776157 podStartE2EDuration="1.832776157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:08:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:08:28.831446084 +0000 UTC m=+2658.850222682" watchObservedRunningTime="2026-07-17 18:08:28.832776157 +0000 UTC m=+2658.851552753"
Jul 17 18:08:32.984125 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:32.984088    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:08:37.811381 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:37.811324    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:37.811789 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:37.811402    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:37.824159 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:37.824126    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:37.865513 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:37.865482    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:08:52.586437 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:08:52.586399    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:09:10.083017 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:10.082977    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:09:15.733371 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:15.733333    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"]
Jul 17 18:09:30.753975 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:30.753919    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs" podUID="d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a" containerName="main" containerID="cri-o://661cc469f8d7d03b3332d3eebc4f06c2953575808d08ae120e6d16ceab27ab6f" gracePeriod=45
Jul 17 18:09:30.999684 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:30.999657    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:09:31.102728 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.102644    2576 generic.go:356] "Generic (PLEG): container finished" podID="d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a" containerID="661cc469f8d7d03b3332d3eebc4f06c2953575808d08ae120e6d16ceab27ab6f" exitCode=0
Jul 17 18:09:31.102728 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.102689    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"
Jul 17 18:09:31.102728 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.102696    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs" event={"ID":"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a","Type":"ContainerDied","Data":"661cc469f8d7d03b3332d3eebc4f06c2953575808d08ae120e6d16ceab27ab6f"}
Jul 17 18:09:31.102728 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.102726    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs" event={"ID":"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a","Type":"ContainerDied","Data":"5e757de411a6036d22a474b23b071ceaa3aa9ded184d8ad08bb62b4b006c7beb"}
Jul 17 18:09:31.103007 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.102748    2576 scope.go:117] "RemoveContainer" containerID="661cc469f8d7d03b3332d3eebc4f06c2953575808d08ae120e6d16ceab27ab6f"
Jul 17 18:09:31.110922 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.110895    2576 scope.go:117] "RemoveContainer" containerID="661cc469f8d7d03b3332d3eebc4f06c2953575808d08ae120e6d16ceab27ab6f"
Jul 17 18:09:31.111204 ip-10-0-143-187 kubenswrapper[2576]: E0717 18:09:31.111158    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"661cc469f8d7d03b3332d3eebc4f06c2953575808d08ae120e6d16ceab27ab6f\": container with ID starting with 661cc469f8d7d03b3332d3eebc4f06c2953575808d08ae120e6d16ceab27ab6f not found: ID does not exist" containerID="661cc469f8d7d03b3332d3eebc4f06c2953575808d08ae120e6d16ceab27ab6f"
Jul 17 18:09:31.111270 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.111216    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"661cc469f8d7d03b3332d3eebc4f06c2953575808d08ae120e6d16ceab27ab6f"} err="failed to get container status \"661cc469f8d7d03b3332d3eebc4f06c2953575808d08ae120e6d16ceab27ab6f\": rpc error: code = NotFound desc = could not find container \"661cc469f8d7d03b3332d3eebc4f06c2953575808d08ae120e6d16ceab27ab6f\": container with ID starting with 661cc469f8d7d03b3332d3eebc4f06c2953575808d08ae120e6d16ceab27ab6f not found: ID does not exist"
Jul 17 18:09:31.118449 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.118429    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-model-cache\") pod \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") "
Jul 17 18:09:31.118540 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.118477    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chbn2\" (UniqueName: \"kubernetes.io/projected/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-kube-api-access-chbn2\") pod \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") "
Jul 17 18:09:31.118540 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.118523    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-dshm\") pod \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") "
Jul 17 18:09:31.118611 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.118553    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-tmp-dir\") pod \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") "
Jul 17 18:09:31.118611 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.118592    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-home\") pod \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") "
Jul 17 18:09:31.118687 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.118620    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-tls-certs\") pod \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\" (UID: \"d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a\") "
Jul 17 18:09:31.118687 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.118674    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-model-cache" (OuterVolumeSpecName: "model-cache") pod "d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a" (UID: "d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:09:31.118820 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.118794    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a" (UID: "d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:09:31.118934 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.118898    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-home" (OuterVolumeSpecName: "home") pod "d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a" (UID: "d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:09:31.119042 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.118959    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-model-cache\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:09:31.119042 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.118978    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-tmp-dir\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:09:31.120793 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.120767    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-dshm" (OuterVolumeSpecName: "dshm") pod "d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a" (UID: "d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:09:31.120862 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.120806    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-kube-api-access-chbn2" (OuterVolumeSpecName: "kube-api-access-chbn2") pod "d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a" (UID: "d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a"). InnerVolumeSpecName "kube-api-access-chbn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:09:31.120862 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.120806    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a" (UID: "d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:09:31.220262 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.220236    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-home\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:09:31.220262 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.220256    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-tls-certs\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:09:31.220262 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.220268    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chbn2\" (UniqueName: \"kubernetes.io/projected/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-kube-api-access-chbn2\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:09:31.220447 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.220276    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a-dshm\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:09:31.426641 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.426609    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"]
Jul 17 18:09:31.432068 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:31.432040    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-a60650e8/e2e-lifecycle-model-a60650e8-kserve-5df56f6479-wf8qs"]
Jul 17 18:09:32.522312 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:09:32.522274    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a" path="/var/lib/kubelet/pods/d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a/volumes"
Jul 17 18:10:07.387429 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:10:07.387391    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:10:20.216216 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:10:20.216180    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:11:09.485964 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:09.485925    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:11:19.995652 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:19.995611    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"]
Jul 17 18:11:19.996095 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:19.995967    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a" containerName="main"
Jul 17 18:11:19.996095 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:19.995978    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a" containerName="main"
Jul 17 18:11:19.996095 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:19.996045    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3d32e3b-8223-4a5e-ab27-5f93c6ecca2a" containerName="main"
Jul 17 18:11:19.998902 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:19.998884    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:20.001959 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.001935    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-54bdd1\"/\"kube-root-ca.crt\""
Jul 17 18:11:20.002152 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.002138    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-54bdd1\"/\"default-dockercfg-8cjw7\""
Jul 17 18:11:20.002978 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.002956    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-54bdd1\"/\"openshift-service-ca.crt\""
Jul 17 18:11:20.003120 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.003098    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-54bdd1\"/\"test-model-54bdd1-kserve-self-signed-certs\""
Jul 17 18:11:20.008154 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.008135    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"]
Jul 17 18:11:20.161829 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.161790    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-dshm\") pod \"test-model-54bdd1-kserve-6f5947dbc7-w24zf\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") " pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:20.162020 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.161852    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-home\") pod \"test-model-54bdd1-kserve-6f5947dbc7-w24zf\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") " pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:20.162020 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.161879    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-958sl\" (UniqueName: \"kubernetes.io/projected/da4e50a9-3754-4580-a6dd-10ad96d43d46-kube-api-access-958sl\") pod \"test-model-54bdd1-kserve-6f5947dbc7-w24zf\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") " pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:20.162020 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.161907    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-tmp-dir\") pod \"test-model-54bdd1-kserve-6f5947dbc7-w24zf\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") " pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:20.162020 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.161924    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da4e50a9-3754-4580-a6dd-10ad96d43d46-tls-certs\") pod \"test-model-54bdd1-kserve-6f5947dbc7-w24zf\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") " pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:20.162020 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.161952    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-model-cache\") pod \"test-model-54bdd1-kserve-6f5947dbc7-w24zf\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") " pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:20.263386 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.263294    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-model-cache\") pod \"test-model-54bdd1-kserve-6f5947dbc7-w24zf\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") " pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:20.263551 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.263391    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-dshm\") pod \"test-model-54bdd1-kserve-6f5947dbc7-w24zf\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") " pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:20.263551 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.263426    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-home\") pod \"test-model-54bdd1-kserve-6f5947dbc7-w24zf\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") " pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:20.263551 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.263450    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-958sl\" (UniqueName: \"kubernetes.io/projected/da4e50a9-3754-4580-a6dd-10ad96d43d46-kube-api-access-958sl\") pod \"test-model-54bdd1-kserve-6f5947dbc7-w24zf\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") " pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:20.263551 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.263486    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-tmp-dir\") pod \"test-model-54bdd1-kserve-6f5947dbc7-w24zf\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") " pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:20.263551 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.263515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da4e50a9-3754-4580-a6dd-10ad96d43d46-tls-certs\") pod \"test-model-54bdd1-kserve-6f5947dbc7-w24zf\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") " pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:20.263781 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.263761    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-model-cache\") pod \"test-model-54bdd1-kserve-6f5947dbc7-w24zf\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") " pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:20.263900 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.263877    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-home\") pod \"test-model-54bdd1-kserve-6f5947dbc7-w24zf\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") " pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:20.263964 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.263913    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-tmp-dir\") pod \"test-model-54bdd1-kserve-6f5947dbc7-w24zf\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") " pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:20.265788 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.265757    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-dshm\") pod \"test-model-54bdd1-kserve-6f5947dbc7-w24zf\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") " pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:20.266041 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.266023    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da4e50a9-3754-4580-a6dd-10ad96d43d46-tls-certs\") pod \"test-model-54bdd1-kserve-6f5947dbc7-w24zf\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") " pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:20.272068 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.272044    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-958sl\" (UniqueName: \"kubernetes.io/projected/da4e50a9-3754-4580-a6dd-10ad96d43d46-kube-api-access-958sl\") pod \"test-model-54bdd1-kserve-6f5947dbc7-w24zf\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") " pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:20.308818 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.308773    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:20.451050 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.451017    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"]
Jul 17 18:11:20.453784 ip-10-0-143-187 kubenswrapper[2576]: W0717 18:11:20.453755    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda4e50a9_3754_4580_a6dd_10ad96d43d46.slice/crio-d19f013caa24b54e8aa722f704db2ed9891d7341d09fedaf0dfbbbd75e08c16c WatchSource:0}: Error finding container d19f013caa24b54e8aa722f704db2ed9891d7341d09fedaf0dfbbbd75e08c16c: Status 404 returned error can't find the container with id d19f013caa24b54e8aa722f704db2ed9891d7341d09fedaf0dfbbbd75e08c16c
Jul 17 18:11:20.611300 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.611257    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf" event={"ID":"da4e50a9-3754-4580-a6dd-10ad96d43d46","Type":"ContainerStarted","Data":"12332a1f12f42e763d7a474d78a52ad448263df20b8236e1863531783b2b6ef1"}
Jul 17 18:11:20.611300 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.611307    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf" event={"ID":"da4e50a9-3754-4580-a6dd-10ad96d43d46","Type":"ContainerStarted","Data":"d19f013caa24b54e8aa722f704db2ed9891d7341d09fedaf0dfbbbd75e08c16c"}
Jul 17 18:11:20.631913 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.631853    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf" podStartSLOduration=1.631836312 podStartE2EDuration="1.631836312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:11:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:11:20.629591661 +0000 UTC m=+2830.648368260" watchObservedRunningTime="2026-07-17 18:11:20.631836312 +0000 UTC m=+2830.650612911"
Jul 17 18:11:20.786298 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:20.786209    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:11:30.308951 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:30.308909    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:30.309383 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:30.308967    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:30.321736 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:30.321711    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:30.407200 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:30.407148    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:11:30.669148 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:30.669067    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:11:51.789623 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:11:51.789584    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:12:06.684994 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:06.684908    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:12:06.728005 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:06.727969    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"]
Jul 17 18:12:19.091445 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:19.091400    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:12:21.748350 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:21.748287    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf" podUID="da4e50a9-3754-4580-a6dd-10ad96d43d46" containerName="main" containerID="cri-o://12332a1f12f42e763d7a474d78a52ad448263df20b8236e1863531783b2b6ef1" gracePeriod=45
Jul 17 18:12:21.896259 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:21.896221    2576 generic.go:356] "Generic (PLEG): container finished" podID="da4e50a9-3754-4580-a6dd-10ad96d43d46" containerID="12332a1f12f42e763d7a474d78a52ad448263df20b8236e1863531783b2b6ef1" exitCode=0
Jul 17 18:12:21.896434 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:21.896306    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf" event={"ID":"da4e50a9-3754-4580-a6dd-10ad96d43d46","Type":"ContainerDied","Data":"12332a1f12f42e763d7a474d78a52ad448263df20b8236e1863531783b2b6ef1"}
Jul 17 18:12:22.007592 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.007521    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:12:22.103311 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.103260    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da4e50a9-3754-4580-a6dd-10ad96d43d46-tls-certs\") pod \"da4e50a9-3754-4580-a6dd-10ad96d43d46\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") "
Jul 17 18:12:22.103311 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.103326    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-home\") pod \"da4e50a9-3754-4580-a6dd-10ad96d43d46\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") "
Jul 17 18:12:22.103573 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.103350    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-dshm\") pod \"da4e50a9-3754-4580-a6dd-10ad96d43d46\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") "
Jul 17 18:12:22.103573 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.103423    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-958sl\" (UniqueName: \"kubernetes.io/projected/da4e50a9-3754-4580-a6dd-10ad96d43d46-kube-api-access-958sl\") pod \"da4e50a9-3754-4580-a6dd-10ad96d43d46\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") "
Jul 17 18:12:22.103573 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.103448    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-tmp-dir\") pod \"da4e50a9-3754-4580-a6dd-10ad96d43d46\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") "
Jul 17 18:12:22.103573 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.103465    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-model-cache\") pod \"da4e50a9-3754-4580-a6dd-10ad96d43d46\" (UID: \"da4e50a9-3754-4580-a6dd-10ad96d43d46\") "
Jul 17 18:12:22.103773 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.103635    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-home" (OuterVolumeSpecName: "home") pod "da4e50a9-3754-4580-a6dd-10ad96d43d46" (UID: "da4e50a9-3754-4580-a6dd-10ad96d43d46"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:12:22.103773 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.103730    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "da4e50a9-3754-4580-a6dd-10ad96d43d46" (UID: "da4e50a9-3754-4580-a6dd-10ad96d43d46"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:12:22.103773 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.103753    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-home\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:12:22.103920 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.103779    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-model-cache" (OuterVolumeSpecName: "model-cache") pod "da4e50a9-3754-4580-a6dd-10ad96d43d46" (UID: "da4e50a9-3754-4580-a6dd-10ad96d43d46"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:12:22.105604 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.105582    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-dshm" (OuterVolumeSpecName: "dshm") pod "da4e50a9-3754-4580-a6dd-10ad96d43d46" (UID: "da4e50a9-3754-4580-a6dd-10ad96d43d46"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:12:22.105694 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.105670    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da4e50a9-3754-4580-a6dd-10ad96d43d46-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "da4e50a9-3754-4580-a6dd-10ad96d43d46" (UID: "da4e50a9-3754-4580-a6dd-10ad96d43d46"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:12:22.105694 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.105673    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da4e50a9-3754-4580-a6dd-10ad96d43d46-kube-api-access-958sl" (OuterVolumeSpecName: "kube-api-access-958sl") pod "da4e50a9-3754-4580-a6dd-10ad96d43d46" (UID: "da4e50a9-3754-4580-a6dd-10ad96d43d46"). InnerVolumeSpecName "kube-api-access-958sl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:12:22.205075 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.205029    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-958sl\" (UniqueName: \"kubernetes.io/projected/da4e50a9-3754-4580-a6dd-10ad96d43d46-kube-api-access-958sl\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:12:22.205075 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.205066    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-tmp-dir\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:12:22.205075 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.205080    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-model-cache\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:12:22.205075 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.205087    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da4e50a9-3754-4580-a6dd-10ad96d43d46-tls-certs\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:12:22.205386 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.205096    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da4e50a9-3754-4580-a6dd-10ad96d43d46-dshm\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:12:22.904555 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.904471    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"
Jul 17 18:12:22.904555 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.904501    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf" event={"ID":"da4e50a9-3754-4580-a6dd-10ad96d43d46","Type":"ContainerDied","Data":"d19f013caa24b54e8aa722f704db2ed9891d7341d09fedaf0dfbbbd75e08c16c"}
Jul 17 18:12:22.905159 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.904557    2576 scope.go:117] "RemoveContainer" containerID="12332a1f12f42e763d7a474d78a52ad448263df20b8236e1863531783b2b6ef1"
Jul 17 18:12:22.924138 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.924111    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"]
Jul 17 18:12:22.930376 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:22.930352    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-54bdd1/test-model-54bdd1-kserve-6f5947dbc7-w24zf"]
Jul 17 18:12:24.523150 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:24.523106    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da4e50a9-3754-4580-a6dd-10ad96d43d46" path="/var/lib/kubelet/pods/da4e50a9-3754-4580-a6dd-10ad96d43d46/volumes"
Jul 17 18:12:29.300799 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:29.300764    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:12:47.385460 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:12:47.385419    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:13:10.510603 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:13:10.510564    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:13:26.183145 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:13:26.183105    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:13:39.798477 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:13:39.798441    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:14:03.924455 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:03.924419    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:14:25.384476 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:25.384429    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:14:38.678727 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:38.678683    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:14:44.209959 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.209921    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"]
Jul 17 18:14:44.210362 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.210302    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da4e50a9-3754-4580-a6dd-10ad96d43d46" containerName="main"
Jul 17 18:14:44.210362 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.210315    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="da4e50a9-3754-4580-a6dd-10ad96d43d46" containerName="main"
Jul 17 18:14:44.210433 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.210380    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="da4e50a9-3754-4580-a6dd-10ad96d43d46" containerName="main"
Jul 17 18:14:44.213593 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.213567    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:44.217427 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.217395    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4699ff\"/\"default-dockercfg-962mf\""
Jul 17 18:14:44.218983 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.218961    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4699ff\"/\"auth-test-model-4699ff-kserve-self-signed-certs\""
Jul 17 18:14:44.219106 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.218977    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4699ff\"/\"openshift-service-ca.crt\""
Jul 17 18:14:44.219106 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.218977    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4699ff\"/\"kube-root-ca.crt\""
Jul 17 18:14:44.225834 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.225811    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"]
Jul 17 18:14:44.356238 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.356199    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-dshm\") pod \"auth-test-model-4699ff-kserve-644db9686c-4sffb\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") " pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:44.356416 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.356269    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-tmp-dir\") pod \"auth-test-model-4699ff-kserve-644db9686c-4sffb\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") " pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:44.356416 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.356293    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-home\") pod \"auth-test-model-4699ff-kserve-644db9686c-4sffb\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") " pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:44.356416 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.356328    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-tls-certs\") pod \"auth-test-model-4699ff-kserve-644db9686c-4sffb\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") " pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:44.356416 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.356399    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-model-cache\") pod \"auth-test-model-4699ff-kserve-644db9686c-4sffb\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") " pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:44.356550 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.356435    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrvd2\" (UniqueName: \"kubernetes.io/projected/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-kube-api-access-nrvd2\") pod \"auth-test-model-4699ff-kserve-644db9686c-4sffb\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") " pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:44.457693 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.457649    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-tmp-dir\") pod \"auth-test-model-4699ff-kserve-644db9686c-4sffb\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") " pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:44.457693 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.457697    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-home\") pod \"auth-test-model-4699ff-kserve-644db9686c-4sffb\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") " pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:44.457912 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.457820    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-tls-certs\") pod \"auth-test-model-4699ff-kserve-644db9686c-4sffb\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") " pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:44.457912 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.457865    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-model-cache\") pod \"auth-test-model-4699ff-kserve-644db9686c-4sffb\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") " pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:44.457912 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.457896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrvd2\" (UniqueName: \"kubernetes.io/projected/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-kube-api-access-nrvd2\") pod \"auth-test-model-4699ff-kserve-644db9686c-4sffb\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") " pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:44.458466 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.457941    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-dshm\") pod \"auth-test-model-4699ff-kserve-644db9686c-4sffb\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") " pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:44.458466 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.458131    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-home\") pod \"auth-test-model-4699ff-kserve-644db9686c-4sffb\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") " pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:44.458466 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.458147    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-tmp-dir\") pod \"auth-test-model-4699ff-kserve-644db9686c-4sffb\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") " pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:44.458466 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.458237    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-model-cache\") pod \"auth-test-model-4699ff-kserve-644db9686c-4sffb\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") " pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:44.460127 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.460080    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-dshm\") pod \"auth-test-model-4699ff-kserve-644db9686c-4sffb\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") " pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:44.460396 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.460378    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-tls-certs\") pod \"auth-test-model-4699ff-kserve-644db9686c-4sffb\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") " pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:44.467567 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.467543    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrvd2\" (UniqueName: \"kubernetes.io/projected/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-kube-api-access-nrvd2\") pod \"auth-test-model-4699ff-kserve-644db9686c-4sffb\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") " pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:44.524065 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.524029    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:44.659374 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:44.659349    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"]
Jul 17 18:14:44.661582 ip-10-0-143-187 kubenswrapper[2576]: W0717 18:14:44.661539    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podacf6dca4_cc5f_47ab_9fc6_3c421b5ee63c.slice/crio-a3fd3c9f94e324d42b945902a84fe169cfe86d655ed96b356fb396beb8be6a39 WatchSource:0}: Error finding container a3fd3c9f94e324d42b945902a84fe169cfe86d655ed96b356fb396beb8be6a39: Status 404 returned error can't find the container with id a3fd3c9f94e324d42b945902a84fe169cfe86d655ed96b356fb396beb8be6a39
Jul 17 18:14:45.556747 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:45.556712    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb" event={"ID":"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c","Type":"ContainerStarted","Data":"959790e827b63f6a5969ab624cad11a56412d9299e3f7e1f5632761815c2c904"}
Jul 17 18:14:45.556747 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:45.556753    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb" event={"ID":"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c","Type":"ContainerStarted","Data":"a3fd3c9f94e324d42b945902a84fe169cfe86d655ed96b356fb396beb8be6a39"}
Jul 17 18:14:45.590459 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:45.590405    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb" podStartSLOduration=1.590388361 podStartE2EDuration="1.590388361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:14:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:14:45.588456572 +0000 UTC m=+3035.607233171" watchObservedRunningTime="2026-07-17 18:14:45.590388361 +0000 UTC m=+3035.609164959"
Jul 17 18:14:47.679065 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:47.679026    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:14:54.524200 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:54.524155    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:54.524599 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:54.524214    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:54.536817 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:54.536788    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:14:54.609288 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:14:54.609256    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:15:11.182532 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:15:11.182492    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:15:39.902265 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:15:39.902233    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:15:57.682398 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:15:57.682361    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:16:17.777959 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:16:17.777918    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:16:34.775181 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:16:34.775124    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:16:52.074955 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:16:52.074908    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:17:11.984393 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:11.984350    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:17:24.276078 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:24.276038    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"]
Jul 17 18:17:27.274198 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:27.274146    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:17:39.297741 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:39.297693    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb" podUID="acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c" containerName="main" containerID="cri-o://959790e827b63f6a5969ab624cad11a56412d9299e3f7e1f5632761815c2c904" gracePeriod=45
Jul 17 18:17:39.545372 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:39.545348    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:17:39.574441 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:39.574369    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-tmp-dir\") pod \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") "
Jul 17 18:17:39.574571 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:39.574445    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-model-cache\") pod \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") "
Jul 17 18:17:39.574571 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:39.574486    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrvd2\" (UniqueName: \"kubernetes.io/projected/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-kube-api-access-nrvd2\") pod \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") "
Jul 17 18:17:39.574571 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:39.574544    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-home\") pod \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") "
Jul 17 18:17:39.574744 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:39.574584    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-tls-certs\") pod \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") "
Jul 17 18:17:39.574744 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:39.574616    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-dshm\") pod \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\" (UID: \"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c\") "
Jul 17 18:17:39.574744 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:39.574717    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c" (UID: "acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:17:39.574909 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:39.574754    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-model-cache" (OuterVolumeSpecName: "model-cache") pod "acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c" (UID: "acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:17:39.574992 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:39.574969    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-tmp-dir\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:17:39.575044 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:39.575004    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-model-cache\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:17:39.575044 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:39.574979    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-home" (OuterVolumeSpecName: "home") pod "acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c" (UID: "acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:17:39.577082 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:39.577056    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c" (UID: "acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:17:39.577214 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:39.577197    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-dshm" (OuterVolumeSpecName: "dshm") pod "acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c" (UID: "acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:17:39.577273 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:39.577216    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-kube-api-access-nrvd2" (OuterVolumeSpecName: "kube-api-access-nrvd2") pod "acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c" (UID: "acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c"). InnerVolumeSpecName "kube-api-access-nrvd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:17:39.675606 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:39.675574    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-tls-certs\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:17:39.675606 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:39.675600    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-dshm\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:17:39.675606 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:39.675610    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrvd2\" (UniqueName: \"kubernetes.io/projected/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-kube-api-access-nrvd2\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:17:39.675845 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:39.675618    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c-home\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:17:40.366137 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:40.366099    2576 generic.go:356] "Generic (PLEG): container finished" podID="acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c" containerID="959790e827b63f6a5969ab624cad11a56412d9299e3f7e1f5632761815c2c904" exitCode=0
Jul 17 18:17:40.366581 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:40.366155    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"
Jul 17 18:17:40.366581 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:40.366158    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb" event={"ID":"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c","Type":"ContainerDied","Data":"959790e827b63f6a5969ab624cad11a56412d9299e3f7e1f5632761815c2c904"}
Jul 17 18:17:40.366581 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:40.366279    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb" event={"ID":"acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c","Type":"ContainerDied","Data":"a3fd3c9f94e324d42b945902a84fe169cfe86d655ed96b356fb396beb8be6a39"}
Jul 17 18:17:40.366581 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:40.366297    2576 scope.go:117] "RemoveContainer" containerID="959790e827b63f6a5969ab624cad11a56412d9299e3f7e1f5632761815c2c904"
Jul 17 18:17:40.375777 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:40.375751    2576 scope.go:117] "RemoveContainer" containerID="959790e827b63f6a5969ab624cad11a56412d9299e3f7e1f5632761815c2c904"
Jul 17 18:17:40.376019 ip-10-0-143-187 kubenswrapper[2576]: E0717 18:17:40.376002    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"959790e827b63f6a5969ab624cad11a56412d9299e3f7e1f5632761815c2c904\": container with ID starting with 959790e827b63f6a5969ab624cad11a56412d9299e3f7e1f5632761815c2c904 not found: ID does not exist" containerID="959790e827b63f6a5969ab624cad11a56412d9299e3f7e1f5632761815c2c904"
Jul 17 18:17:40.376105 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:40.376026    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"959790e827b63f6a5969ab624cad11a56412d9299e3f7e1f5632761815c2c904"} err="failed to get container status \"959790e827b63f6a5969ab624cad11a56412d9299e3f7e1f5632761815c2c904\": rpc error: code = NotFound desc = could not find container \"959790e827b63f6a5969ab624cad11a56412d9299e3f7e1f5632761815c2c904\": container with ID starting with 959790e827b63f6a5969ab624cad11a56412d9299e3f7e1f5632761815c2c904 not found: ID does not exist"
Jul 17 18:17:40.389743 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:40.389706    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"]
Jul 17 18:17:40.391920 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:40.391895    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4699ff/auth-test-model-4699ff-kserve-644db9686c-4sffb"]
Jul 17 18:17:40.522553 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:40.522516    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c" path="/var/lib/kubelet/pods/acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c/volumes"
Jul 17 18:17:49.301180 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.301120    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"]
Jul 17 18:17:49.301682 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.301553    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c" containerName="main"
Jul 17 18:17:49.301682 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.301570    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c" containerName="main"
Jul 17 18:17:49.301682 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.301653    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="acf6dca4-cc5f-47ab-9fc6-3c421b5ee63c" containerName="main"
Jul 17 18:17:49.304909 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.304886    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:17:49.308922 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.308897    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4699ff\"/\"openshift-service-ca.crt\""
Jul 17 18:17:49.309058 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.308897    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4699ff\"/\"default-dockercfg-962mf\""
Jul 17 18:17:49.309058 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.308899    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4699ff\"/\"kube-root-ca.crt\""
Jul 17 18:17:49.309058 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.308898    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4699ff\"/\"sub-test-model-4699ff-kserve-self-signed-certs\""
Jul 17 18:17:49.314114 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.314058    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"]
Jul 17 18:17:49.361261 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.361231    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-dshm\") pod \"sub-test-model-4699ff-kserve-75c4496875-nv9bs\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") " pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:17:49.361440 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.361284    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-home\") pod \"sub-test-model-4699ff-kserve-75c4496875-nv9bs\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") " pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:17:49.361440 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.361319    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-tmp-dir\") pod \"sub-test-model-4699ff-kserve-75c4496875-nv9bs\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") " pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:17:49.361440 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.361348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-model-cache\") pod \"sub-test-model-4699ff-kserve-75c4496875-nv9bs\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") " pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:17:49.361440 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.361372    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkfkj\" (UniqueName: \"kubernetes.io/projected/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-kube-api-access-xkfkj\") pod \"sub-test-model-4699ff-kserve-75c4496875-nv9bs\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") " pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:17:49.361616 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.361466    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-tls-certs\") pod \"sub-test-model-4699ff-kserve-75c4496875-nv9bs\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") " pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:17:49.462734 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.462698    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-tls-certs\") pod \"sub-test-model-4699ff-kserve-75c4496875-nv9bs\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") " pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:17:49.462910 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.462754    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-dshm\") pod \"sub-test-model-4699ff-kserve-75c4496875-nv9bs\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") " pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:17:49.462910 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.462786    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-home\") pod \"sub-test-model-4699ff-kserve-75c4496875-nv9bs\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") " pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:17:49.462910 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.462807    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-tmp-dir\") pod \"sub-test-model-4699ff-kserve-75c4496875-nv9bs\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") " pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:17:49.462910 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.462831    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-model-cache\") pod \"sub-test-model-4699ff-kserve-75c4496875-nv9bs\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") " pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:17:49.462910 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.462853    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkfkj\" (UniqueName: \"kubernetes.io/projected/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-kube-api-access-xkfkj\") pod \"sub-test-model-4699ff-kserve-75c4496875-nv9bs\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") " pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:17:49.463289 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.463269    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-tmp-dir\") pod \"sub-test-model-4699ff-kserve-75c4496875-nv9bs\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") " pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:17:49.463368 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.463316    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-home\") pod \"sub-test-model-4699ff-kserve-75c4496875-nv9bs\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") " pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:17:49.463368 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.463349    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-model-cache\") pod \"sub-test-model-4699ff-kserve-75c4496875-nv9bs\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") " pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:17:49.465087 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.465063    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-dshm\") pod \"sub-test-model-4699ff-kserve-75c4496875-nv9bs\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") " pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:17:49.465424 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.465407    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-tls-certs\") pod \"sub-test-model-4699ff-kserve-75c4496875-nv9bs\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") " pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:17:49.473913 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.473886    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkfkj\" (UniqueName: \"kubernetes.io/projected/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-kube-api-access-xkfkj\") pod \"sub-test-model-4699ff-kserve-75c4496875-nv9bs\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") " pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:17:49.614594 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.614503    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:17:49.750483 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:49.750460    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"]
Jul 17 18:17:49.752455 ip-10-0-143-187 kubenswrapper[2576]: W0717 18:17:49.752425    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda54bf9d_db7f_46bd_b3dc_b64d0ff4e391.slice/crio-4ae13078315f508bf1291c2680c2cf4e7f36ad444840782210741f0781baa58e WatchSource:0}: Error finding container 4ae13078315f508bf1291c2680c2cf4e7f36ad444840782210741f0781baa58e: Status 404 returned error can't find the container with id 4ae13078315f508bf1291c2680c2cf4e7f36ad444840782210741f0781baa58e
Jul 17 18:17:50.417637 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:50.417596    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs" event={"ID":"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391","Type":"ContainerStarted","Data":"836ea668ff194647adff97f7b852a0e12ba05080124daed595343d1ae9c21569"}
Jul 17 18:17:50.417637 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:50.417643    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs" event={"ID":"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391","Type":"ContainerStarted","Data":"4ae13078315f508bf1291c2680c2cf4e7f36ad444840782210741f0781baa58e"}
Jul 17 18:17:50.434776 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:50.434711    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs" podStartSLOduration=1.434690928 podStartE2EDuration="1.434690928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:17:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:17:50.433605387 +0000 UTC m=+3220.452381986" watchObservedRunningTime="2026-07-17 18:17:50.434690928 +0000 UTC m=+3220.453467530"
Jul 17 18:17:53.179059 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:53.179021    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:17:59.614919 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:59.614874    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:17:59.615353 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:59.614943    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:17:59.627288 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:17:59.627264    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:18:00.474575 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:00.474545    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:18:13.196810 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.196775    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"]
Jul 17 18:18:13.201296 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.201276    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:13.203813 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.203789    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-22fb10\"/\"openshift-service-ca.crt\""
Jul 17 18:18:13.204881 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.204864    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-22fb10\"/\"sub-test-model-22fb10-kserve-self-signed-certs\""
Jul 17 18:18:13.204940 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.204867    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-22fb10\"/\"default-dockercfg-qw92v\""
Jul 17 18:18:13.204940 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.204868    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-22fb10\"/\"kube-root-ca.crt\""
Jul 17 18:18:13.211655 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.211631    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"]
Jul 17 18:18:13.377194 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.377117    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-dshm\") pod \"sub-test-model-22fb10-kserve-6898c75b85-zgqqj\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") " pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:13.377381 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.377206    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-model-cache\") pod \"sub-test-model-22fb10-kserve-6898c75b85-zgqqj\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") " pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:13.377381 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.377232    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bc21f63-44c3-44ae-81af-986dd8804f90-tls-certs\") pod \"sub-test-model-22fb10-kserve-6898c75b85-zgqqj\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") " pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:13.377381 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.377255    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-home\") pod \"sub-test-model-22fb10-kserve-6898c75b85-zgqqj\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") " pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:13.377381 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.377353    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcgcq\" (UniqueName: \"kubernetes.io/projected/5bc21f63-44c3-44ae-81af-986dd8804f90-kube-api-access-tcgcq\") pod \"sub-test-model-22fb10-kserve-6898c75b85-zgqqj\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") " pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:13.377533 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.377400    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-tmp-dir\") pod \"sub-test-model-22fb10-kserve-6898c75b85-zgqqj\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") " pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:13.477892 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.477848    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcgcq\" (UniqueName: \"kubernetes.io/projected/5bc21f63-44c3-44ae-81af-986dd8804f90-kube-api-access-tcgcq\") pod \"sub-test-model-22fb10-kserve-6898c75b85-zgqqj\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") " pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:13.478102 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.477921    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-tmp-dir\") pod \"sub-test-model-22fb10-kserve-6898c75b85-zgqqj\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") " pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:13.478102 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.477952    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-dshm\") pod \"sub-test-model-22fb10-kserve-6898c75b85-zgqqj\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") " pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:13.478102 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.477989    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-model-cache\") pod \"sub-test-model-22fb10-kserve-6898c75b85-zgqqj\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") " pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:13.478102 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.478033    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bc21f63-44c3-44ae-81af-986dd8804f90-tls-certs\") pod \"sub-test-model-22fb10-kserve-6898c75b85-zgqqj\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") " pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:13.478102 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.478064    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-home\") pod \"sub-test-model-22fb10-kserve-6898c75b85-zgqqj\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") " pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:13.478436 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.478411    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-tmp-dir\") pod \"sub-test-model-22fb10-kserve-6898c75b85-zgqqj\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") " pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:13.478504 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.478479    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-model-cache\") pod \"sub-test-model-22fb10-kserve-6898c75b85-zgqqj\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") " pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:13.478563 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.478540    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-home\") pod \"sub-test-model-22fb10-kserve-6898c75b85-zgqqj\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") " pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:13.480335 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.480307    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-dshm\") pod \"sub-test-model-22fb10-kserve-6898c75b85-zgqqj\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") " pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:13.480509 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.480491    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bc21f63-44c3-44ae-81af-986dd8804f90-tls-certs\") pod \"sub-test-model-22fb10-kserve-6898c75b85-zgqqj\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") " pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:13.486998 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.486966    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcgcq\" (UniqueName: \"kubernetes.io/projected/5bc21f63-44c3-44ae-81af-986dd8804f90-kube-api-access-tcgcq\") pod \"sub-test-model-22fb10-kserve-6898c75b85-zgqqj\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") " pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:13.511265 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.511234    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:13.650257 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:13.650227    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"]
Jul 17 18:18:13.651932 ip-10-0-143-187 kubenswrapper[2576]: W0717 18:18:13.651899    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5bc21f63_44c3_44ae_81af_986dd8804f90.slice/crio-e4b264ad784360b90656556d60ec9479e6cff023de8f03a0d0a16ffbbe9a1f33 WatchSource:0}: Error finding container e4b264ad784360b90656556d60ec9479e6cff023de8f03a0d0a16ffbbe9a1f33: Status 404 returned error can't find the container with id e4b264ad784360b90656556d60ec9479e6cff023de8f03a0d0a16ffbbe9a1f33
Jul 17 18:18:14.526910 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:14.526872    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj" event={"ID":"5bc21f63-44c3-44ae-81af-986dd8804f90","Type":"ContainerStarted","Data":"2243c0842282e7394b5eefbe7141eb1c39c20dd3638944ea92fc1d420e7240f3"}
Jul 17 18:18:14.526910 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:14.526916    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj" event={"ID":"5bc21f63-44c3-44ae-81af-986dd8804f90","Type":"ContainerStarted","Data":"e4b264ad784360b90656556d60ec9479e6cff023de8f03a0d0a16ffbbe9a1f33"}
Jul 17 18:18:14.546793 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:14.546739    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj" podStartSLOduration=1.546723403 podStartE2EDuration="1.546723403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:18:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:18:14.545318892 +0000 UTC m=+3244.564095489" watchObservedRunningTime="2026-07-17 18:18:14.546723403 +0000 UTC m=+3244.565500000"
Jul 17 18:18:17.977582 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:17.977544    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:18:23.511929 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:23.511894    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:23.512406 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:23.511945    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:23.524625 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:23.524591    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:23.579047 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:23.579012    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:18:43.588785 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:43.588752    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:18:59.285534 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:18:59.285492    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"]
Jul 17 18:19:00.118194 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:00.118145    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"]
Jul 17 18:19:04.580616 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:04.580575    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:19:09.799664 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:09.799629    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"]
Jul 17 18:19:09.803394 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:09.803365    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:09.806281 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:09.806259    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4699ff\"/\"rate-test-model-4699ff-kserve-self-signed-certs\""
Jul 17 18:19:09.814423 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:09.814398    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"]
Jul 17 18:19:09.897260 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:09.897222    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8557\" (UniqueName: \"kubernetes.io/projected/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-kube-api-access-c8557\") pod \"rate-test-model-4699ff-kserve-75677488b7-8jxsl\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") " pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:09.897455 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:09.897336    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-home\") pod \"rate-test-model-4699ff-kserve-75677488b7-8jxsl\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") " pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:09.897455 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:09.897411    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-tls-certs\") pod \"rate-test-model-4699ff-kserve-75677488b7-8jxsl\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") " pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:09.897584 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:09.897501    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-dshm\") pod \"rate-test-model-4699ff-kserve-75677488b7-8jxsl\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") " pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:09.897584 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:09.897528    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-tmp-dir\") pod \"rate-test-model-4699ff-kserve-75677488b7-8jxsl\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") " pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:09.897584 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:09.897556    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-model-cache\") pod \"rate-test-model-4699ff-kserve-75677488b7-8jxsl\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") " pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:09.998746 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:09.998693    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-home\") pod \"rate-test-model-4699ff-kserve-75677488b7-8jxsl\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") " pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:09.998957 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:09.998782    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-tls-certs\") pod \"rate-test-model-4699ff-kserve-75677488b7-8jxsl\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") " pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:09.998957 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:09.998832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-dshm\") pod \"rate-test-model-4699ff-kserve-75677488b7-8jxsl\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") " pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:09.998957 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:09.998926    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-tmp-dir\") pod \"rate-test-model-4699ff-kserve-75677488b7-8jxsl\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") " pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:09.999191 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:09.998963    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-model-cache\") pod \"rate-test-model-4699ff-kserve-75677488b7-8jxsl\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") " pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:09.999191 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:09.998999    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8557\" (UniqueName: \"kubernetes.io/projected/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-kube-api-access-c8557\") pod \"rate-test-model-4699ff-kserve-75677488b7-8jxsl\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") " pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:09.999191 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:09.999133    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-home\") pod \"rate-test-model-4699ff-kserve-75677488b7-8jxsl\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") " pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:09.999368 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:09.999262    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-tmp-dir\") pod \"rate-test-model-4699ff-kserve-75677488b7-8jxsl\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") " pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:09.999368 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:09.999312    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-model-cache\") pod \"rate-test-model-4699ff-kserve-75677488b7-8jxsl\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") " pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:10.001135 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:10.001109    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-dshm\") pod \"rate-test-model-4699ff-kserve-75677488b7-8jxsl\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") " pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:10.001324 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:10.001308    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-tls-certs\") pod \"rate-test-model-4699ff-kserve-75677488b7-8jxsl\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") " pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:10.007923 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:10.007895    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8557\" (UniqueName: \"kubernetes.io/projected/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-kube-api-access-c8557\") pod \"rate-test-model-4699ff-kserve-75677488b7-8jxsl\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") " pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:10.112911 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:10.112820    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:10.247851 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:10.247800    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"]
Jul 17 18:19:10.250733 ip-10-0-143-187 kubenswrapper[2576]: W0717 18:19:10.250702    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64c9fbc4_2774_4a9f_9de5_5c131d91bcdc.slice/crio-0df473978b56fc817f61c2eb0c9a4e8a5c0c9c7140d14519e50c573a12e06134 WatchSource:0}: Error finding container 0df473978b56fc817f61c2eb0c9a4e8a5c0c9c7140d14519e50c573a12e06134: Status 404 returned error can't find the container with id 0df473978b56fc817f61c2eb0c9a4e8a5c0c9c7140d14519e50c573a12e06134
Jul 17 18:19:10.795885 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:10.795839    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl" event={"ID":"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc","Type":"ContainerStarted","Data":"ff15a9c022b22778388511293d476819646af1e9c4e5872b20c588f56aeabe7b"}
Jul 17 18:19:10.795885 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:10.795887    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl" event={"ID":"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc","Type":"ContainerStarted","Data":"0df473978b56fc817f61c2eb0c9a4e8a5c0c9c7140d14519e50c573a12e06134"}
Jul 17 18:19:10.813002 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:10.812951    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl" podStartSLOduration=1.8129373640000002 podStartE2EDuration="1.812937364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:19:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:19:10.811589718 +0000 UTC m=+3300.830366317" watchObservedRunningTime="2026-07-17 18:19:10.812937364 +0000 UTC m=+3300.831713940"
Jul 17 18:19:14.306025 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.305953    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs" podUID="da54bf9d-db7f-46bd-b3dc-b64d0ff4e391" containerName="main" containerID="cri-o://836ea668ff194647adff97f7b852a0e12ba05080124daed595343d1ae9c21569" gracePeriod=45
Jul 17 18:19:14.560831 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.560765    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:19:14.640955 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.640917    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkfkj\" (UniqueName: \"kubernetes.io/projected/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-kube-api-access-xkfkj\") pod \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") "
Jul 17 18:19:14.641141 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.640965    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-model-cache\") pod \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") "
Jul 17 18:19:14.641141 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.640992    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-tmp-dir\") pod \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") "
Jul 17 18:19:14.641141 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.641024    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-dshm\") pod \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") "
Jul 17 18:19:14.641141 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.641047    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-tls-certs\") pod \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") "
Jul 17 18:19:14.641141 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.641121    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-home\") pod \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\" (UID: \"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391\") "
Jul 17 18:19:14.641438 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.641274    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-model-cache" (OuterVolumeSpecName: "model-cache") pod "da54bf9d-db7f-46bd-b3dc-b64d0ff4e391" (UID: "da54bf9d-db7f-46bd-b3dc-b64d0ff4e391"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:19:14.641438 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.641341    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "da54bf9d-db7f-46bd-b3dc-b64d0ff4e391" (UID: "da54bf9d-db7f-46bd-b3dc-b64d0ff4e391"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:19:14.641533 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.641453    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-home" (OuterVolumeSpecName: "home") pod "da54bf9d-db7f-46bd-b3dc-b64d0ff4e391" (UID: "da54bf9d-db7f-46bd-b3dc-b64d0ff4e391"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:19:14.641662 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.641633    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-home\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:19:14.641794 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.641665    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-model-cache\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:19:14.641794 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.641682    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-tmp-dir\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:19:14.643243 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.643215    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-dshm" (OuterVolumeSpecName: "dshm") pod "da54bf9d-db7f-46bd-b3dc-b64d0ff4e391" (UID: "da54bf9d-db7f-46bd-b3dc-b64d0ff4e391"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:19:14.643356 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.643263    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "da54bf9d-db7f-46bd-b3dc-b64d0ff4e391" (UID: "da54bf9d-db7f-46bd-b3dc-b64d0ff4e391"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:19:14.643356 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.643287    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-kube-api-access-xkfkj" (OuterVolumeSpecName: "kube-api-access-xkfkj") pod "da54bf9d-db7f-46bd-b3dc-b64d0ff4e391" (UID: "da54bf9d-db7f-46bd-b3dc-b64d0ff4e391"). InnerVolumeSpecName "kube-api-access-xkfkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:19:14.742693 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.742654    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-dshm\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:19:14.742693 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.742685    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-tls-certs\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:19:14.742693 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.742694    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkfkj\" (UniqueName: \"kubernetes.io/projected/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391-kube-api-access-xkfkj\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:19:14.816188 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.816074    2576 generic.go:356] "Generic (PLEG): container finished" podID="da54bf9d-db7f-46bd-b3dc-b64d0ff4e391" containerID="836ea668ff194647adff97f7b852a0e12ba05080124daed595343d1ae9c21569" exitCode=0
Jul 17 18:19:14.816188 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.816119    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"
Jul 17 18:19:14.816380 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.816159    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs" event={"ID":"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391","Type":"ContainerDied","Data":"836ea668ff194647adff97f7b852a0e12ba05080124daed595343d1ae9c21569"}
Jul 17 18:19:14.816380 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.816227    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs" event={"ID":"da54bf9d-db7f-46bd-b3dc-b64d0ff4e391","Type":"ContainerDied","Data":"4ae13078315f508bf1291c2680c2cf4e7f36ad444840782210741f0781baa58e"}
Jul 17 18:19:14.816380 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.816251    2576 scope.go:117] "RemoveContainer" containerID="836ea668ff194647adff97f7b852a0e12ba05080124daed595343d1ae9c21569"
Jul 17 18:19:14.825648 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.825624    2576 scope.go:117] "RemoveContainer" containerID="836ea668ff194647adff97f7b852a0e12ba05080124daed595343d1ae9c21569"
Jul 17 18:19:14.825953 ip-10-0-143-187 kubenswrapper[2576]: E0717 18:19:14.825931    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"836ea668ff194647adff97f7b852a0e12ba05080124daed595343d1ae9c21569\": container with ID starting with 836ea668ff194647adff97f7b852a0e12ba05080124daed595343d1ae9c21569 not found: ID does not exist" containerID="836ea668ff194647adff97f7b852a0e12ba05080124daed595343d1ae9c21569"
Jul 17 18:19:14.826014 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.825964    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"836ea668ff194647adff97f7b852a0e12ba05080124daed595343d1ae9c21569"} err="failed to get container status \"836ea668ff194647adff97f7b852a0e12ba05080124daed595343d1ae9c21569\": rpc error: code = NotFound desc = could not find container \"836ea668ff194647adff97f7b852a0e12ba05080124daed595343d1ae9c21569\": container with ID starting with 836ea668ff194647adff97f7b852a0e12ba05080124daed595343d1ae9c21569 not found: ID does not exist"
Jul 17 18:19:14.844682 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.844644    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"]
Jul 17 18:19:14.848376 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:14.848345    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4699ff/sub-test-model-4699ff-kserve-75c4496875-nv9bs"]
Jul 17 18:19:15.139242 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.139135    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj" podUID="5bc21f63-44c3-44ae-81af-986dd8804f90" containerName="main" containerID="cri-o://2243c0842282e7394b5eefbe7141eb1c39c20dd3638944ea92fc1d420e7240f3" gracePeriod=45
Jul 17 18:19:15.396997 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.396930    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:19:15.450220 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.450160    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bc21f63-44c3-44ae-81af-986dd8804f90-tls-certs\") pod \"5bc21f63-44c3-44ae-81af-986dd8804f90\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") "
Jul 17 18:19:15.450401 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.450259    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-tmp-dir\") pod \"5bc21f63-44c3-44ae-81af-986dd8804f90\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") "
Jul 17 18:19:15.450401 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.450296    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-dshm\") pod \"5bc21f63-44c3-44ae-81af-986dd8804f90\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") "
Jul 17 18:19:15.450401 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.450349    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-model-cache\") pod \"5bc21f63-44c3-44ae-81af-986dd8804f90\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") "
Jul 17 18:19:15.450401 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.450397    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-home\") pod \"5bc21f63-44c3-44ae-81af-986dd8804f90\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") "
Jul 17 18:19:15.450625 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.450434    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcgcq\" (UniqueName: \"kubernetes.io/projected/5bc21f63-44c3-44ae-81af-986dd8804f90-kube-api-access-tcgcq\") pod \"5bc21f63-44c3-44ae-81af-986dd8804f90\" (UID: \"5bc21f63-44c3-44ae-81af-986dd8804f90\") "
Jul 17 18:19:15.450625 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.450543    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5bc21f63-44c3-44ae-81af-986dd8804f90" (UID: "5bc21f63-44c3-44ae-81af-986dd8804f90"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:19:15.450738 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.450657    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-home" (OuterVolumeSpecName: "home") pod "5bc21f63-44c3-44ae-81af-986dd8804f90" (UID: "5bc21f63-44c3-44ae-81af-986dd8804f90"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:19:15.450738 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.450667    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-model-cache" (OuterVolumeSpecName: "model-cache") pod "5bc21f63-44c3-44ae-81af-986dd8804f90" (UID: "5bc21f63-44c3-44ae-81af-986dd8804f90"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:19:15.450844 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.450821    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-tmp-dir\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:19:15.450886 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.450849    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-model-cache\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:19:15.450886 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.450862    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-home\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:19:15.452667 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.452635    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bc21f63-44c3-44ae-81af-986dd8804f90-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5bc21f63-44c3-44ae-81af-986dd8804f90" (UID: "5bc21f63-44c3-44ae-81af-986dd8804f90"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:19:15.452773 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.452685    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bc21f63-44c3-44ae-81af-986dd8804f90-kube-api-access-tcgcq" (OuterVolumeSpecName: "kube-api-access-tcgcq") pod "5bc21f63-44c3-44ae-81af-986dd8804f90" (UID: "5bc21f63-44c3-44ae-81af-986dd8804f90"). InnerVolumeSpecName "kube-api-access-tcgcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:19:15.452773 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.452687    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-dshm" (OuterVolumeSpecName: "dshm") pod "5bc21f63-44c3-44ae-81af-986dd8804f90" (UID: "5bc21f63-44c3-44ae-81af-986dd8804f90"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:19:15.551379 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.551337    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bc21f63-44c3-44ae-81af-986dd8804f90-tls-certs\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:19:15.551379 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.551376    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bc21f63-44c3-44ae-81af-986dd8804f90-dshm\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:19:15.551379 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.551389    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcgcq\" (UniqueName: \"kubernetes.io/projected/5bc21f63-44c3-44ae-81af-986dd8804f90-kube-api-access-tcgcq\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:19:15.821758 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.821724    2576 generic.go:356] "Generic (PLEG): container finished" podID="5bc21f63-44c3-44ae-81af-986dd8804f90" containerID="2243c0842282e7394b5eefbe7141eb1c39c20dd3638944ea92fc1d420e7240f3" exitCode=0
Jul 17 18:19:15.821942 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.821767    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"
Jul 17 18:19:15.821942 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.821800    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj" event={"ID":"5bc21f63-44c3-44ae-81af-986dd8804f90","Type":"ContainerDied","Data":"2243c0842282e7394b5eefbe7141eb1c39c20dd3638944ea92fc1d420e7240f3"}
Jul 17 18:19:15.821942 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.821846    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj" event={"ID":"5bc21f63-44c3-44ae-81af-986dd8804f90","Type":"ContainerDied","Data":"e4b264ad784360b90656556d60ec9479e6cff023de8f03a0d0a16ffbbe9a1f33"}
Jul 17 18:19:15.821942 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.821866    2576 scope.go:117] "RemoveContainer" containerID="2243c0842282e7394b5eefbe7141eb1c39c20dd3638944ea92fc1d420e7240f3"
Jul 17 18:19:15.830892 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.830874    2576 scope.go:117] "RemoveContainer" containerID="2243c0842282e7394b5eefbe7141eb1c39c20dd3638944ea92fc1d420e7240f3"
Jul 17 18:19:15.831190 ip-10-0-143-187 kubenswrapper[2576]: E0717 18:19:15.831150    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2243c0842282e7394b5eefbe7141eb1c39c20dd3638944ea92fc1d420e7240f3\": container with ID starting with 2243c0842282e7394b5eefbe7141eb1c39c20dd3638944ea92fc1d420e7240f3 not found: ID does not exist" containerID="2243c0842282e7394b5eefbe7141eb1c39c20dd3638944ea92fc1d420e7240f3"
Jul 17 18:19:15.831239 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.831200    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2243c0842282e7394b5eefbe7141eb1c39c20dd3638944ea92fc1d420e7240f3"} err="failed to get container status \"2243c0842282e7394b5eefbe7141eb1c39c20dd3638944ea92fc1d420e7240f3\": rpc error: code = NotFound desc = could not find container \"2243c0842282e7394b5eefbe7141eb1c39c20dd3638944ea92fc1d420e7240f3\": container with ID starting with 2243c0842282e7394b5eefbe7141eb1c39c20dd3638944ea92fc1d420e7240f3 not found: ID does not exist"
Jul 17 18:19:15.843383 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.843351    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"]
Jul 17 18:19:15.848706 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:15.848682    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-22fb10/sub-test-model-22fb10-kserve-6898c75b85-zgqqj"]
Jul 17 18:19:16.523245 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:16.523202    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bc21f63-44c3-44ae-81af-986dd8804f90" path="/var/lib/kubelet/pods/5bc21f63-44c3-44ae-81af-986dd8804f90/volumes"
Jul 17 18:19:16.523804 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:16.523783    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da54bf9d-db7f-46bd-b3dc-b64d0ff4e391" path="/var/lib/kubelet/pods/da54bf9d-db7f-46bd-b3dc-b64d0ff4e391/volumes"
Jul 17 18:19:16.574720 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:16.574679    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:19:20.113053 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:20.113021    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:20.113491 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:20.113274    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:20.125501 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:20.125479    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:20.860102 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:20.860072    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:19:29.793665 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.793633    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"]
Jul 17 18:19:29.794223 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.794202    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da54bf9d-db7f-46bd-b3dc-b64d0ff4e391" containerName="main"
Jul 17 18:19:29.794322 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.794230    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="da54bf9d-db7f-46bd-b3dc-b64d0ff4e391" containerName="main"
Jul 17 18:19:29.794322 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.794258    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bc21f63-44c3-44ae-81af-986dd8804f90" containerName="main"
Jul 17 18:19:29.794322 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.794267    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bc21f63-44c3-44ae-81af-986dd8804f90" containerName="main"
Jul 17 18:19:29.794475 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.794363    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="da54bf9d-db7f-46bd-b3dc-b64d0ff4e391" containerName="main"
Jul 17 18:19:29.794475 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.794377    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bc21f63-44c3-44ae-81af-986dd8804f90" containerName="main"
Jul 17 18:19:29.797533 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.797512    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:29.800102 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.800084    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-22fb10\"/\"kube-root-ca.crt\""
Jul 17 18:19:29.801377 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.801351    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-22fb10\"/\"default-dockercfg-qw92v\""
Jul 17 18:19:29.801468 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.801380    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-22fb10\"/\"openshift-service-ca.crt\""
Jul 17 18:19:29.801468 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.801439    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-22fb10\"/\"rate-test-model-22fb10-kserve-self-signed-certs\""
Jul 17 18:19:29.807612 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.807590    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"]
Jul 17 18:19:29.880041 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.880009    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-dshm\") pod \"rate-test-model-22fb10-kserve-5d45847847-ltrh4\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") " pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:29.880187 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.880057    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgmdh\" (UniqueName: \"kubernetes.io/projected/21e07027-c3b4-4b22-ab32-74787c0db1ee-kube-api-access-bgmdh\") pod \"rate-test-model-22fb10-kserve-5d45847847-ltrh4\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") " pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:29.880187 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.880105    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-model-cache\") pod \"rate-test-model-22fb10-kserve-5d45847847-ltrh4\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") " pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:29.880187 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.880150    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-tmp-dir\") pod \"rate-test-model-22fb10-kserve-5d45847847-ltrh4\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") " pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:29.880300 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.880253    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21e07027-c3b4-4b22-ab32-74787c0db1ee-tls-certs\") pod \"rate-test-model-22fb10-kserve-5d45847847-ltrh4\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") " pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:29.880338 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.880301    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-home\") pod \"rate-test-model-22fb10-kserve-5d45847847-ltrh4\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") " pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:29.981348 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.981316    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21e07027-c3b4-4b22-ab32-74787c0db1ee-tls-certs\") pod \"rate-test-model-22fb10-kserve-5d45847847-ltrh4\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") " pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:29.981507 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.981375    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-home\") pod \"rate-test-model-22fb10-kserve-5d45847847-ltrh4\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") " pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:29.981507 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.981411    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-dshm\") pod \"rate-test-model-22fb10-kserve-5d45847847-ltrh4\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") " pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:29.981507 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.981448    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgmdh\" (UniqueName: \"kubernetes.io/projected/21e07027-c3b4-4b22-ab32-74787c0db1ee-kube-api-access-bgmdh\") pod \"rate-test-model-22fb10-kserve-5d45847847-ltrh4\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") " pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:29.981507 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.981484    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-model-cache\") pod \"rate-test-model-22fb10-kserve-5d45847847-ltrh4\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") " pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:29.981724 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.981516    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-tmp-dir\") pod \"rate-test-model-22fb10-kserve-5d45847847-ltrh4\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") " pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:29.981865 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.981839    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-home\") pod \"rate-test-model-22fb10-kserve-5d45847847-ltrh4\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") " pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:29.981938 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.981891    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-model-cache\") pod \"rate-test-model-22fb10-kserve-5d45847847-ltrh4\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") " pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:29.981938 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.981905    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-tmp-dir\") pod \"rate-test-model-22fb10-kserve-5d45847847-ltrh4\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") " pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:29.983691 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.983669    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-dshm\") pod \"rate-test-model-22fb10-kserve-5d45847847-ltrh4\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") " pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:29.983947 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.983930    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21e07027-c3b4-4b22-ab32-74787c0db1ee-tls-certs\") pod \"rate-test-model-22fb10-kserve-5d45847847-ltrh4\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") " pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:29.990689 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:29.990665    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgmdh\" (UniqueName: \"kubernetes.io/projected/21e07027-c3b4-4b22-ab32-74787c0db1ee-kube-api-access-bgmdh\") pod \"rate-test-model-22fb10-kserve-5d45847847-ltrh4\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") " pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:30.106311 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:30.106232    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:30.236805 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:30.236779    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"]
Jul 17 18:19:30.238722 ip-10-0-143-187 kubenswrapper[2576]: W0717 18:19:30.238697    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21e07027_c3b4_4b22_ab32_74787c0db1ee.slice/crio-85bdcb231e96c9d22a548b2a72a8eb4fc02c7167c4e42af4371f169e90652068 WatchSource:0}: Error finding container 85bdcb231e96c9d22a548b2a72a8eb4fc02c7167c4e42af4371f169e90652068: Status 404 returned error can't find the container with id 85bdcb231e96c9d22a548b2a72a8eb4fc02c7167c4e42af4371f169e90652068
Jul 17 18:19:30.894448 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:30.894404    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4" event={"ID":"21e07027-c3b4-4b22-ab32-74787c0db1ee","Type":"ContainerStarted","Data":"3a333fb51f4660d09a73cc9554c78581131ec4b5e798a040b6b12ba9d7f67e9c"}
Jul 17 18:19:30.894911 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:30.894460    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4" event={"ID":"21e07027-c3b4-4b22-ab32-74787c0db1ee","Type":"ContainerStarted","Data":"85bdcb231e96c9d22a548b2a72a8eb4fc02c7167c4e42af4371f169e90652068"}
Jul 17 18:19:30.916584 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:30.916526    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4" podStartSLOduration=1.916506521 podStartE2EDuration="1.916506521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:19:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:19:30.915614823 +0000 UTC m=+3320.934391420" watchObservedRunningTime="2026-07-17 18:19:30.916506521 +0000 UTC m=+3320.935283122"
Jul 17 18:19:35.076595 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:35.076558    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:19:40.106796 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:40.106757    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:40.106796 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:40.106804    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:40.119268 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:40.119233    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:40.953789 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:40.953762    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:19:50.986720 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:19:50.986683    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:20:07.787722 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:07.787686    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:20:13.440049 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:13.440008    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"]
Jul 17 18:20:14.182698 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:14.182665    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"]
Jul 17 18:20:21.298444 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:21.298407    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7573-140054093735232"]
Jul 17 18:20:21.303350 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:21.303321    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7573-140054093735232"
Jul 17 18:20:21.306078 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:21.306046    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7573-140054093735232"]
Jul 17 18:20:21.306233 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:21.306145    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hqwf7\""
Jul 17 18:20:21.449569 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:21.449519    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrcp5\" (UniqueName: \"kubernetes.io/projected/9b48e0b7-abe8-42d8-a8a5-3a210534dc00-kube-api-access-jrcp5\") pod \"test-curl-7573-140054093735232\" (UID: \"9b48e0b7-abe8-42d8-a8a5-3a210534dc00\") " pod="opendatahub/test-curl-7573-140054093735232"
Jul 17 18:20:21.550613 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:21.550511    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrcp5\" (UniqueName: \"kubernetes.io/projected/9b48e0b7-abe8-42d8-a8a5-3a210534dc00-kube-api-access-jrcp5\") pod \"test-curl-7573-140054093735232\" (UID: \"9b48e0b7-abe8-42d8-a8a5-3a210534dc00\") " pod="opendatahub/test-curl-7573-140054093735232"
Jul 17 18:20:21.558759 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:21.558732    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrcp5\" (UniqueName: \"kubernetes.io/projected/9b48e0b7-abe8-42d8-a8a5-3a210534dc00-kube-api-access-jrcp5\") pod \"test-curl-7573-140054093735232\" (UID: \"9b48e0b7-abe8-42d8-a8a5-3a210534dc00\") " pod="opendatahub/test-curl-7573-140054093735232"
Jul 17 18:20:21.614801 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:21.614766    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7573-140054093735232"
Jul 17 18:20:21.747234 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:21.747196    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7573-140054093735232"]
Jul 17 18:20:21.748913 ip-10-0-143-187 kubenswrapper[2576]: W0717 18:20:21.748886    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b48e0b7_abe8_42d8_a8a5_3a210534dc00.slice/crio-384b5a9a76a0effd63a3a4edd4ac33ccad2771fdd2e52eb7bc602696a310c573 WatchSource:0}: Error finding container 384b5a9a76a0effd63a3a4edd4ac33ccad2771fdd2e52eb7bc602696a310c573: Status 404 returned error can't find the container with id 384b5a9a76a0effd63a3a4edd4ac33ccad2771fdd2e52eb7bc602696a310c573
Jul 17 18:20:21.750719 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:21.750703    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 18:20:22.141292 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:22.141253    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7573-140054093735232" event={"ID":"9b48e0b7-abe8-42d8-a8a5-3a210534dc00","Type":"ContainerStarted","Data":"384b5a9a76a0effd63a3a4edd4ac33ccad2771fdd2e52eb7bc602696a310c573"}
Jul 17 18:20:23.148001 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:23.147960    2576 generic.go:356] "Generic (PLEG): container finished" podID="9b48e0b7-abe8-42d8-a8a5-3a210534dc00" containerID="0265c7a7fc325f4f1e1a06af7639fa99e287eadb831167f3a5a8aa99ed5ce4a4" exitCode=0
Jul 17 18:20:23.148433 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:23.148008    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7573-140054093735232" event={"ID":"9b48e0b7-abe8-42d8-a8a5-3a210534dc00","Type":"ContainerDied","Data":"0265c7a7fc325f4f1e1a06af7639fa99e287eadb831167f3a5a8aa99ed5ce4a4"}
Jul 17 18:20:24.288836 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:24.288807    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7573-140054093735232"
Jul 17 18:20:24.338929 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:24.338898    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7573-140054093735232_9b48e0b7-abe8-42d8-a8a5-3a210534dc00/test-curl-7573-140054093735232/0.log"
Jul 17 18:20:24.362724 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:24.362688    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7573-140054093735232"]
Jul 17 18:20:24.366824 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:24.366795    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7573-140054093735232"]
Jul 17 18:20:24.375477 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:24.375452    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrcp5\" (UniqueName: \"kubernetes.io/projected/9b48e0b7-abe8-42d8-a8a5-3a210534dc00-kube-api-access-jrcp5\") pod \"9b48e0b7-abe8-42d8-a8a5-3a210534dc00\" (UID: \"9b48e0b7-abe8-42d8-a8a5-3a210534dc00\") "
Jul 17 18:20:24.377528 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:24.377502    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b48e0b7-abe8-42d8-a8a5-3a210534dc00-kube-api-access-jrcp5" (OuterVolumeSpecName: "kube-api-access-jrcp5") pod "9b48e0b7-abe8-42d8-a8a5-3a210534dc00" (UID: "9b48e0b7-abe8-42d8-a8a5-3a210534dc00"). InnerVolumeSpecName "kube-api-access-jrcp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:20:24.476783 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:24.476743    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrcp5\" (UniqueName: \"kubernetes.io/projected/9b48e0b7-abe8-42d8-a8a5-3a210534dc00-kube-api-access-jrcp5\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:20:24.522761 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:24.522728    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b48e0b7-abe8-42d8-a8a5-3a210534dc00" path="/var/lib/kubelet/pods/9b48e0b7-abe8-42d8-a8a5-3a210534dc00/volumes"
Jul 17 18:20:25.159858 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:25.159826    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7573-140054093735232"
Jul 17 18:20:25.160051 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:25.159852    2576 scope.go:117] "RemoveContainer" containerID="0265c7a7fc325f4f1e1a06af7639fa99e287eadb831167f3a5a8aa99ed5ce4a4"
Jul 17 18:20:25.283173 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:25.283128    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:20:27.333263 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:27.333227    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7573-140054093736240"]
Jul 17 18:20:27.333645 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:27.333603    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b48e0b7-abe8-42d8-a8a5-3a210534dc00" containerName="test-curl-7573-140054093735232"
Jul 17 18:20:27.333645 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:27.333614    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b48e0b7-abe8-42d8-a8a5-3a210534dc00" containerName="test-curl-7573-140054093735232"
Jul 17 18:20:27.333721 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:27.333687    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b48e0b7-abe8-42d8-a8a5-3a210534dc00" containerName="test-curl-7573-140054093735232"
Jul 17 18:20:27.338037 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:27.338019    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7573-140054093736240"
Jul 17 18:20:27.340748 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:27.340724    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hqwf7\""
Jul 17 18:20:27.341639 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:27.341612    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7573-140054093736240"]
Jul 17 18:20:27.503776 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:27.503735    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvck6\" (UniqueName: \"kubernetes.io/projected/017ae86a-c9d5-4c93-afd0-c8d62035f7ca-kube-api-access-gvck6\") pod \"test-curl-7573-140054093736240\" (UID: \"017ae86a-c9d5-4c93-afd0-c8d62035f7ca\") " pod="opendatahub/test-curl-7573-140054093736240"
Jul 17 18:20:27.605060 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:27.604964    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvck6\" (UniqueName: \"kubernetes.io/projected/017ae86a-c9d5-4c93-afd0-c8d62035f7ca-kube-api-access-gvck6\") pod \"test-curl-7573-140054093736240\" (UID: \"017ae86a-c9d5-4c93-afd0-c8d62035f7ca\") " pod="opendatahub/test-curl-7573-140054093736240"
Jul 17 18:20:27.614136 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:27.614096    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvck6\" (UniqueName: \"kubernetes.io/projected/017ae86a-c9d5-4c93-afd0-c8d62035f7ca-kube-api-access-gvck6\") pod \"test-curl-7573-140054093736240\" (UID: \"017ae86a-c9d5-4c93-afd0-c8d62035f7ca\") " pod="opendatahub/test-curl-7573-140054093736240"
Jul 17 18:20:27.648794 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:27.648757    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7573-140054093736240"
Jul 17 18:20:27.781896 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:27.781788    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7573-140054093736240"]
Jul 17 18:20:27.784406 ip-10-0-143-187 kubenswrapper[2576]: W0717 18:20:27.784377    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod017ae86a_c9d5_4c93_afd0_c8d62035f7ca.slice/crio-541da6dbd01f2b1e53ea315830146e47c202a8a07b66e6f30c39cd3ec8575249 WatchSource:0}: Error finding container 541da6dbd01f2b1e53ea315830146e47c202a8a07b66e6f30c39cd3ec8575249: Status 404 returned error can't find the container with id 541da6dbd01f2b1e53ea315830146e47c202a8a07b66e6f30c39cd3ec8575249
Jul 17 18:20:28.176987 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.176948    2576 generic.go:356] "Generic (PLEG): container finished" podID="017ae86a-c9d5-4c93-afd0-c8d62035f7ca" containerID="fee5d03922d603c19ca5d99e8585ac56cf031268afbb15d0cb3fc60388d96614" exitCode=0
Jul 17 18:20:28.177185 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.177039    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7573-140054093736240" event={"ID":"017ae86a-c9d5-4c93-afd0-c8d62035f7ca","Type":"ContainerDied","Data":"fee5d03922d603c19ca5d99e8585ac56cf031268afbb15d0cb3fc60388d96614"}
Jul 17 18:20:28.177185 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.177080    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7573-140054093736240" event={"ID":"017ae86a-c9d5-4c93-afd0-c8d62035f7ca","Type":"ContainerStarted","Data":"541da6dbd01f2b1e53ea315830146e47c202a8a07b66e6f30c39cd3ec8575249"}
Jul 17 18:20:28.469825 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.469787    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl" podUID="64c9fbc4-2774-4a9f-9de5-5c131d91bcdc" containerName="main" containerID="cri-o://ff15a9c022b22778388511293d476819646af1e9c4e5872b20c588f56aeabe7b" gracePeriod=45
Jul 17 18:20:28.716833 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.716806    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:20:28.817477 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.817391    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-tls-certs\") pod \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") "
Jul 17 18:20:28.817477 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.817444    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-model-cache\") pod \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") "
Jul 17 18:20:28.817699 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.817490    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-tmp-dir\") pod \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") "
Jul 17 18:20:28.817699 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.817551    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-home\") pod \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") "
Jul 17 18:20:28.817699 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.817573    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8557\" (UniqueName: \"kubernetes.io/projected/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-kube-api-access-c8557\") pod \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") "
Jul 17 18:20:28.817699 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.817618    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-dshm\") pod \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\" (UID: \"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc\") "
Jul 17 18:20:28.817910 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.817750    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-model-cache" (OuterVolumeSpecName: "model-cache") pod "64c9fbc4-2774-4a9f-9de5-5c131d91bcdc" (UID: "64c9fbc4-2774-4a9f-9de5-5c131d91bcdc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:20:28.817910 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.817824    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "64c9fbc4-2774-4a9f-9de5-5c131d91bcdc" (UID: "64c9fbc4-2774-4a9f-9de5-5c131d91bcdc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:20:28.817910 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.817840    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-home" (OuterVolumeSpecName: "home") pod "64c9fbc4-2774-4a9f-9de5-5c131d91bcdc" (UID: "64c9fbc4-2774-4a9f-9de5-5c131d91bcdc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:20:28.818080 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.817916    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-tmp-dir\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:20:28.818080 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.817936    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-home\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:20:28.818080 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.817951    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-model-cache\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:20:28.819654 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.819628    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "64c9fbc4-2774-4a9f-9de5-5c131d91bcdc" (UID: "64c9fbc4-2774-4a9f-9de5-5c131d91bcdc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:20:28.819766 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.819680    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-dshm" (OuterVolumeSpecName: "dshm") pod "64c9fbc4-2774-4a9f-9de5-5c131d91bcdc" (UID: "64c9fbc4-2774-4a9f-9de5-5c131d91bcdc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:20:28.819766 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.819727    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-kube-api-access-c8557" (OuterVolumeSpecName: "kube-api-access-c8557") pod "64c9fbc4-2774-4a9f-9de5-5c131d91bcdc" (UID: "64c9fbc4-2774-4a9f-9de5-5c131d91bcdc"). InnerVolumeSpecName "kube-api-access-c8557". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:20:28.918737 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.918705    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-dshm\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:20:28.918737 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.918735    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-tls-certs\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:20:28.918737 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:28.918746    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8557\" (UniqueName: \"kubernetes.io/projected/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc-kube-api-access-c8557\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:20:29.182679 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.182591    2576 generic.go:356] "Generic (PLEG): container finished" podID="64c9fbc4-2774-4a9f-9de5-5c131d91bcdc" containerID="ff15a9c022b22778388511293d476819646af1e9c4e5872b20c588f56aeabe7b" exitCode=0
Jul 17 18:20:29.182679 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.182631    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"
Jul 17 18:20:29.182679 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.182663    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl" event={"ID":"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc","Type":"ContainerDied","Data":"ff15a9c022b22778388511293d476819646af1e9c4e5872b20c588f56aeabe7b"}
Jul 17 18:20:29.182960 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.182694    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl" event={"ID":"64c9fbc4-2774-4a9f-9de5-5c131d91bcdc","Type":"ContainerDied","Data":"0df473978b56fc817f61c2eb0c9a4e8a5c0c9c7140d14519e50c573a12e06134"}
Jul 17 18:20:29.182960 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.182711    2576 scope.go:117] "RemoveContainer" containerID="ff15a9c022b22778388511293d476819646af1e9c4e5872b20c588f56aeabe7b"
Jul 17 18:20:29.192841 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.192816    2576 scope.go:117] "RemoveContainer" containerID="ff15a9c022b22778388511293d476819646af1e9c4e5872b20c588f56aeabe7b"
Jul 17 18:20:29.193122 ip-10-0-143-187 kubenswrapper[2576]: E0717 18:20:29.193100    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff15a9c022b22778388511293d476819646af1e9c4e5872b20c588f56aeabe7b\": container with ID starting with ff15a9c022b22778388511293d476819646af1e9c4e5872b20c588f56aeabe7b not found: ID does not exist" containerID="ff15a9c022b22778388511293d476819646af1e9c4e5872b20c588f56aeabe7b"
Jul 17 18:20:29.193211 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.193132    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff15a9c022b22778388511293d476819646af1e9c4e5872b20c588f56aeabe7b"} err="failed to get container status \"ff15a9c022b22778388511293d476819646af1e9c4e5872b20c588f56aeabe7b\": rpc error: code = NotFound desc = could not find container \"ff15a9c022b22778388511293d476819646af1e9c4e5872b20c588f56aeabe7b\": container with ID starting with ff15a9c022b22778388511293d476819646af1e9c4e5872b20c588f56aeabe7b not found: ID does not exist"
Jul 17 18:20:29.203531 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.203156    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4" podUID="21e07027-c3b4-4b22-ab32-74787c0db1ee" containerName="main" containerID="cri-o://3a333fb51f4660d09a73cc9554c78581131ec4b5e798a040b6b12ba9d7f67e9c" gracePeriod=45
Jul 17 18:20:29.205642 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.205609    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"]
Jul 17 18:20:29.209420 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.209395    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4699ff/rate-test-model-4699ff-kserve-75677488b7-8jxsl"]
Jul 17 18:20:29.315814 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.315789    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7573-140054093736240"
Jul 17 18:20:29.336482 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.336442    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7573-140054093736240_017ae86a-c9d5-4c93-afd0-c8d62035f7ca/test-curl-7573-140054093736240/0.log"
Jul 17 18:20:29.361483 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.361448    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7573-140054093736240"]
Jul 17 18:20:29.364351 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.364323    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7573-140054093736240"]
Jul 17 18:20:29.423528 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.423496    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvck6\" (UniqueName: \"kubernetes.io/projected/017ae86a-c9d5-4c93-afd0-c8d62035f7ca-kube-api-access-gvck6\") pod \"017ae86a-c9d5-4c93-afd0-c8d62035f7ca\" (UID: \"017ae86a-c9d5-4c93-afd0-c8d62035f7ca\") "
Jul 17 18:20:29.426012 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.425977    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/017ae86a-c9d5-4c93-afd0-c8d62035f7ca-kube-api-access-gvck6" (OuterVolumeSpecName: "kube-api-access-gvck6") pod "017ae86a-c9d5-4c93-afd0-c8d62035f7ca" (UID: "017ae86a-c9d5-4c93-afd0-c8d62035f7ca"). InnerVolumeSpecName "kube-api-access-gvck6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:20:29.454038 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.454016    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:20:29.480830 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.480799    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7573-140054093736240"]
Jul 17 18:20:29.481355 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.481336    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="017ae86a-c9d5-4c93-afd0-c8d62035f7ca" containerName="test-curl-7573-140054093736240"
Jul 17 18:20:29.481468 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.481358    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="017ae86a-c9d5-4c93-afd0-c8d62035f7ca" containerName="test-curl-7573-140054093736240"
Jul 17 18:20:29.481468 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.481373    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21e07027-c3b4-4b22-ab32-74787c0db1ee" containerName="main"
Jul 17 18:20:29.481468 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.481382    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="21e07027-c3b4-4b22-ab32-74787c0db1ee" containerName="main"
Jul 17 18:20:29.481468 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.481405    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64c9fbc4-2774-4a9f-9de5-5c131d91bcdc" containerName="main"
Jul 17 18:20:29.481468 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.481415    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="64c9fbc4-2774-4a9f-9de5-5c131d91bcdc" containerName="main"
Jul 17 18:20:29.481708 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.481516    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="21e07027-c3b4-4b22-ab32-74787c0db1ee" containerName="main"
Jul 17 18:20:29.481708 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.481532    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="017ae86a-c9d5-4c93-afd0-c8d62035f7ca" containerName="test-curl-7573-140054093736240"
Jul 17 18:20:29.481708 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.481543    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="64c9fbc4-2774-4a9f-9de5-5c131d91bcdc" containerName="main"
Jul 17 18:20:29.484470 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.484446    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7573-140054093736240"
Jul 17 18:20:29.488071 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.488043    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7573-140054093736240"]
Jul 17 18:20:29.524065 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.524032    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvck6\" (UniqueName: \"kubernetes.io/projected/017ae86a-c9d5-4c93-afd0-c8d62035f7ca-kube-api-access-gvck6\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:20:29.624487 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.624458    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgmdh\" (UniqueName: \"kubernetes.io/projected/21e07027-c3b4-4b22-ab32-74787c0db1ee-kube-api-access-bgmdh\") pod \"21e07027-c3b4-4b22-ab32-74787c0db1ee\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") "
Jul 17 18:20:29.624605 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.624547    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-model-cache\") pod \"21e07027-c3b4-4b22-ab32-74787c0db1ee\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") "
Jul 17 18:20:29.624605 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.624598    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-home\") pod \"21e07027-c3b4-4b22-ab32-74787c0db1ee\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") "
Jul 17 18:20:29.624739 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.624620    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-tmp-dir\") pod \"21e07027-c3b4-4b22-ab32-74787c0db1ee\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") "
Jul 17 18:20:29.624739 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.624666    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21e07027-c3b4-4b22-ab32-74787c0db1ee-tls-certs\") pod \"21e07027-c3b4-4b22-ab32-74787c0db1ee\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") "
Jul 17 18:20:29.624739 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.624692    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-dshm\") pod \"21e07027-c3b4-4b22-ab32-74787c0db1ee\" (UID: \"21e07027-c3b4-4b22-ab32-74787c0db1ee\") "
Jul 17 18:20:29.624916 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.624890    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-home" (OuterVolumeSpecName: "home") pod "21e07027-c3b4-4b22-ab32-74787c0db1ee" (UID: "21e07027-c3b4-4b22-ab32-74787c0db1ee"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:20:29.625218 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.625132    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "21e07027-c3b4-4b22-ab32-74787c0db1ee" (UID: "21e07027-c3b4-4b22-ab32-74787c0db1ee"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:20:29.625624 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.625598    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-model-cache" (OuterVolumeSpecName: "model-cache") pod "21e07027-c3b4-4b22-ab32-74787c0db1ee" (UID: "21e07027-c3b4-4b22-ab32-74787c0db1ee"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:20:29.627207 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.627048    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcbwt\" (UniqueName: \"kubernetes.io/projected/24acc09b-dba0-4985-a965-ee01c8991dc7-kube-api-access-jcbwt\") pod \"test-curl-7573-140054093736240\" (UID: \"24acc09b-dba0-4985-a965-ee01c8991dc7\") " pod="opendatahub/test-curl-7573-140054093736240"
Jul 17 18:20:29.627689 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.627668    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-model-cache\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:20:29.627771 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.627707    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-home\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:20:29.627835 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.627722    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-tmp-dir\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:20:29.633300 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.633157    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21e07027-c3b4-4b22-ab32-74787c0db1ee-kube-api-access-bgmdh" (OuterVolumeSpecName: "kube-api-access-bgmdh") pod "21e07027-c3b4-4b22-ab32-74787c0db1ee" (UID: "21e07027-c3b4-4b22-ab32-74787c0db1ee"). InnerVolumeSpecName "kube-api-access-bgmdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:20:29.633406 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.633333    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21e07027-c3b4-4b22-ab32-74787c0db1ee-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "21e07027-c3b4-4b22-ab32-74787c0db1ee" (UID: "21e07027-c3b4-4b22-ab32-74787c0db1ee"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:20:29.633569 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.633549    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-dshm" (OuterVolumeSpecName: "dshm") pod "21e07027-c3b4-4b22-ab32-74787c0db1ee" (UID: "21e07027-c3b4-4b22-ab32-74787c0db1ee"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:20:29.728533 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.728488    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcbwt\" (UniqueName: \"kubernetes.io/projected/24acc09b-dba0-4985-a965-ee01c8991dc7-kube-api-access-jcbwt\") pod \"test-curl-7573-140054093736240\" (UID: \"24acc09b-dba0-4985-a965-ee01c8991dc7\") " pod="opendatahub/test-curl-7573-140054093736240"
Jul 17 18:20:29.728726 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.728638    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21e07027-c3b4-4b22-ab32-74787c0db1ee-tls-certs\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:20:29.728726 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.728654    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21e07027-c3b4-4b22-ab32-74787c0db1ee-dshm\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:20:29.728726 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.728666    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgmdh\" (UniqueName: \"kubernetes.io/projected/21e07027-c3b4-4b22-ab32-74787c0db1ee-kube-api-access-bgmdh\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:20:29.737892 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.737861    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcbwt\" (UniqueName: \"kubernetes.io/projected/24acc09b-dba0-4985-a965-ee01c8991dc7-kube-api-access-jcbwt\") pod \"test-curl-7573-140054093736240\" (UID: \"24acc09b-dba0-4985-a965-ee01c8991dc7\") " pod="opendatahub/test-curl-7573-140054093736240"
Jul 17 18:20:29.794802 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.794747    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7573-140054093736240"
Jul 17 18:20:29.929922 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:29.929894    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7573-140054093736240"]
Jul 17 18:20:29.931982 ip-10-0-143-187 kubenswrapper[2576]: W0717 18:20:29.931958    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24acc09b_dba0_4985_a965_ee01c8991dc7.slice/crio-394587c5472529eb1530998c2faec986ac0f44fc8f3b5060a2ced44f49624deb WatchSource:0}: Error finding container 394587c5472529eb1530998c2faec986ac0f44fc8f3b5060a2ced44f49624deb: Status 404 returned error can't find the container with id 394587c5472529eb1530998c2faec986ac0f44fc8f3b5060a2ced44f49624deb
Jul 17 18:20:30.188501 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:30.188403    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7573-140054093736240"
Jul 17 18:20:30.188501 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:30.188407    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="541da6dbd01f2b1e53ea315830146e47c202a8a07b66e6f30c39cd3ec8575249"
Jul 17 18:20:30.189823 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:30.189788    2576 generic.go:356] "Generic (PLEG): container finished" podID="21e07027-c3b4-4b22-ab32-74787c0db1ee" containerID="3a333fb51f4660d09a73cc9554c78581131ec4b5e798a040b6b12ba9d7f67e9c" exitCode=0
Jul 17 18:20:30.189962 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:30.189846    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"
Jul 17 18:20:30.189962 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:30.189867    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4" event={"ID":"21e07027-c3b4-4b22-ab32-74787c0db1ee","Type":"ContainerDied","Data":"3a333fb51f4660d09a73cc9554c78581131ec4b5e798a040b6b12ba9d7f67e9c"}
Jul 17 18:20:30.189962 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:30.189916    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4" event={"ID":"21e07027-c3b4-4b22-ab32-74787c0db1ee","Type":"ContainerDied","Data":"85bdcb231e96c9d22a548b2a72a8eb4fc02c7167c4e42af4371f169e90652068"}
Jul 17 18:20:30.189962 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:30.189939    2576 scope.go:117] "RemoveContainer" containerID="3a333fb51f4660d09a73cc9554c78581131ec4b5e798a040b6b12ba9d7f67e9c"
Jul 17 18:20:30.192433 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:30.192404    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7573-140054093736240" event={"ID":"24acc09b-dba0-4985-a965-ee01c8991dc7","Type":"ContainerStarted","Data":"394587c5472529eb1530998c2faec986ac0f44fc8f3b5060a2ced44f49624deb"}
Jul 17 18:20:30.199453 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:30.199419    2576 scope.go:117] "RemoveContainer" containerID="3a333fb51f4660d09a73cc9554c78581131ec4b5e798a040b6b12ba9d7f67e9c"
Jul 17 18:20:30.199720 ip-10-0-143-187 kubenswrapper[2576]: E0717 18:20:30.199700    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a333fb51f4660d09a73cc9554c78581131ec4b5e798a040b6b12ba9d7f67e9c\": container with ID starting with 3a333fb51f4660d09a73cc9554c78581131ec4b5e798a040b6b12ba9d7f67e9c not found: ID does not exist" containerID="3a333fb51f4660d09a73cc9554c78581131ec4b5e798a040b6b12ba9d7f67e9c"
Jul 17 18:20:30.199800 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:30.199728    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a333fb51f4660d09a73cc9554c78581131ec4b5e798a040b6b12ba9d7f67e9c"} err="failed to get container status \"3a333fb51f4660d09a73cc9554c78581131ec4b5e798a040b6b12ba9d7f67e9c\": rpc error: code = NotFound desc = could not find container \"3a333fb51f4660d09a73cc9554c78581131ec4b5e798a040b6b12ba9d7f67e9c\": container with ID starting with 3a333fb51f4660d09a73cc9554c78581131ec4b5e798a040b6b12ba9d7f67e9c not found: ID does not exist"
Jul 17 18:20:30.204820 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:30.204791    2576 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7573-140054093736240" oldPodUID="017ae86a-c9d5-4c93-afd0-c8d62035f7ca" podUID="24acc09b-dba0-4985-a965-ee01c8991dc7"
Jul 17 18:20:30.216985 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:30.216962    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"]
Jul 17 18:20:30.221510 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:30.221487    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-22fb10/rate-test-model-22fb10-kserve-5d45847847-ltrh4"]
Jul 17 18:20:30.522625 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:30.522583    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="017ae86a-c9d5-4c93-afd0-c8d62035f7ca" path="/var/lib/kubelet/pods/017ae86a-c9d5-4c93-afd0-c8d62035f7ca/volumes"
Jul 17 18:20:30.523003 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:30.522969    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21e07027-c3b4-4b22-ab32-74787c0db1ee" path="/var/lib/kubelet/pods/21e07027-c3b4-4b22-ab32-74787c0db1ee/volumes"
Jul 17 18:20:30.523323 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:30.523309    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64c9fbc4-2774-4a9f-9de5-5c131d91bcdc" path="/var/lib/kubelet/pods/64c9fbc4-2774-4a9f-9de5-5c131d91bcdc/volumes"
Jul 17 18:20:31.198580 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:31.198545    2576 generic.go:356] "Generic (PLEG): container finished" podID="24acc09b-dba0-4985-a965-ee01c8991dc7" containerID="c9754d2b20fd7accaaebd1ceb615306b878f35382fa43d504dc4d26a5a3effaf" exitCode=0
Jul 17 18:20:31.198734 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:31.198604    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7573-140054093736240" event={"ID":"24acc09b-dba0-4985-a965-ee01c8991dc7","Type":"ContainerDied","Data":"c9754d2b20fd7accaaebd1ceb615306b878f35382fa43d504dc4d26a5a3effaf"}
Jul 17 18:20:32.344051 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:32.344016    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7573-140054093736240"
Jul 17 18:20:32.351618 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:32.351591    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcbwt\" (UniqueName: \"kubernetes.io/projected/24acc09b-dba0-4985-a965-ee01c8991dc7-kube-api-access-jcbwt\") pod \"24acc09b-dba0-4985-a965-ee01c8991dc7\" (UID: \"24acc09b-dba0-4985-a965-ee01c8991dc7\") "
Jul 17 18:20:32.353645 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:32.353616    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24acc09b-dba0-4985-a965-ee01c8991dc7-kube-api-access-jcbwt" (OuterVolumeSpecName: "kube-api-access-jcbwt") pod "24acc09b-dba0-4985-a965-ee01c8991dc7" (UID: "24acc09b-dba0-4985-a965-ee01c8991dc7"). InnerVolumeSpecName "kube-api-access-jcbwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:20:32.364308 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:32.364282    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7573-140054093736240_24acc09b-dba0-4985-a965-ee01c8991dc7/test-curl-7573-140054093736240/0.log"
Jul 17 18:20:32.386486 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:32.386448    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7573-140054093736240"]
Jul 17 18:20:32.392809 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:32.392778    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7573-140054093736240"]
Jul 17 18:20:32.452613 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:32.452587    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcbwt\" (UniqueName: \"kubernetes.io/projected/24acc09b-dba0-4985-a965-ee01c8991dc7-kube-api-access-jcbwt\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\""
Jul 17 18:20:32.522326 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:32.522293    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24acc09b-dba0-4985-a965-ee01c8991dc7" path="/var/lib/kubelet/pods/24acc09b-dba0-4985-a965-ee01c8991dc7/volumes"
Jul 17 18:20:33.216421 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:33.216389    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7573-140054093736240"
Jul 17 18:20:33.216627 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:33.216430    2576 scope.go:117] "RemoveContainer" containerID="c9754d2b20fd7accaaebd1ceb615306b878f35382fa43d504dc4d26a5a3effaf"
Jul 17 18:20:46.686314 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:20:46.686275    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:21:12.582066 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:12.582030    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-82xqb"]
Jul 17 18:21:30.469134 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:30.469096    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-c8lx8_8ed9660b-3c7c-4ec6-a4ab-9f8bd5730ec3/manager/0.log"
Jul 17 18:21:30.584228 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:30.584193    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-bxx5j_96f67c09-4757-4c92-86e6-dcb0eea52a41/manager/0.log"
Jul 17 18:21:30.809730 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:30.809655    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lv4nm_20b6149a-0774-47af-bcff-b5a61d9abef1/server/0.log"
Jul 17 18:21:30.923682 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:30.923654    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fjmjn_57c93eef-4752-4139-a123-9377a3661828/manager/0.log"
Jul 17 18:21:31.153954 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:31.153878    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cbb795d5f-7p7kx_580be012-2cdd-49c6-8b3b-6bbd8390019d/copy-manifests/0.log"
Jul 17 18:21:31.166744 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:31.166718    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cbb795d5f-7p7kx_580be012-2cdd-49c6-8b3b-6bbd8390019d/manager/0.log"
Jul 17 18:21:34.705323 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:34.705287    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2whvn_1051965d-3105-43ca-aa22-ee952a261453/manager/0.log"
Jul 17 18:21:34.809176 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:34.809144    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6d4ql_5a217bc6-7a38-4c8e-a37b-b75cf455f900/manager/0.log"
Jul 17 18:21:34.918577 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:34.918543    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-5zwd5_5905f3f2-d347-4590-a388-b3ba2fe36582/kuadrant-console-plugin/0.log"
Jul 17 18:21:35.033198 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:35.033159    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zchwr_2d1dbbde-1738-4957-80cc-4d1d21d6e445/registry-server/0.log"
Jul 17 18:21:35.273476 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:35.273446    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-82xqb_e5a96088-6bc2-444b-9610-a998b5491952/limitador/0.log"
Jul 17 18:21:35.384843 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:35.384763    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-q2ggh_008bb7e2-addb-45ca-be58-ac0aa377f3c1/manager/0.log"
Jul 17 18:21:35.948080 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:35.948050    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d88846968-bmt5v_bcb137bf-21c7-46e1-acce-c6fe80aa6e23/kube-auth-proxy/0.log"
Jul 17 18:21:36.525478 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:36.525443    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ccd4cd878-b9n7t_53a3cf11-c213-41a8-9f95-0c1563f42f3a/router/0.log"
Jul 17 18:21:36.995722 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:36.995697    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-6vhmb_b37e3613-8f48-43b7-b644-43d45f349c55/main/0.log"
Jul 17 18:21:37.111797 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:37.111762    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-44mmc_3cdb3f67-8dc6-4709-a4df-51fe084164a1/main/0.log"
Jul 17 18:21:37.229592 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:37.229566    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvqx96_90db9070-4e87-4fb7-bd26-8701e41abc3b/main/0.log"
Jul 17 18:21:37.340633 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:37.340555    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-rk6ld_27357e2d-7fc9-4f6d-a1b9-a8ba5929368d/main/0.log"
Jul 17 18:21:45.871848 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:45.871813    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jdnds_9bed4dab-7c99-4599-b607-55672af77505/global-pull-secret-syncer/0.log"
Jul 17 18:21:45.998581 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:45.998548    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gtwmn_5acd1016-b254-462d-bccd-bcf5f1f69e61/konnectivity-agent/0.log"
Jul 17 18:21:46.097799 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:46.097769    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-187.ec2.internal_055b2da4f7f1fd6f00b0fe6f11d1c89c/haproxy/0.log"
Jul 17 18:21:51.194499 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:51.194448    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2whvn_1051965d-3105-43ca-aa22-ee952a261453/manager/0.log"
Jul 17 18:21:51.238456 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:51.238432    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6d4ql_5a217bc6-7a38-4c8e-a37b-b75cf455f900/manager/0.log"
Jul 17 18:21:51.271125 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:51.271098    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-5zwd5_5905f3f2-d347-4590-a388-b3ba2fe36582/kuadrant-console-plugin/0.log"
Jul 17 18:21:51.315298 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:51.315269    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zchwr_2d1dbbde-1738-4957-80cc-4d1d21d6e445/registry-server/0.log"
Jul 17 18:21:51.453635 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:51.453553    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-82xqb_e5a96088-6bc2-444b-9610-a998b5491952/limitador/0.log"
Jul 17 18:21:51.513074 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:51.513045    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-q2ggh_008bb7e2-addb-45ca-be58-ac0aa377f3c1/manager/0.log"
Jul 17 18:21:53.355680 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:53.355649    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cqgrw_5a852985-eef4-45f9-88da-2373e6404a22/node-exporter/0.log"
Jul 17 18:21:53.394263 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:53.394236    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cqgrw_5a852985-eef4-45f9-88da-2373e6404a22/kube-rbac-proxy/0.log"
Jul 17 18:21:53.416309 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:53.416285    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cqgrw_5a852985-eef4-45f9-88da-2373e6404a22/init-textfile/0.log"
Jul 17 18:21:56.249057 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.249024    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2"]
Jul 17 18:21:56.249479 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.249383    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24acc09b-dba0-4985-a965-ee01c8991dc7" containerName="test-curl-7573-140054093736240"
Jul 17 18:21:56.249479 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.249396    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="24acc09b-dba0-4985-a965-ee01c8991dc7" containerName="test-curl-7573-140054093736240"
Jul 17 18:21:56.249479 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.249456    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="24acc09b-dba0-4985-a965-ee01c8991dc7" containerName="test-curl-7573-140054093736240"
Jul 17 18:21:56.252431 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.252408    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2"
Jul 17 18:21:56.255054 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.255027    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5g29d\"/\"kube-root-ca.crt\""
Jul 17 18:21:56.255206 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.255063    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5g29d\"/\"openshift-service-ca.crt\""
Jul 17 18:21:56.256123 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.256109    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5g29d\"/\"default-dockercfg-rgpp8\""
Jul 17 18:21:56.265331 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.265300    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2"]
Jul 17 18:21:56.270610 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.270578    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95063b79-2274-4d82-bb83-2f9433aa4b1d-lib-modules\") pod \"perf-node-gather-daemonset-46wv2\" (UID: \"95063b79-2274-4d82-bb83-2f9433aa4b1d\") " pod="openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2"
Jul 17 18:21:56.270735 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.270693    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnnp7\" (UniqueName: \"kubernetes.io/projected/95063b79-2274-4d82-bb83-2f9433aa4b1d-kube-api-access-dnnp7\") pod \"perf-node-gather-daemonset-46wv2\" (UID: \"95063b79-2274-4d82-bb83-2f9433aa4b1d\") " pod="openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2"
Jul 17 18:21:56.270803 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.270756    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95063b79-2274-4d82-bb83-2f9433aa4b1d-podres\") pod \"perf-node-gather-daemonset-46wv2\" (UID: \"95063b79-2274-4d82-bb83-2f9433aa4b1d\") " pod="openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2"
Jul 17 18:21:56.270861 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.270811    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95063b79-2274-4d82-bb83-2f9433aa4b1d-sys\") pod \"perf-node-gather-daemonset-46wv2\" (UID: \"95063b79-2274-4d82-bb83-2f9433aa4b1d\") " pod="openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2"
Jul 17 18:21:56.270861 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.270842    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95063b79-2274-4d82-bb83-2f9433aa4b1d-proc\") pod \"perf-node-gather-daemonset-46wv2\" (UID: \"95063b79-2274-4d82-bb83-2f9433aa4b1d\") " pod="openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2"
Jul 17 18:21:56.372212 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.372155    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95063b79-2274-4d82-bb83-2f9433aa4b1d-lib-modules\") pod \"perf-node-gather-daemonset-46wv2\" (UID: \"95063b79-2274-4d82-bb83-2f9433aa4b1d\") " pod="openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2"
Jul 17 18:21:56.372372 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.372243    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnnp7\" (UniqueName: \"kubernetes.io/projected/95063b79-2274-4d82-bb83-2f9433aa4b1d-kube-api-access-dnnp7\") pod \"perf-node-gather-daemonset-46wv2\" (UID: \"95063b79-2274-4d82-bb83-2f9433aa4b1d\") " pod="openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2"
Jul 17 18:21:56.372372 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.372271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95063b79-2274-4d82-bb83-2f9433aa4b1d-podres\") pod \"perf-node-gather-daemonset-46wv2\" (UID: \"95063b79-2274-4d82-bb83-2f9433aa4b1d\") " pod="openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2"
Jul 17 18:21:56.372372 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.372291    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95063b79-2274-4d82-bb83-2f9433aa4b1d-lib-modules\") pod \"perf-node-gather-daemonset-46wv2\" (UID: \"95063b79-2274-4d82-bb83-2f9433aa4b1d\") " pod="openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2"
Jul 17 18:21:56.372372 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.372298    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95063b79-2274-4d82-bb83-2f9433aa4b1d-sys\") pod \"perf-node-gather-daemonset-46wv2\" (UID: \"95063b79-2274-4d82-bb83-2f9433aa4b1d\") " pod="openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2"
Jul 17 18:21:56.372372 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.372335    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95063b79-2274-4d82-bb83-2f9433aa4b1d-proc\") pod \"perf-node-gather-daemonset-46wv2\" (UID: \"95063b79-2274-4d82-bb83-2f9433aa4b1d\") " pod="openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2"
Jul 17 18:21:56.372538 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.372400    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/95063b79-2274-4d82-bb83-2f9433aa4b1d-podres\") pod \"perf-node-gather-daemonset-46wv2\" (UID: \"95063b79-2274-4d82-bb83-2f9433aa4b1d\") " pod="openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2"
Jul 17 18:21:56.372538 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.372442    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/95063b79-2274-4d82-bb83-2f9433aa4b1d-proc\") pod \"perf-node-gather-daemonset-46wv2\" (UID: \"95063b79-2274-4d82-bb83-2f9433aa4b1d\") " pod="openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2"
Jul 17 18:21:56.372538 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.372442    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95063b79-2274-4d82-bb83-2f9433aa4b1d-sys\") pod \"perf-node-gather-daemonset-46wv2\" (UID: \"95063b79-2274-4d82-bb83-2f9433aa4b1d\") " pod="openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2"
Jul 17 18:21:56.380679 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.380652    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnnp7\" (UniqueName: \"kubernetes.io/projected/95063b79-2274-4d82-bb83-2f9433aa4b1d-kube-api-access-dnnp7\") pod \"perf-node-gather-daemonset-46wv2\" (UID: \"95063b79-2274-4d82-bb83-2f9433aa4b1d\") " pod="openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2"
Jul 17 18:21:56.564730 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.564644    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2"
Jul 17 18:21:56.695645 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:56.695566    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2"]
Jul 17 18:21:56.697962 ip-10-0-143-187 kubenswrapper[2576]: W0717 18:21:56.697927    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod95063b79_2274_4d82_bb83_2f9433aa4b1d.slice/crio-4377fe874e82340cab40f26363ee55c42874dd1375c30fcb76485da156a14761 WatchSource:0}: Error finding container 4377fe874e82340cab40f26363ee55c42874dd1375c30fcb76485da156a14761: Status 404 returned error can't find the container with id 4377fe874e82340cab40f26363ee55c42874dd1375c30fcb76485da156a14761
Jul 17 18:21:57.625509 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:57.625461    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2" event={"ID":"95063b79-2274-4d82-bb83-2f9433aa4b1d","Type":"ContainerStarted","Data":"aca465c541324139cfedecc806dd5ea262dae0e48ef341791fbeb2f99164ab1f"}
Jul 17 18:21:57.625962 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:57.625532    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2" event={"ID":"95063b79-2274-4d82-bb83-2f9433aa4b1d","Type":"ContainerStarted","Data":"4377fe874e82340cab40f26363ee55c42874dd1375c30fcb76485da156a14761"}
Jul 17 18:21:57.625962 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:57.625566    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2"
Jul 17 18:21:57.643860 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:57.643811    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2" podStartSLOduration=1.643794761 podStartE2EDuration="1.643794761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:21:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:21:57.643607087 +0000 UTC m=+3467.662383687" watchObservedRunningTime="2026-07-17 18:21:57.643794761 +0000 UTC m=+3467.662571359"
Jul 17 18:21:58.767952 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:58.767923    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b6srd_8b45e0ab-c974-4125-af1b-72d77697f266/dns/0.log"
Jul 17 18:21:58.791785 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:58.791751    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b6srd_8b45e0ab-c974-4125-af1b-72d77697f266/kube-rbac-proxy/0.log"
Jul 17 18:21:58.913264 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:58.913238    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v5dfj_ea0cda67-da14-493a-b32a-f40756867f5e/dns-node-resolver/0.log"
Jul 17 18:21:59.428752 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:59.428701    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59ccb7fcdd-gp8dc_c8031931-8203-48d0-8c47-25412b3d89a6/registry/0.log"
Jul 17 18:21:59.450733 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:21:59.450705    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4wnph_a3c90559-497c-41f7-9dfd-0a038dec0c80/node-ca/0.log"
Jul 17 18:22:00.598728 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:00.598700    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d88846968-bmt5v_bcb137bf-21c7-46e1-acce-c6fe80aa6e23/kube-auth-proxy/0.log"
Jul 17 18:22:00.779404 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:00.779376    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ccd4cd878-b9n7t_53a3cf11-c213-41a8-9f95-0c1563f42f3a/router/0.log"
Jul 17 18:22:01.537945 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:01.537913    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hndwr_dea89e0b-2f80-4f56-a41b-707e580fca42/serve-healthcheck-canary/0.log"
Jul 17 18:22:02.277353 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:02.277319    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pvr5x_3476683f-19c4-4cbd-92c6-40968a1250dc/kube-rbac-proxy/0.log"
Jul 17 18:22:02.301380 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:02.301346    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pvr5x_3476683f-19c4-4cbd-92c6-40968a1250dc/exporter/0.log"
Jul 17 18:22:02.324332 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:02.324304    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pvr5x_3476683f-19c4-4cbd-92c6-40968a1250dc/extractor/0.log"
Jul 17 18:22:03.639343 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:03.639305    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5g29d/perf-node-gather-daemonset-46wv2"
Jul 17 18:22:04.457633 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:04.457603    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-c8lx8_8ed9660b-3c7c-4ec6-a4ab-9f8bd5730ec3/manager/0.log"
Jul 17 18:22:04.598741 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:04.598699    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-bxx5j_96f67c09-4757-4c92-86e6-dcb0eea52a41/manager/0.log"
Jul 17 18:22:04.767992 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:04.767911    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lv4nm_20b6149a-0774-47af-bcff-b5a61d9abef1/server/0.log"
Jul 17 18:22:04.837474 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:04.837440    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fjmjn_57c93eef-4752-4139-a123-9377a3661828/manager/0.log"
Jul 17 18:22:04.974907 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:04.974873    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cbb795d5f-7p7kx_580be012-2cdd-49c6-8b3b-6bbd8390019d/manager/0.log"
Jul 17 18:22:04.994059 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:04.994036    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cbb795d5f-7p7kx_580be012-2cdd-49c6-8b3b-6bbd8390019d/copy-manifests/0.log"
Jul 17 18:22:06.345415 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:06.345389    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d88846968-bmt5v_bcb137bf-21c7-46e1-acce-c6fe80aa6e23/kube-auth-proxy/0.log"
Jul 17 18:22:06.476365 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:06.476336    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ccd4cd878-b9n7t_53a3cf11-c213-41a8-9f95-0c1563f42f3a/router/0.log"
Jul 17 18:22:07.760509 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:07.760478    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d88846968-bmt5v_bcb137bf-21c7-46e1-acce-c6fe80aa6e23/kube-auth-proxy/0.log"
Jul 17 18:22:07.903862 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:07.903834    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ccd4cd878-b9n7t_53a3cf11-c213-41a8-9f95-0c1563f42f3a/router/0.log"
Jul 17 18:22:11.775054 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:11.775022    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-lldq2_ad6bf2ef-6b2a-44dd-97c2-8f06ddc2ad82/migrator/0.log"
Jul 17 18:22:11.800623 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:11.800590    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-lldq2_ad6bf2ef-6b2a-44dd-97c2-8f06ddc2ad82/graceful-termination/0.log"
Jul 17 18:22:12.160734 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:12.160651    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-jbhqq_8589fbe7-8408-49d1-9197-bc82c6f3c7c4/kube-storage-version-migrator-operator/1.log"
Jul 17 18:22:12.161693 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:12.161673    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-jbhqq_8589fbe7-8408-49d1-9197-bc82c6f3c7c4/kube-storage-version-migrator-operator/0.log"
Jul 17 18:22:13.175477 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:13.175443    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8zqpl_9ad9862b-5fb6-4754-8e61-5f8fa0776be0/kube-multus/0.log"
Jul 17 18:22:13.199095 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:13.199064    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-59gm6_d6ad5407-4bb0-47b4-8f15-6c82b11d50c5/kube-multus-additional-cni-plugins/0.log"
Jul 17 18:22:13.223769 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:13.223736    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-59gm6_d6ad5407-4bb0-47b4-8f15-6c82b11d50c5/egress-router-binary-copy/0.log"
Jul 17 18:22:13.250934 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:13.250899    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-59gm6_d6ad5407-4bb0-47b4-8f15-6c82b11d50c5/cni-plugins/0.log"
Jul 17 18:22:13.278322 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:13.278296    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-59gm6_d6ad5407-4bb0-47b4-8f15-6c82b11d50c5/bond-cni-plugin/0.log"
Jul 17 18:22:13.301351 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:13.301324    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-59gm6_d6ad5407-4bb0-47b4-8f15-6c82b11d50c5/routeoverride-cni/0.log"
Jul 17 18:22:13.325057 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:13.325023    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-59gm6_d6ad5407-4bb0-47b4-8f15-6c82b11d50c5/whereabouts-cni-bincopy/0.log"
Jul 17 18:22:13.362094 ip-10-0-143-187 kubenswrapper[2576]: I0717 18:22:13.362056    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-59gm6_d6ad5407-4bb0-47b4-8f15-6c82b11d50c5/whereabouts-cni/0.log"