Jul 15 20:57:17.101009 ip-10-0-130-134 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 15 20:57:17.101025 ip-10-0-130-134 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 15 20:57:17.101036 ip-10-0-130-134 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 15 20:57:17.101366 ip-10-0-130-134 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 15 20:57:26.770663 ip-10-0-130-134 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 15 20:57:26.770680 ip-10-0-130-134 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 3f387bd1f9154ef79bb2fdfe20237ec5 --
Jul 15 20:59:09.906304 ip-10-0-130-134 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 20:59:13.381856 ip-10-0-130-134 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 20:59:13.381856 ip-10-0-130-134 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 20:59:13.381856 ip-10-0-130-134 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 20:59:13.381856 ip-10-0-130-134 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 20:59:13.381856 ip-10-0-130-134 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 20:59:13.383269 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.383112    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 20:59:13.386880 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386858    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 20:59:13.386880 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386875    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 20:59:13.386880 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386880    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 20:59:13.386880 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386884    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 20:59:13.386880 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386888    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 20:59:13.387182 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386893    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 20:59:13.387182 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386899    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 20:59:13.387182 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386903    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 20:59:13.387182 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386907    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 20:59:13.387182 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386910    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 20:59:13.387182 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386914    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 20:59:13.387182 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386917    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 20:59:13.387182 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386922    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 20:59:13.387182 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386925    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 20:59:13.387182 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386929    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 20:59:13.387182 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386933    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 20:59:13.387182 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386937    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 20:59:13.387182 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386941    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 20:59:13.387182 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386945    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 20:59:13.387182 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386949    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 20:59:13.387182 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386953    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 20:59:13.387182 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386957    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 20:59:13.387182 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386961    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 20:59:13.387182 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386965    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 20:59:13.387182 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386969    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 20:59:13.387903 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386974    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 20:59:13.387903 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386980    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 20:59:13.387903 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386984    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 20:59:13.387903 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386987    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 20:59:13.387903 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386991    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 20:59:13.387903 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.386996    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 20:59:13.387903 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387000    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 20:59:13.387903 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387003    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 20:59:13.387903 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387007    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 20:59:13.387903 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387011    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 20:59:13.387903 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387018    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 20:59:13.387903 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387024    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 20:59:13.387903 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387029    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 20:59:13.387903 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387041    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 20:59:13.387903 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387046    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 20:59:13.387903 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387050    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 20:59:13.387903 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387057    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 20:59:13.387903 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387062    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 20:59:13.387903 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387066    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 20:59:13.388410 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387072    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 20:59:13.388410 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387076    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 20:59:13.388410 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387080    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 20:59:13.388410 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387085    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 20:59:13.388410 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387090    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 20:59:13.388410 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387094    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 20:59:13.388410 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387098    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 20:59:13.388410 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387102    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 20:59:13.388410 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387106    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 20:59:13.388410 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387110    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 20:59:13.388410 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387115    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 20:59:13.388410 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387119    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 20:59:13.388410 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387124    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 20:59:13.388410 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387128    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 20:59:13.388410 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387132    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 20:59:13.388410 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387138    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 20:59:13.388410 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387142    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 20:59:13.388410 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387147    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 20:59:13.388410 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387151    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 20:59:13.388868 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387158    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 20:59:13.388868 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387163    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 20:59:13.388868 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387168    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 20:59:13.388868 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387172    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 20:59:13.388868 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387176    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 20:59:13.388868 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387181    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 20:59:13.388868 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387185    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 20:59:13.388868 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387190    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 20:59:13.388868 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387196    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 20:59:13.388868 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387200    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 20:59:13.388868 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387205    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 20:59:13.388868 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387209    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 20:59:13.388868 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387213    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 20:59:13.388868 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387218    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 20:59:13.388868 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387222    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 20:59:13.388868 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387226    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 20:59:13.388868 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387231    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 20:59:13.388868 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387235    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 20:59:13.388868 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387239    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 20:59:13.389340 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387243    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 20:59:13.389340 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387248    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 20:59:13.389340 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387252    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 20:59:13.389340 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387257    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 20:59:13.389340 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387261    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 20:59:13.389340 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387265    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 20:59:13.389340 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387270    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 20:59:13.389340 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387274    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 20:59:13.389340 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387278    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 20:59:13.389340 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387283    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 20:59:13.389340 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387287    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 20:59:13.389340 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387291    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 20:59:13.389340 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387297    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 20:59:13.389340 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387301    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 20:59:13.389340 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387305    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 20:59:13.389340 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387309    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 20:59:13.389340 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.387313    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 20:59:13.390370 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390350    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 20:59:13.390370 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390366    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 20:59:13.390370 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390372    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 20:59:13.390370 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390376    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 20:59:13.390609 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390382    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 20:59:13.390609 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390387    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 20:59:13.390609 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390391    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 20:59:13.390609 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390394    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 20:59:13.390609 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390398    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 20:59:13.390609 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390402    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 20:59:13.390609 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390406    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 20:59:13.390609 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390411    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 20:59:13.390609 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390414    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 20:59:13.390609 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390418    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 20:59:13.390609 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390422    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 20:59:13.390609 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390425    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 20:59:13.390609 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390429    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 20:59:13.390609 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390433    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 20:59:13.390609 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390437    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 20:59:13.390609 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390440    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 20:59:13.390609 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390444    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 20:59:13.390609 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390449    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 20:59:13.390609 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390452    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 20:59:13.390609 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390456    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 20:59:13.391449 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390460    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 20:59:13.391449 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390465    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 20:59:13.391449 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390469    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 20:59:13.391449 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390472    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 20:59:13.391449 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390485    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 20:59:13.391449 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390489    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 20:59:13.391449 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390493    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 20:59:13.391449 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390498    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 20:59:13.391449 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390502    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 20:59:13.391449 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390507    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 20:59:13.391449 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390511    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 20:59:13.391449 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390515    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 20:59:13.391449 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390519    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 20:59:13.391449 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390525    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 20:59:13.391449 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390543    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 20:59:13.391449 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390548    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 20:59:13.391449 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390552    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 20:59:13.391449 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390557    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 20:59:13.391449 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390561    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 20:59:13.391449 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390565    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 20:59:13.392347 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390569    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 20:59:13.392347 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390573    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 20:59:13.392347 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390578    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 20:59:13.392347 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390582    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 20:59:13.392347 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390586    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 20:59:13.392347 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390590    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 20:59:13.392347 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390595    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 20:59:13.392347 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390599    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 20:59:13.392347 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390603    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 20:59:13.392347 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390607    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 20:59:13.392347 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390611    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 20:59:13.392347 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390615    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 20:59:13.392347 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390624    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 20:59:13.392347 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390628    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 20:59:13.392347 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390632    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 20:59:13.392347 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390637    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 20:59:13.392347 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390641    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 20:59:13.392347 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390646    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 20:59:13.392347 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390650    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 20:59:13.392347 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390654    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 20:59:13.393173 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390658    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 20:59:13.393173 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390662    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 20:59:13.393173 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390667    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 20:59:13.393173 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390672    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 20:59:13.393173 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390678    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 20:59:13.393173 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390686    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 20:59:13.393173 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390691    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 20:59:13.393173 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390704    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 20:59:13.393173 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390709    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 20:59:13.393173 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390714    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 20:59:13.393173 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390718    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 20:59:13.393173 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390722    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 20:59:13.393173 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390726    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 20:59:13.393173 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390733    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 20:59:13.393173 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390739    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 20:59:13.393173 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390743    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 20:59:13.393173 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390747    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 20:59:13.393173 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390751    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 20:59:13.393173 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390756    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 20:59:13.393862 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390763    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 20:59:13.393862 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390786    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 20:59:13.393862 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390792    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 20:59:13.393862 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390797    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 20:59:13.393862 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390801    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 20:59:13.393862 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390806    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 20:59:13.393862 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390810    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 20:59:13.393862 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390814    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 20:59:13.393862 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390818    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 20:59:13.393862 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390822    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 20:59:13.393862 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390827    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 20:59:13.393862 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390831    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 20:59:13.393862 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390835    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 20:59:13.393862 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390840    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 20:59:13.393862 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390844    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 20:59:13.393862 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.390848    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 20:59:13.393862 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391532    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 20:59:13.393862 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391540    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 20:59:13.393862 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391548    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 20:59:13.394308 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391553    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 20:59:13.394308 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391560    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 20:59:13.394308 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391565    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 20:59:13.394308 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391570    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 20:59:13.394308 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391575    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 20:59:13.394308 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391579    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 20:59:13.394308 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391584    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 20:59:13.394308 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391589    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 20:59:13.394308 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391593    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 20:59:13.394308 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391597    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 20:59:13.394308 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391602    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 20:59:13.394308 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391608    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 20:59:13.394308 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391614    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 20:59:13.394308 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391618    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 20:59:13.394308 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391623    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 20:59:13.394308 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391627    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 20:59:13.394308 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391631    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 20:59:13.394308 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391635    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 20:59:13.394308 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391640    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 20:59:13.394871 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391644    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 20:59:13.394871 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391650    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 20:59:13.394871 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391657    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 20:59:13.394871 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391662    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 20:59:13.394871 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391667    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 20:59:13.394871 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391671    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 20:59:13.394871 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391675    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 20:59:13.394871 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391680    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 20:59:13.394871 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391685    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 20:59:13.394871 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391689    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 20:59:13.394871 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391693    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 20:59:13.394871 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391697    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 20:59:13.394871 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391701    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 20:59:13.394871 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391705    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 20:59:13.394871 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391709    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 20:59:13.394871 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391714    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 20:59:13.394871 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391718    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 20:59:13.394871 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391723    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 20:59:13.394871 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391727    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 20:59:13.394871 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391732    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 20:59:13.395564 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391737    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 20:59:13.395564 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391742    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 20:59:13.395564 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391746    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 20:59:13.395564 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391751    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 20:59:13.395564 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391755    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 20:59:13.395564 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391759    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 20:59:13.395564 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391764    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 20:59:13.395564 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391789    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 20:59:13.395564 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391794    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 20:59:13.395564 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391798    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 20:59:13.395564 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391802    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 20:59:13.395564 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391807    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 20:59:13.395564 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391811    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 20:59:13.395564 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391815    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 20:59:13.395564 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391820    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 20:59:13.395564 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391824    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 20:59:13.395564 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391828    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 20:59:13.395564 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391832    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 20:59:13.395564 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391837    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 20:59:13.395564 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391841    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 20:59:13.396106 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391845    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 20:59:13.396106 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391850    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 20:59:13.396106 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391854    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 20:59:13.396106 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391858    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 20:59:13.396106 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391863    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 20:59:13.396106 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391867    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 20:59:13.396106 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391871    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 20:59:13.396106 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391875    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 20:59:13.396106 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391880    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 20:59:13.396106 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391885    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 20:59:13.396106 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391889    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 20:59:13.396106 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391895    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 20:59:13.396106 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391900    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 20:59:13.396106 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391904    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 20:59:13.396106 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391908    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 20:59:13.396106 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391913    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 20:59:13.396106 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391917    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 20:59:13.396106 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391921    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 20:59:13.396106 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391925    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 20:59:13.396106 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391929    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 20:59:13.396617 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391933    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 20:59:13.396617 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391938    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 20:59:13.396617 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391942    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 20:59:13.396617 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391946    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 20:59:13.396617 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391950    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 20:59:13.396617 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391954    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 20:59:13.396617 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391959    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 20:59:13.396617 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391963    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 20:59:13.396617 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391967    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 20:59:13.396617 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391972    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 20:59:13.396617 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391976    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 20:59:13.396617 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391980    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 20:59:13.396617 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391984    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 20:59:13.396617 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391988    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 20:59:13.396617 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391992    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 20:59:13.396617 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.391996    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 20:59:13.396617 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.392000    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 20:59:13.396617 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392108    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 20:59:13.396617 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392120    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 20:59:13.396617 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392131    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 20:59:13.396617 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392138    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392146    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392152    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392159    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392166    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392171    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392176    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392182    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392187    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392193    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392198    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392203    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392208    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392212    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392217    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392224    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392229    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392234    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392240    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392246    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392252    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392257    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392262    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 20:59:13.397185 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392267    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392272    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392277    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392282    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392287    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392292    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392298    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392303    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392309    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392313    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392319    2560 flags.go:64] FLAG: --enable-server="true"
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392324    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392332    2560 flags.go:64] FLAG: --event-burst="100"
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392337    2560 flags.go:64] FLAG: --event-qps="50"
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392341    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392346    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392351    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392357    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392361    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392366    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392371    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392375    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392381    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392386    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392395    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 20:59:13.397732 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392400    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392404    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392410    2560 flags.go:64] FLAG: --feature-gates=""
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392416    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392421    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392426    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392432    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392437    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392442    2560 flags.go:64] FLAG: --help="false"
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392446    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-130-134.ec2.internal"
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392451    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392456    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392461    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392467    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392473    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392478    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392482    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392487    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392492    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392498    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392503    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392508    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392512    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392517    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 20:59:13.398387 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392522    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392527    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392531    2560 flags.go:64] FLAG: --lock-file=""
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392536    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392541    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392547    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392556    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392562    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392567    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392572    2560 flags.go:64] FLAG: --logging-format="text"
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392579    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392585    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392590    2560 flags.go:64] FLAG: --manifest-url=""
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392595    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392602    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392607    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392614    2560 flags.go:64] FLAG: --max-pods="110"
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392619    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392624    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392629    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392634    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392638    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392643    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392648    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392680    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 20:59:13.398976 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392686    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392691    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392696    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392702    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392711    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392716    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392720    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392725    2560 flags.go:64] FLAG: --port="10250"
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392730    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392735    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-073fba077f0bcfa2b"
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392740    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392745    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392750    2560 flags.go:64] FLAG: --register-node="true"
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392754    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392760    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392782    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392787    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392794    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392800    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392805    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392810    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392815    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392819    2560 flags.go:64] FLAG: --runonce="false"
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392824    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392830    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 20:59:13.399558 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392835    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392839    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392844    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392849    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392854    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392859    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392864    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392868    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392873    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392878    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392883    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392889    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392893    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392903    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392908    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392912    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392920    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392924    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392929    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392934    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392938    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392943    2560 flags.go:64] FLAG: --v="2"
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392953    2560 flags.go:64] FLAG: --version="false"
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392960    2560 flags.go:64] FLAG: --vmodule=""
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392971    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 20:59:13.400247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.392977    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 20:59:13.400855 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393173    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 20:59:13.400855 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393181    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 20:59:13.400855 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393185    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 20:59:13.400855 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393189    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 20:59:13.400855 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393194    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 20:59:13.400855 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393198    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 20:59:13.400855 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393202    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 20:59:13.400855 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393206    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 20:59:13.400855 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393211    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 20:59:13.400855 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393215    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 20:59:13.400855 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393221    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 20:59:13.400855 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393227    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 20:59:13.400855 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393231    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 20:59:13.400855 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393236    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 20:59:13.400855 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393240    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 20:59:13.400855 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393244    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 20:59:13.400855 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393248    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 20:59:13.400855 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393253    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 20:59:13.400855 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393258    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 20:59:13.401309 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393262    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 20:59:13.401309 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393267    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 20:59:13.401309 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393271    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 20:59:13.401309 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393275    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 20:59:13.401309 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393280    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 20:59:13.401309 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393284    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 20:59:13.401309 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393288    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 20:59:13.401309 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393292    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 20:59:13.401309 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393297    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 20:59:13.401309 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393303    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 20:59:13.401309 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393307    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 20:59:13.401309 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393313    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 20:59:13.401309 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393317    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 20:59:13.401309 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393322    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 20:59:13.401309 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393326    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 20:59:13.401309 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393330    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 20:59:13.401309 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393335    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 20:59:13.401309 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393339    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 20:59:13.401309 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393343    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 20:59:13.401309 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393347    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 20:59:13.401818 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393352    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 20:59:13.401818 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393356    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 20:59:13.401818 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393360    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 20:59:13.401818 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393364    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 20:59:13.401818 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393368    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 20:59:13.401818 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393373    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 20:59:13.401818 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393377    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 20:59:13.401818 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393381    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 20:59:13.401818 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393386    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 20:59:13.401818 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393390    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 20:59:13.401818 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393394    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 20:59:13.401818 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393399    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 20:59:13.401818 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393404    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 20:59:13.401818 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393408    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 20:59:13.401818 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393412    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 20:59:13.401818 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393417    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 20:59:13.401818 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393421    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 20:59:13.401818 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393425    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 20:59:13.401818 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393429    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 20:59:13.401818 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393434    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 20:59:13.402332 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393438    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 20:59:13.402332 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393445    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 20:59:13.402332 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393450    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 20:59:13.402332 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393456    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 20:59:13.402332 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393461    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 20:59:13.402332 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393465    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 20:59:13.402332 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393469    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 20:59:13.402332 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393474    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 20:59:13.402332 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393478    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 20:59:13.402332 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393482    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 20:59:13.402332 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393486    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 20:59:13.402332 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393490    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 20:59:13.402332 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393495    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 20:59:13.402332 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393499    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 20:59:13.402332 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393503    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 20:59:13.402332 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393508    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 20:59:13.402332 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393512    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 20:59:13.402332 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393516    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 20:59:13.402332 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393520    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 20:59:13.402332 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393524    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 20:59:13.402845 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393529    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 20:59:13.402845 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393533    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 20:59:13.402845 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393537    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 20:59:13.402845 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393541    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 20:59:13.402845 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393545    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 20:59:13.402845 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393550    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 20:59:13.402845 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393554    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 20:59:13.402845 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393559    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 20:59:13.402845 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393563    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 20:59:13.402845 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393569    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 20:59:13.402845 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393575    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 20:59:13.402845 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393580    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 20:59:13.402845 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393585    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 20:59:13.402845 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393592    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 20:59:13.402845 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393596    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 20:59:13.402845 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393602    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 20:59:13.402845 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393607    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 20:59:13.402845 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393611    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 20:59:13.402845 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393617    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 20:59:13.403304 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.393623    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 20:59:13.403304 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.394316    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 20:59:13.403304 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.401618    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 20:59:13.403304 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.401639    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 20:59:13.403304 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.402466    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 20:59:13.403304 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.402474    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 20:59:13.403304 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402556    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 20:59:13.403304 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402562    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 20:59:13.403304 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402566    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 20:59:13.403304 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402569    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 20:59:13.403304 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402572    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 20:59:13.403304 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402574    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 20:59:13.403304 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402577    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 20:59:13.403304 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402580    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 20:59:13.403304 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402582    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 20:59:13.403746 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402585    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 20:59:13.403746 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402588    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 20:59:13.403746 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402591    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 20:59:13.403746 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402593    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 20:59:13.403746 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402596    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 20:59:13.403746 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402599    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 20:59:13.403746 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402601    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 20:59:13.403746 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402603    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 20:59:13.403746 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402606    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 20:59:13.403746 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402608    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 20:59:13.403746 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402611    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 20:59:13.403746 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402613    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 20:59:13.403746 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402616    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 20:59:13.403746 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402618    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 20:59:13.403746 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402621    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 20:59:13.403746 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402623    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 20:59:13.403746 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402626    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 20:59:13.403746 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402628    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 20:59:13.403746 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402630    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 20:59:13.404573 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402635    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 20:59:13.404573 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402649    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 20:59:13.404573 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402653    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 20:59:13.404573 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402656    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 20:59:13.404573 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402659    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 20:59:13.404573 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402661    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 20:59:13.404573 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402664    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 20:59:13.404573 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402667    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 20:59:13.404573 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402669    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 20:59:13.404573 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402672    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 20:59:13.404573 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402675    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 20:59:13.404573 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402677    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 20:59:13.404573 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402680    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 20:59:13.404573 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402683    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 20:59:13.404573 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402685    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 20:59:13.404573 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402688    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 20:59:13.404573 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402690    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 20:59:13.404573 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402693    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 20:59:13.404573 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402696    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 20:59:13.404573 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402698    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 20:59:13.405183 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402700    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 20:59:13.405183 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402704    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 20:59:13.405183 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402707    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 20:59:13.405183 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402710    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 20:59:13.405183 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402713    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 20:59:13.405183 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402717    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 20:59:13.405183 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402721    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 20:59:13.405183 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402724    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 20:59:13.405183 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402727    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 20:59:13.405183 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402729    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 20:59:13.405183 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402732    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 20:59:13.405183 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402734    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 20:59:13.405183 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402737    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 20:59:13.405183 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402740    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 20:59:13.405183 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402749    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 20:59:13.405183 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402751    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 20:59:13.405183 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402754    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 20:59:13.405183 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402756    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 20:59:13.405183 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402759    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 20:59:13.405641 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402761    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 20:59:13.405641 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402764    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 20:59:13.405641 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402783    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 20:59:13.405641 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402787    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 20:59:13.405641 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402789    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 20:59:13.405641 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402792    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 20:59:13.405641 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402795    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 20:59:13.405641 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402798    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 20:59:13.405641 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402800    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 20:59:13.405641 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402803    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 20:59:13.405641 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402805    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 20:59:13.405641 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402808    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 20:59:13.405641 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402810    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 20:59:13.405641 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402813    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 20:59:13.405641 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402816    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 20:59:13.405641 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402819    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 20:59:13.405641 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402821    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 20:59:13.405641 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402824    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 20:59:13.405641 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402826    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 20:59:13.405641 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402829    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 20:59:13.406164 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402832    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 20:59:13.406164 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402834    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 20:59:13.406164 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402838    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 20:59:13.406164 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402840    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 20:59:13.406164 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402843    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 20:59:13.406164 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402846    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 20:59:13.406164 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402849    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 20:59:13.406164 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402851    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 20:59:13.406164 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402860    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 20:59:13.406164 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402863    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 20:59:13.406164 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402866    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 20:59:13.406164 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.402869    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 20:59:13.406164 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.402874    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 20:59:13.406164 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403023    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 20:59:13.406164 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403032    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 20:59:13.406535 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403035    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 20:59:13.406535 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403038    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 20:59:13.406535 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403041    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 20:59:13.406535 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403044    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 20:59:13.406535 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403047    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 20:59:13.406535 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403050    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 20:59:13.406535 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403053    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 20:59:13.406535 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403056    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 20:59:13.406535 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403059    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 20:59:13.406535 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403061    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 20:59:13.406535 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403064    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 20:59:13.406535 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403066    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 20:59:13.406535 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403069    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 20:59:13.406535 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403071    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 20:59:13.406535 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403074    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 20:59:13.406535 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403076    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 20:59:13.406535 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403079    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 20:59:13.406535 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403081    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 20:59:13.406535 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403083    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 20:59:13.406535 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403086    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 20:59:13.407024 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403089    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 20:59:13.407024 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403092    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 20:59:13.407024 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403094    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 20:59:13.407024 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403097    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 20:59:13.407024 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403099    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 20:59:13.407024 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403102    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 20:59:13.407024 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403110    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 20:59:13.407024 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403113    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 20:59:13.407024 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403117    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 20:59:13.407024 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403120    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 20:59:13.407024 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403123    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 20:59:13.407024 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403127    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 20:59:13.407024 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403129    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 20:59:13.407024 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403132    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 20:59:13.407024 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403135    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 20:59:13.407024 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403137    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 20:59:13.407024 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403140    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 20:59:13.407024 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403142    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 20:59:13.407024 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403145    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 20:59:13.407024 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403147    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 20:59:13.407500 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403150    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 20:59:13.407500 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403152    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 20:59:13.407500 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403155    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 20:59:13.407500 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403157    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 20:59:13.407500 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403160    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 20:59:13.407500 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403162    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 20:59:13.407500 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403165    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 20:59:13.407500 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403167    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 20:59:13.407500 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403169    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 20:59:13.407500 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403172    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 20:59:13.407500 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403175    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 20:59:13.407500 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403178    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 20:59:13.407500 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403180    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 20:59:13.407500 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403183    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 20:59:13.407500 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403185    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 20:59:13.407500 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403194    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 20:59:13.407500 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403197    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 20:59:13.407500 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403201    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 20:59:13.407500 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403204    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 20:59:13.407996 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403213    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 20:59:13.407996 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403216    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 20:59:13.407996 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403219    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 20:59:13.407996 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403221    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 20:59:13.407996 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403224    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 20:59:13.407996 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403227    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 20:59:13.407996 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403229    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 20:59:13.407996 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403231    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 20:59:13.407996 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403234    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 20:59:13.407996 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403236    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 20:59:13.407996 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403238    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 20:59:13.407996 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403241    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 20:59:13.407996 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403244    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 20:59:13.407996 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403246    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 20:59:13.407996 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403248    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 20:59:13.407996 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403251    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 20:59:13.407996 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403253    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 20:59:13.407996 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403256    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 20:59:13.407996 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403258    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 20:59:13.407996 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403261    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 20:59:13.408474 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403263    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 20:59:13.408474 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403265    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 20:59:13.408474 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403268    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 20:59:13.408474 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403271    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 20:59:13.408474 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403273    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 20:59:13.408474 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403276    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 20:59:13.408474 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403278    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 20:59:13.408474 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403281    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 20:59:13.408474 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403284    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 20:59:13.408474 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403286    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 20:59:13.408474 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403289    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 20:59:13.408474 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403291    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 20:59:13.408474 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403294    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 20:59:13.408474 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.403349    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 20:59:13.408474 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.404622    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 20:59:13.408474 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.404637    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 20:59:13.408474 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.404644    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 20:59:13.408474 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:13.404649    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 20:59:13.409042 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.404658    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 20:59:13.409042 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.405127    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 20:59:13.409042 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.408019    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 20:59:13.409338 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.409325    2560 server.go:1019] "Starting client certificate rotation"
Jul 15 20:59:13.409451 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.409433    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 20:59:13.409486 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.409472    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 20:59:13.412577 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.412564    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 20:59:13.413919 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.413871    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 20:59:13.424275 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.424252    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 15 20:59:13.428656 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.428633    2560 log.go:25] "Validated CRI v1 image API"
Jul 15 20:59:13.429486 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.429472    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 20:59:13.432205 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.432178    2560 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 d19ca3a9-d3b3-44e5-b891-0b7eb6528dfb:/dev/nvme0n1p4 d8c0a912-982e-4cac-961d-acd9e3948f88:/dev/nvme0n1p3]
Jul 15 20:59:13.432256 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.432205    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 20:59:13.437935 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.437762    2560 manager.go:216] Machine: {Timestamp:2026-07-15 20:59:13.436431429 +0000 UTC m=+0.627110850 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094758 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2467ee65ea3b123cac00cd751eb671 SystemUUID:ec2467ee-65ea-3b12-3cac-00cd751eb671 BootID:3f387bd1-f915-4ef7-9bb2-fdfe20237ec5 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:37:73:e3:b5:91 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:37:73:e3:b5:91 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:2c:78:8d:70:ff Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 20:59:13.437935 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.437933    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 20:59:13.438042 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.438026    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 20:59:13.441212 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.441176    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 20:59:13.441356 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.441214    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-134.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 20:59:13.441916 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.441904    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 20:59:13.441948 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.441918    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 20:59:13.441948 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.441927    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 20:59:13.442425 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.442415    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 20:59:13.444477 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.444059    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 20:59:13.447034 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.447015    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 20:59:13.447389 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.447376    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 20:59:13.447523 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.447513    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 20:59:13.447555 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.447546    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 20:59:13.447586 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.447558    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 20:59:13.447586 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.447569    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 20:59:13.447586 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.447579    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 15 20:59:13.447666 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.447587    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 20:59:13.448019 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.448000    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 20:59:13.448110 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.448026    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 20:59:13.450340 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.450319    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 20:59:13.452219 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.452201    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 20:59:13.452304 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.452240    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 20:59:13.452432 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.452419    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 20:59:13.452498 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.452439    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 20:59:13.452498 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.452449    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 20:59:13.452498 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.452458    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 20:59:13.452498 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.452470    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 20:59:13.452498 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.452480    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 20:59:13.453146 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.453135    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 20:59:13.453196 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.453148    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 20:59:13.453196 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.453159    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 20:59:13.453196 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.453168    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 20:59:13.453196 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.453182    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 20:59:13.453196 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.453195    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 20:59:13.453972 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.453953    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 20:59:13.453972 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.453971    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 20:59:13.456872 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.456852    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-134.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 20:59:13.456872 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:13.456858    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 20:59:13.456981 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:13.456922    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 20:59:13.457437 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.457424    2560 server.go:1268] "Started kubelet"
Jul 15 20:59:13.457524 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.457500    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 20:59:13.458053 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.458013    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 20:59:13.458122 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.458058    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 20:59:13.459175 ip-10-0-130-134 systemd[1]: Started Kubernetes Kubelet.
Jul 15 20:59:13.459801 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.459186    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 20:59:13.460394 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.460381    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 20:59:13.462689 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:13.461668    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-134.ec2.internal.18c29233c6244da8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-134.ec2.internal,UID:ip-10-0-130-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-134.ec2.internal,},FirstTimestamp:2026-07-15 20:59:13.457393064 +0000 UTC m=+0.648072486,LastTimestamp:2026-07-15 20:59:13.457393064 +0000 UTC m=+0.648072486,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-134.ec2.internal,}"
Jul 15 20:59:13.463276 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:13.463261    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 20:59:13.464835 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.464817    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 20:59:13.464921 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.464819    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 20:59:13.465018 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:13.464955    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-134.ec2.internal\" not found"
Jul 15 20:59:13.465425 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.465406    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 20:59:13.465425 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.465406    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 20:59:13.465575 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.465434    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 20:59:13.465716 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.465684    2560 factory.go:55] Registering systemd factory
Jul 15 20:59:13.465716 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.465707    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 15 20:59:13.465841 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.465687    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 20:59:13.465841 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.465759    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 20:59:13.465989 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.465975    2560 factory.go:153] Registering CRI-O factory
Jul 15 20:59:13.466044 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.465993    2560 factory.go:223] Registration of the crio container factory successfully
Jul 15 20:59:13.466087 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.466043    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 20:59:13.466087 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.466068    2560 factory.go:103] Registering Raw factory
Jul 15 20:59:13.466087 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.466083    2560 manager.go:1196] Started watching for new ooms in manager
Jul 15 20:59:13.466541 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.466527    2560 manager.go:349] Starting recovery of all containers
Jul 15 20:59:13.466821 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:13.466798    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 20:59:13.467089 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.467066    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jvv9z"
Jul 15 20:59:13.467595 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:13.467561    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 20:59:13.475332 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.475309    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jvv9z"
Jul 15 20:59:13.479466 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.479444    2560 manager.go:354] Recovery completed
Jul 15 20:59:13.484373 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.484358    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 20:59:13.486409 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.486387    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 20:59:13.486514 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.486421    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 20:59:13.486514 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.486432    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-134.ec2.internal" event="NodeHasSufficientPID"
Jul 15 20:59:13.487038 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.487019    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 20:59:13.487038 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.487038    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 20:59:13.487149 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.487046    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 20:59:13.487149 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.487057    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 20:59:13.487833 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.487811    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 20:59:13.487903 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.487850    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 20:59:13.487903 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.487863    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-134.ec2.internal" event="NodeHasSufficientPID"
Jul 15 20:59:13.488226 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.488210    2560 policy_none.go:49] "None policy: Start"
Jul 15 20:59:13.488292 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.488235    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 20:59:13.488292 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.488250    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 20:59:13.489235 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.489222    2560 policy_none.go:47] "Start"
Jul 15 20:59:13.533632 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.533414    2560 manager.go:337] "Starting Device Plugin manager"
Jul 15 20:59:13.533794 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:13.533675    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 20:59:13.533794 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.533688    2560 server.go:87] "Starting device plugin registration server"
Jul 15 20:59:13.534012 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.533999    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 20:59:13.534063 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.534014    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 20:59:13.534151 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.534121    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 20:59:13.534250 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.534238    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 20:59:13.534250 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.534249    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 20:59:13.534827 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:13.534806    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 20:59:13.534916 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:13.534862    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-134.ec2.internal\" not found"
Jul 15 20:59:13.566032 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.565997    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 20:59:13.567483 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.567244    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 20:59:13.567483 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.567278    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 20:59:13.567483 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.567303    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 20:59:13.567483 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:13.567344    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 20:59:13.570317 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.570299    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 20:59:13.634489 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.634386    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 20:59:13.635438 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.635420    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 20:59:13.635534 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.635451    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 20:59:13.635534 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.635461    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-134.ec2.internal" event="NodeHasSufficientPID"
Jul 15 20:59:13.635534 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.635486    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-134.ec2.internal"
Jul 15 20:59:13.645893 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.645869    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-134.ec2.internal"
Jul 15 20:59:13.646018 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:13.645904    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-134.ec2.internal\": node \"ip-10-0-130-134.ec2.internal\" not found"
Jul 15 20:59:13.668142 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.668077    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-134.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-134.ec2.internal"]
Jul 15 20:59:13.668330 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.668177    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 20:59:13.668330 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:13.668231    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-134.ec2.internal\" not found"
Jul 15 20:59:13.669152 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.669130    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 20:59:13.669270 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.669165    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 20:59:13.669270 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.669180    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-134.ec2.internal" event="NodeHasSufficientPID"
Jul 15 20:59:13.670427 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.670414    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 20:59:13.670527 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.670513    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-134.ec2.internal"
Jul 15 20:59:13.670585 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.670552    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 20:59:13.671409 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.671388    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 20:59:13.671502 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.671419    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 20:59:13.671502 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.671430    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-134.ec2.internal" event="NodeHasSufficientPID"
Jul 15 20:59:13.671502 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.671396    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 20:59:13.671502 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.671487    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 20:59:13.671502 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.671497    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-134.ec2.internal" event="NodeHasSufficientPID"
Jul 15 20:59:13.672573 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.672561    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-134.ec2.internal"
Jul 15 20:59:13.672623 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.672585    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 20:59:13.673806 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.673789    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-134.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 20:59:13.673902 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.673815    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-134.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 20:59:13.673902 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.673828    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-134.ec2.internal" event="NodeHasSufficientPID"
Jul 15 20:59:13.699756 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:13.699722    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-134.ec2.internal\" not found" node="ip-10-0-130-134.ec2.internal"
Jul 15 20:59:13.704520 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:13.704501    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-134.ec2.internal\" not found" node="ip-10-0-130-134.ec2.internal"
Jul 15 20:59:13.767837 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.767807    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8bdce92e82071ad2602beba49b95b8d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-134.ec2.internal\" (UID: \"8bdce92e82071ad2602beba49b95b8d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-134.ec2.internal"
Jul 15 20:59:13.767837 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.767840    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bdce92e82071ad2602beba49b95b8d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-134.ec2.internal\" (UID: \"8bdce92e82071ad2602beba49b95b8d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-134.ec2.internal"
Jul 15 20:59:13.767972 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.767856    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d096c15409b94daf881a74897409f344-config\") pod \"kube-apiserver-proxy-ip-10-0-130-134.ec2.internal\" (UID: \"d096c15409b94daf881a74897409f344\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-134.ec2.internal"
Jul 15 20:59:13.768834 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:13.768818    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-134.ec2.internal\" not found"
Jul 15 20:59:13.868358 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.868322    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d096c15409b94daf881a74897409f344-config\") pod \"kube-apiserver-proxy-ip-10-0-130-134.ec2.internal\" (UID: \"d096c15409b94daf881a74897409f344\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-134.ec2.internal"
Jul 15 20:59:13.868358 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.868362    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8bdce92e82071ad2602beba49b95b8d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-134.ec2.internal\" (UID: \"8bdce92e82071ad2602beba49b95b8d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-134.ec2.internal"
Jul 15 20:59:13.868464 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.868379    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bdce92e82071ad2602beba49b95b8d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-134.ec2.internal\" (UID: \"8bdce92e82071ad2602beba49b95b8d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-134.ec2.internal"
Jul 15 20:59:13.868464 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.868422    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8bdce92e82071ad2602beba49b95b8d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-134.ec2.internal\" (UID: \"8bdce92e82071ad2602beba49b95b8d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-134.ec2.internal"
Jul 15 20:59:13.868464 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.868436    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d096c15409b94daf881a74897409f344-config\") pod \"kube-apiserver-proxy-ip-10-0-130-134.ec2.internal\" (UID: \"d096c15409b94daf881a74897409f344\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-134.ec2.internal"
Jul 15 20:59:13.868552 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:13.868464    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bdce92e82071ad2602beba49b95b8d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-134.ec2.internal\" (UID: \"8bdce92e82071ad2602beba49b95b8d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-134.ec2.internal"
Jul 15 20:59:13.869372 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:13.869357    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-134.ec2.internal\" not found"
Jul 15 20:59:13.970027 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:13.969990    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-134.ec2.internal\" not found"
Jul 15 20:59:14.002194 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.002166    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-134.ec2.internal"
Jul 15 20:59:14.008184 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.008162    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-134.ec2.internal"
Jul 15 20:59:14.070850 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:14.070805    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-134.ec2.internal\" not found"
Jul 15 20:59:14.171269 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:14.171234    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-134.ec2.internal\" not found"
Jul 15 20:59:14.271726 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:14.271640    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-134.ec2.internal\" not found"
Jul 15 20:59:14.294269 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.294243    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 20:59:14.316655 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.316630    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 20:59:14.366106 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.366069    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-134.ec2.internal"
Jul 15 20:59:14.378298 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.378270    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 20:59:14.379306 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.379291    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-134.ec2.internal"
Jul 15 20:59:14.391937 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.391913    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 20:59:14.409080 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.409049    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 20:59:14.409227 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.409190    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 20:59:14.409227 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.409191    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 20:59:14.409318 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.409220    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 20:59:14.448423 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.448374    2560 apiserver.go:52] "Watching apiserver"
Jul 15 20:59:14.464453 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.464416    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 20:59:14.464822 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.464800    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-z9bpw","openshift-network-operator/iptables-alerter-2xdsz","kube-system/global-pull-secret-syncer-zqlwf","kube-system/konnectivity-agent-lbrvc","openshift-cluster-node-tuning-operator/tuned-w4h68","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-134.ec2.internal","openshift-multus/multus-additional-cni-plugins-kkgc7","openshift-ovn-kubernetes/ovnkube-node-5nl52","kube-system/kube-apiserver-proxy-ip-10-0-130-134.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc","openshift-dns/node-resolver-ndnjh","openshift-image-registry/node-ca-vntdq","openshift-multus/multus-2r9lp","openshift-multus/network-metrics-daemon-k47j9"]
Jul 15 20:59:14.465024 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.465009    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 20:59:14.466435 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.466415    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.469335 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.469311    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 20:59:14.469439 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.469365    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.469439 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.469311    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 20:59:14.469588 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.469312    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 20:59:14.469588 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.469311    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 20:59:14.470056 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.470040    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 20:59:14.470375 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.470334    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kkqcg\""
Jul 15 20:59:14.470507 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.470492    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:14.470571 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:14.470556    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqlwf" podUID="714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91"
Jul 15 20:59:14.471318 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.471300    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 20:59:14.471695 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.471667    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/191159ed-06e6-43b3-8d6c-11452cd3aa7f-system-cni-dir\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.471834 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.471705    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/191159ed-06e6-43b3-8d6c-11452cd3aa7f-cni-binary-copy\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.471834 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.471731    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/191159ed-06e6-43b3-8d6c-11452cd3aa7f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.471834 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.471784    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/191159ed-06e6-43b3-8d6c-11452cd3aa7f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.471834 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.471794    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lbrvc"
Jul 15 20:59:14.471834 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.471820    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/191159ed-06e6-43b3-8d6c-11452cd3aa7f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.472083 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.471840    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-clflm\""
Jul 15 20:59:14.472083 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.471850    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/191159ed-06e6-43b3-8d6c-11452cd3aa7f-cnibin\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.472083 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.471892    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/191159ed-06e6-43b3-8d6c-11452cd3aa7f-os-release\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.472083 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.471917    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvhfk\" (UniqueName: \"kubernetes.io/projected/191159ed-06e6-43b3-8d6c-11452cd3aa7f-kube-api-access-vvhfk\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.473015 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.473002    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.473920 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.473901    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 20:59:14.474251 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.474236    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:14.474327 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:14.474295    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k47j9" podUID="4a380d70-7f9e-4fc4-b28d-520f61003def"
Jul 15 20:59:14.474482 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.474454    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 20:59:14.474659 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.474641    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-x66tw\""
Jul 15 20:59:14.474829 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.474812    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 20:59:14.475285 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.475266    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 20:59:14.475368 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.475287    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tcpzq\""
Jul 15 20:59:14.475632 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.475617    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.477029 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.477006    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:14.477140 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:14.477082    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bpw" podUID="e670c826-029c-4b43-8594-3caf0693e896"
Jul 15 20:59:14.478505 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.477748    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 20:59:14.478505 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.478124    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dzc94\""
Jul 15 20:59:14.478505 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.478362    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 20:59:14.478682 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.478621    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 20:59:14.478750 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.478730    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 20:59:14.478873 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.478858    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 20:59:14.478953 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.478903    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 20:59:14.478953 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.478921    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 20:59:14.479067 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.479016    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 20:54:13 +0000 UTC" deadline="2028-01-12 22:12:25.72913614 +0000 UTC"
Jul 15 20:59:14.479067 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.479053    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13105h13m11.250086437s"
Jul 15 20:59:14.479368 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.479347    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2xdsz"
Jul 15 20:59:14.480809 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.480795    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.481537 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.481507    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 20:59:14.481537 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.481526    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 20:59:14.481693 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.481671    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 20:59:14.481743 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.481690    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rz4vf\""
Jul 15 20:59:14.482194 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.482178    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ndnjh"
Jul 15 20:59:14.482569 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.482554    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 20:59:14.482709 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.482696    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nbswk\""
Jul 15 20:59:14.483168 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.483028    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 20:59:14.483431 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.483416    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 20:59:14.483549 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.483531    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vntdq"
Jul 15 20:59:14.485382 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.485360    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lw46w\""
Jul 15 20:59:14.485458 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.485360    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 20:59:14.485539 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.485362    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 20:59:14.485605 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.485362    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 20:59:14.485669 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.485633    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 20:59:14.485813 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.485796    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 20:59:14.485893 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.485861    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f8hdd\""
Jul 15 20:59:14.500435 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.500414    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-l8mzw"
Jul 15 20:59:14.509607 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.509578    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-l8mzw"
Jul 15 20:59:14.531937 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:14.531901    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bdce92e82071ad2602beba49b95b8d5.slice/crio-ba2e94d39e81e151801f1297847a1dac598996487b909859d43e1fd0f9a8b609 WatchSource:0}: Error finding container ba2e94d39e81e151801f1297847a1dac598996487b909859d43e1fd0f9a8b609: Status 404 returned error can't find the container with id ba2e94d39e81e151801f1297847a1dac598996487b909859d43e1fd0f9a8b609
Jul 15 20:59:14.532125 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:14.532105    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd096c15409b94daf881a74897409f344.slice/crio-0b7533784e668d1edd2d0b141a7eff5999307f0545e96031ce1bf7bd897f3dda WatchSource:0}: Error finding container 0b7533784e668d1edd2d0b141a7eff5999307f0545e96031ce1bf7bd897f3dda: Status 404 returned error can't find the container with id 0b7533784e668d1edd2d0b141a7eff5999307f0545e96031ce1bf7bd897f3dda
Jul 15 20:59:14.537566 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.537544    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 20:59:14.566328 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.566308    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 20:59:14.570801 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.570743    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-134.ec2.internal" event={"ID":"d096c15409b94daf881a74897409f344","Type":"ContainerStarted","Data":"0b7533784e668d1edd2d0b141a7eff5999307f0545e96031ce1bf7bd897f3dda"}
Jul 15 20:59:14.571969 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.571950    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-134.ec2.internal" event={"ID":"8bdce92e82071ad2602beba49b95b8d5","Type":"ContainerStarted","Data":"ba2e94d39e81e151801f1297847a1dac598996487b909859d43e1fd0f9a8b609"}
Jul 15 20:59:14.572057 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572034    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-os-release\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.572100 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572057    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-multus-socket-dir-parent\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.572100 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572074    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-host-kubelet\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.572159 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572096    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c78e80e5-a1ef-4c31-a40d-36f73bc1e7bf-iptables-alerter-script\") pod \"iptables-alerter-2xdsz\" (UID: \"c78e80e5-a1ef-4c31-a40d-36f73bc1e7bf\") " pod="openshift-network-operator/iptables-alerter-2xdsz"
Jul 15 20:59:14.572159 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572132    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-etc-modprobe-d\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.572218 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572164    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg7cl\" (UniqueName: \"kubernetes.io/projected/a523cf63-f5ce-46c3-b3ca-75daceb7c894-kube-api-access-fg7cl\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.572218 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572193    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/191159ed-06e6-43b3-8d6c-11452cd3aa7f-cni-binary-copy\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.572218 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572209    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/191159ed-06e6-43b3-8d6c-11452cd3aa7f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.572309 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-system-cni-dir\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.572309 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572239    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-multus-cni-dir\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.572309 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572256    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-host-var-lib-cni-bin\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.572309 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572291    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-host-var-lib-cni-multus\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.572446 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572322    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.572446 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572353    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/191159ed-06e6-43b3-8d6c-11452cd3aa7f-os-release\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.572446 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572376    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a3209dca-9434-43c6-b423-2ace40e77574-multus-daemon-config\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.572446 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572402    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-node-log\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.572446 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572424    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a523cf63-f5ce-46c3-b3ca-75daceb7c894-ovn-node-metrics-cert\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.572620 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572451    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-kubelet-config\") pod \"global-pull-secret-syncer-zqlwf\" (UID: \"714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91\") " pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:14.572620 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572456    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/191159ed-06e6-43b3-8d6c-11452cd3aa7f-os-release\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.572620 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572483    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-dbus\") pod \"global-pull-secret-syncer-zqlwf\" (UID: \"714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91\") " pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:14.572620 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572509    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-etc-kubernetes\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.572620 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572532    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs\") pod \"network-metrics-daemon-k47j9\" (UID: \"4a380d70-7f9e-4fc4-b28d-520f61003def\") " pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:14.572620 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572554    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-run-ovn\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.572620 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572577    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l4wr\" (UniqueName: \"kubernetes.io/projected/95d4da4f-d62c-4030-885d-ea52f665dc38-kube-api-access-5l4wr\") pod \"aws-ebs-csi-driver-node-qr4bc\" (UID: \"95d4da4f-d62c-4030-885d-ea52f665dc38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.572620 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572598    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/936b35e9-8251-4100-b335-c91679e0c998-tmp-dir\") pod \"node-resolver-ndnjh\" (UID: \"936b35e9-8251-4100-b335-c91679e0c998\") " pod="openshift-dns/node-resolver-ndnjh"
Jul 15 20:59:14.573012 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572620    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-var-lib-openvswitch\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.573012 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572650    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-run-openvswitch\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.573012 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572676    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/63c63623-9437-4680-88c3-1495e3b67d8e-agent-certs\") pod \"konnectivity-agent-lbrvc\" (UID: \"63c63623-9437-4680-88c3-1495e3b67d8e\") " pod="kube-system/konnectivity-agent-lbrvc"
Jul 15 20:59:14.573012 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-etc-sysctl-d\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.573012 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572755    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/191159ed-06e6-43b3-8d6c-11452cd3aa7f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.573012 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572765    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/191159ed-06e6-43b3-8d6c-11452cd3aa7f-cni-binary-copy\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.573012 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572798    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-var-lib-kubelet\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.573012 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572823    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0b4d72f-b8a2-465f-a92d-2201d824ff19-host\") pod \"node-ca-vntdq\" (UID: \"a0b4d72f-b8a2-465f-a92d-2201d824ff19\") " pod="openshift-image-registry/node-ca-vntdq"
Jul 15 20:59:14.573012 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572853    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/191159ed-06e6-43b3-8d6c-11452cd3aa7f-system-cni-dir\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.573012 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572877    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/191159ed-06e6-43b3-8d6c-11452cd3aa7f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.573012 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572894    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/191159ed-06e6-43b3-8d6c-11452cd3aa7f-system-cni-dir\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.573012 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572903    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/936b35e9-8251-4100-b335-c91679e0c998-hosts-file\") pod \"node-resolver-ndnjh\" (UID: \"936b35e9-8251-4100-b335-c91679e0c998\") " pod="openshift-dns/node-resolver-ndnjh"
Jul 15 20:59:14.573012 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572927    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-run\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.573012 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572950    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c9230613-fd2c-4231-85ca-187299a3a504-etc-tuned\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.573012 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572975    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-host-slash\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.573012 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.572997    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a3209dca-9434-43c6-b423-2ace40e77574-cni-binary-copy\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.573012 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573020    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-run-systemd\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.573678 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573031    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/191159ed-06e6-43b3-8d6c-11452cd3aa7f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.573678 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573043    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-etc-openvswitch\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.573678 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573067    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/95d4da4f-d62c-4030-885d-ea52f665dc38-device-dir\") pod \"aws-ebs-csi-driver-node-qr4bc\" (UID: \"95d4da4f-d62c-4030-885d-ea52f665dc38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.573678 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573090    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rthc7\" (UniqueName: \"kubernetes.io/projected/936b35e9-8251-4100-b335-c91679e0c998-kube-api-access-rthc7\") pod \"node-resolver-ndnjh\" (UID: \"936b35e9-8251-4100-b335-c91679e0c998\") " pod="openshift-dns/node-resolver-ndnjh"
Jul 15 20:59:14.573678 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573117    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-etc-sysctl-conf\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.573678 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573140    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-host\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.573678 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573162    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a523cf63-f5ce-46c3-b3ca-75daceb7c894-ovnkube-script-lib\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.573678 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573188    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gpdw\" (UniqueName: \"kubernetes.io/projected/c78e80e5-a1ef-4c31-a40d-36f73bc1e7bf-kube-api-access-9gpdw\") pod \"iptables-alerter-2xdsz\" (UID: \"c78e80e5-a1ef-4c31-a40d-36f73bc1e7bf\") " pod="openshift-network-operator/iptables-alerter-2xdsz"
Jul 15 20:59:14.573678 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573231    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/95d4da4f-d62c-4030-885d-ea52f665dc38-sys-fs\") pod \"aws-ebs-csi-driver-node-qr4bc\" (UID: \"95d4da4f-d62c-4030-885d-ea52f665dc38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.573678 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573254    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-etc-systemd\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.573678 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573291    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-systemd-units\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.573678 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573325    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-host-run-netns\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.573678 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573348    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/95d4da4f-d62c-4030-885d-ea52f665dc38-registration-dir\") pod \"aws-ebs-csi-driver-node-qr4bc\" (UID: \"95d4da4f-d62c-4030-885d-ea52f665dc38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.573678 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573371    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/63c63623-9437-4680-88c3-1495e3b67d8e-konnectivity-ca\") pod \"konnectivity-agent-lbrvc\" (UID: \"63c63623-9437-4680-88c3-1495e3b67d8e\") " pod="kube-system/konnectivity-agent-lbrvc"
Jul 15 20:59:14.573678 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573393    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9230613-fd2c-4231-85ca-187299a3a504-tmp\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.573678 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573423    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-host-run-netns\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.574241 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573445    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-multus-conf-dir\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.574241 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573460    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-etc-kubernetes\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.574241 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573484    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a523cf63-f5ce-46c3-b3ca-75daceb7c894-ovnkube-config\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.574241 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573509    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-lib-modules\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.574241 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573529    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a0b4d72f-b8a2-465f-a92d-2201d824ff19-serviceca\") pod \"node-ca-vntdq\" (UID: \"a0b4d72f-b8a2-465f-a92d-2201d824ff19\") " pod="openshift-image-registry/node-ca-vntdq"
Jul 15 20:59:14.574241 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573548    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv779\" (UniqueName: \"kubernetes.io/projected/a0b4d72f-b8a2-465f-a92d-2201d824ff19-kube-api-access-nv779\") pod \"node-ca-vntdq\" (UID: \"a0b4d72f-b8a2-465f-a92d-2201d824ff19\") " pod="openshift-image-registry/node-ca-vntdq"
Jul 15 20:59:14.574241 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573564    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-host-var-lib-kubelet\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.574241 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573578    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a523cf63-f5ce-46c3-b3ca-75daceb7c894-env-overrides\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.574241 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573613    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/95d4da4f-d62c-4030-885d-ea52f665dc38-socket-dir\") pod \"aws-ebs-csi-driver-node-qr4bc\" (UID: \"95d4da4f-d62c-4030-885d-ea52f665dc38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.574241 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573630    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8fxw\" (UniqueName: \"kubernetes.io/projected/4a380d70-7f9e-4fc4-b28d-520f61003def-kube-api-access-l8fxw\") pod \"network-metrics-daemon-k47j9\" (UID: \"4a380d70-7f9e-4fc4-b28d-520f61003def\") " pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:14.574241 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573647    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/191159ed-06e6-43b3-8d6c-11452cd3aa7f-cnibin\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.574241 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573662    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvhfk\" (UniqueName: \"kubernetes.io/projected/191159ed-06e6-43b3-8d6c-11452cd3aa7f-kube-api-access-vvhfk\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.574241 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573676    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-host-run-multus-certs\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.574241 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573684    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/191159ed-06e6-43b3-8d6c-11452cd3aa7f-cnibin\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.574241 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573690    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-log-socket\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.574241 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573705    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-host-cni-netd\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.574688 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573729    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-host-run-ovn-kubernetes\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.574688 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/95d4da4f-d62c-4030-885d-ea52f665dc38-etc-selinux\") pod \"aws-ebs-csi-driver-node-qr4bc\" (UID: \"95d4da4f-d62c-4030-885d-ea52f665dc38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.574688 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573811    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-sys\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.574688 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573843    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-cnibin\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.574688 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573865    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-host-cni-bin\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.574688 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573889    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q2h8\" (UniqueName: \"kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8\") pod \"network-check-target-z9bpw\" (UID: \"e670c826-029c-4b43-8594-3caf0693e896\") " pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:14.574688 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573912    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/95d4da4f-d62c-4030-885d-ea52f665dc38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qr4bc\" (UID: \"95d4da4f-d62c-4030-885d-ea52f665dc38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.574688 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573934    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-etc-sysconfig\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.574688 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573961    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m4xf\" (UniqueName: \"kubernetes.io/projected/c9230613-fd2c-4231-85ca-187299a3a504-kube-api-access-9m4xf\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.574688 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.573983    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/191159ed-06e6-43b3-8d6c-11452cd3aa7f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.574688 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.574025    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-host-run-k8s-cni-cncf-io\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.574688 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.574046    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-hostroot\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.574688 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.574061    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5x2c\" (UniqueName: \"kubernetes.io/projected/a3209dca-9434-43c6-b423-2ace40e77574-kube-api-access-p5x2c\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.574688 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.574081    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c78e80e5-a1ef-4c31-a40d-36f73bc1e7bf-host-slash\") pod \"iptables-alerter-2xdsz\" (UID: \"c78e80e5-a1ef-4c31-a40d-36f73bc1e7bf\") " pod="openshift-network-operator/iptables-alerter-2xdsz"
Jul 15 20:59:14.574688 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.574110    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret\") pod \"global-pull-secret-syncer-zqlwf\" (UID: \"714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91\") " pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:14.574688 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.574312    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/191159ed-06e6-43b3-8d6c-11452cd3aa7f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.580041 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.580014    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 20:59:14.583235 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.583217    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvhfk\" (UniqueName: \"kubernetes.io/projected/191159ed-06e6-43b3-8d6c-11452cd3aa7f-kube-api-access-vvhfk\") pod \"multus-additional-cni-plugins-kkgc7\" (UID: \"191159ed-06e6-43b3-8d6c-11452cd3aa7f\") " pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.674660 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.674624    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/936b35e9-8251-4100-b335-c91679e0c998-hosts-file\") pod \"node-resolver-ndnjh\" (UID: \"936b35e9-8251-4100-b335-c91679e0c998\") " pod="openshift-dns/node-resolver-ndnjh"
Jul 15 20:59:14.674660 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.674661    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-run\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.674923 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.674680    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c9230613-fd2c-4231-85ca-187299a3a504-etc-tuned\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.674923 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.674702    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-host-slash\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.674923 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.674725    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a3209dca-9434-43c6-b423-2ace40e77574-cni-binary-copy\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.674923 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.674747    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-run-systemd\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.674923 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.674786    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-etc-openvswitch\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.674923 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.674789    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-run\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.674923 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.674789    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/936b35e9-8251-4100-b335-c91679e0c998-hosts-file\") pod \"node-resolver-ndnjh\" (UID: \"936b35e9-8251-4100-b335-c91679e0c998\") " pod="openshift-dns/node-resolver-ndnjh"
Jul 15 20:59:14.674923 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.674816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/95d4da4f-d62c-4030-885d-ea52f665dc38-device-dir\") pod \"aws-ebs-csi-driver-node-qr4bc\" (UID: \"95d4da4f-d62c-4030-885d-ea52f665dc38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.674923 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.674809    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-host-slash\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.674923 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.674837    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-etc-openvswitch\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.674923 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.674858    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rthc7\" (UniqueName: \"kubernetes.io/projected/936b35e9-8251-4100-b335-c91679e0c998-kube-api-access-rthc7\") pod \"node-resolver-ndnjh\" (UID: \"936b35e9-8251-4100-b335-c91679e0c998\") " pod="openshift-dns/node-resolver-ndnjh"
Jul 15 20:59:14.674923 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.674882    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/95d4da4f-d62c-4030-885d-ea52f665dc38-device-dir\") pod \"aws-ebs-csi-driver-node-qr4bc\" (UID: \"95d4da4f-d62c-4030-885d-ea52f665dc38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.674923 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.674873    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-run-systemd\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.674923 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.674886    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-etc-sysctl-conf\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.674923 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.674924    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-host\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.675535 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.674950    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a523cf63-f5ce-46c3-b3ca-75daceb7c894-ovnkube-script-lib\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.675535 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.674971    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gpdw\" (UniqueName: \"kubernetes.io/projected/c78e80e5-a1ef-4c31-a40d-36f73bc1e7bf-kube-api-access-9gpdw\") pod \"iptables-alerter-2xdsz\" (UID: \"c78e80e5-a1ef-4c31-a40d-36f73bc1e7bf\") " pod="openshift-network-operator/iptables-alerter-2xdsz"
Jul 15 20:59:14.675535 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.674987    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/95d4da4f-d62c-4030-885d-ea52f665dc38-sys-fs\") pod \"aws-ebs-csi-driver-node-qr4bc\" (UID: \"95d4da4f-d62c-4030-885d-ea52f665dc38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.675535 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.674985    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-host\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.675535 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675010    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-etc-sysctl-conf\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.675535 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675012    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-etc-systemd\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.675535 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-systemd-units\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.675535 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675057    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-etc-systemd\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.675535 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675067    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-host-run-netns\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.675535 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675088    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/95d4da4f-d62c-4030-885d-ea52f665dc38-registration-dir\") pod \"aws-ebs-csi-driver-node-qr4bc\" (UID: \"95d4da4f-d62c-4030-885d-ea52f665dc38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.675535 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675108    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/95d4da4f-d62c-4030-885d-ea52f665dc38-sys-fs\") pod \"aws-ebs-csi-driver-node-qr4bc\" (UID: \"95d4da4f-d62c-4030-885d-ea52f665dc38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.675535 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675139    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/63c63623-9437-4680-88c3-1495e3b67d8e-konnectivity-ca\") pod \"konnectivity-agent-lbrvc\" (UID: \"63c63623-9437-4680-88c3-1495e3b67d8e\") " pod="kube-system/konnectivity-agent-lbrvc"
Jul 15 20:59:14.675535 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675163    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9230613-fd2c-4231-85ca-187299a3a504-tmp\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.675535 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675165    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-host-run-netns\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.675535 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675145    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-systemd-units\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.675535 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675187    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-host-run-netns\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.675535 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675208    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-multus-conf-dir\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.675535 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675234    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-etc-kubernetes\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.676352 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675279    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-etc-kubernetes\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.676352 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675286    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/95d4da4f-d62c-4030-885d-ea52f665dc38-registration-dir\") pod \"aws-ebs-csi-driver-node-qr4bc\" (UID: \"95d4da4f-d62c-4030-885d-ea52f665dc38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.676352 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675319    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-multus-conf-dir\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.676352 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675327    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-host-run-netns\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.676352 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675345    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a523cf63-f5ce-46c3-b3ca-75daceb7c894-ovnkube-config\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.676352 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675368    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-lib-modules\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.676352 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675394    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a0b4d72f-b8a2-465f-a92d-2201d824ff19-serviceca\") pod \"node-ca-vntdq\" (UID: \"a0b4d72f-b8a2-465f-a92d-2201d824ff19\") " pod="openshift-image-registry/node-ca-vntdq"
Jul 15 20:59:14.676352 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv779\" (UniqueName: \"kubernetes.io/projected/a0b4d72f-b8a2-465f-a92d-2201d824ff19-kube-api-access-nv779\") pod \"node-ca-vntdq\" (UID: \"a0b4d72f-b8a2-465f-a92d-2201d824ff19\") " pod="openshift-image-registry/node-ca-vntdq"
Jul 15 20:59:14.676352 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675437    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-host-var-lib-kubelet\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.676352 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675467    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a523cf63-f5ce-46c3-b3ca-75daceb7c894-env-overrides\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.676352 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675491    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/95d4da4f-d62c-4030-885d-ea52f665dc38-socket-dir\") pod \"aws-ebs-csi-driver-node-qr4bc\" (UID: \"95d4da4f-d62c-4030-885d-ea52f665dc38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.676352 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675519    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8fxw\" (UniqueName: \"kubernetes.io/projected/4a380d70-7f9e-4fc4-b28d-520f61003def-kube-api-access-l8fxw\") pod \"network-metrics-daemon-k47j9\" (UID: \"4a380d70-7f9e-4fc4-b28d-520f61003def\") " pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:14.676352 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675546    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-host-run-multus-certs\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.676352 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675584    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-log-socket\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.676352 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-host-cni-netd\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.676352 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675636    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-host-run-ovn-kubernetes\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.676352 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675657    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/95d4da4f-d62c-4030-885d-ea52f665dc38-etc-selinux\") pod \"aws-ebs-csi-driver-node-qr4bc\" (UID: \"95d4da4f-d62c-4030-885d-ea52f665dc38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.677161 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675677    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-sys\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.677161 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675674    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a523cf63-f5ce-46c3-b3ca-75daceb7c894-ovnkube-script-lib\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.677161 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675721    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/95d4da4f-d62c-4030-885d-ea52f665dc38-socket-dir\") pod \"aws-ebs-csi-driver-node-qr4bc\" (UID: \"95d4da4f-d62c-4030-885d-ea52f665dc38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.677161 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675736    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/63c63623-9437-4680-88c3-1495e3b67d8e-konnectivity-ca\") pod \"konnectivity-agent-lbrvc\" (UID: \"63c63623-9437-4680-88c3-1495e3b67d8e\") " pod="kube-system/konnectivity-agent-lbrvc"
Jul 15 20:59:14.677161 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675730    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-sys\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.677161 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-cnibin\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.677161 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675806    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-host-cni-bin\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.677161 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675808    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-host-run-multus-certs\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.677161 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675846    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-host-cni-bin\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.677161 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675850    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q2h8\" (UniqueName: \"kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8\") pod \"network-check-target-z9bpw\" (UID: \"e670c826-029c-4b43-8594-3caf0693e896\") " pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:14.677161 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675855    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a523cf63-f5ce-46c3-b3ca-75daceb7c894-ovnkube-config\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.677161 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675858    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/95d4da4f-d62c-4030-885d-ea52f665dc38-etc-selinux\") pod \"aws-ebs-csi-driver-node-qr4bc\" (UID: \"95d4da4f-d62c-4030-885d-ea52f665dc38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.677161 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675736    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-log-socket\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.677161 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675737    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-host-var-lib-kubelet\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.677161 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675878    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/95d4da4f-d62c-4030-885d-ea52f665dc38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qr4bc\" (UID: \"95d4da4f-d62c-4030-885d-ea52f665dc38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.677161 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675917    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-etc-sysconfig\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.677161 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675927    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-cnibin\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.677161 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675946    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a3209dca-9434-43c6-b423-2ace40e77574-cni-binary-copy\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.677985 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675950    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m4xf\" (UniqueName: \"kubernetes.io/projected/c9230613-fd2c-4231-85ca-187299a3a504-kube-api-access-9m4xf\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.677985 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675980    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-etc-sysconfig\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.677985 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.675993    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-host-run-k8s-cni-cncf-io\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.677985 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676000    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-lib-modules\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.677985 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676031    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-hostroot\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.677985 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676035    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-host-run-k8s-cni-cncf-io\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.677985 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676057    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5x2c\" (UniqueName: \"kubernetes.io/projected/a3209dca-9434-43c6-b423-2ace40e77574-kube-api-access-p5x2c\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.677985 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676082    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c78e80e5-a1ef-4c31-a40d-36f73bc1e7bf-host-slash\") pod \"iptables-alerter-2xdsz\" (UID: \"c78e80e5-a1ef-4c31-a40d-36f73bc1e7bf\") " pod="openshift-network-operator/iptables-alerter-2xdsz"
Jul 15 20:59:14.677985 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676089    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-host-run-ovn-kubernetes\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.677985 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676108    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret\") pod \"global-pull-secret-syncer-zqlwf\" (UID: \"714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91\") " pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:14.677985 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676114    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-hostroot\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.677985 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676109    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a523cf63-f5ce-46c3-b3ca-75daceb7c894-env-overrides\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.677985 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676138    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-host-cni-netd\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.677985 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676145    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-os-release\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.677985 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676175    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/95d4da4f-d62c-4030-885d-ea52f665dc38-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qr4bc\" (UID: \"95d4da4f-d62c-4030-885d-ea52f665dc38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.677985 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676186    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c78e80e5-a1ef-4c31-a40d-36f73bc1e7bf-host-slash\") pod \"iptables-alerter-2xdsz\" (UID: \"c78e80e5-a1ef-4c31-a40d-36f73bc1e7bf\") " pod="openshift-network-operator/iptables-alerter-2xdsz"
Jul 15 20:59:14.677985 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676189    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-multus-socket-dir-parent\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.677985 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676195    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-os-release\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.678547 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676243    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-host-kubelet\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.678547 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:14.676265    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:14.678547 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676269    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c78e80e5-a1ef-4c31-a40d-36f73bc1e7bf-iptables-alerter-script\") pod \"iptables-alerter-2xdsz\" (UID: \"c78e80e5-a1ef-4c31-a40d-36f73bc1e7bf\") " pod="openshift-network-operator/iptables-alerter-2xdsz"
Jul 15 20:59:14.678547 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676276    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-host-kubelet\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.678547 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676243    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-multus-socket-dir-parent\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.678547 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:14.676347    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret podName:714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:15.176319355 +0000 UTC m=+2.366998780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret") pod "global-pull-secret-syncer-zqlwf" (UID: "714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91") : object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:14.678547 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676370    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-etc-modprobe-d\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.678547 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676400    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg7cl\" (UniqueName: \"kubernetes.io/projected/a523cf63-f5ce-46c3-b3ca-75daceb7c894-kube-api-access-fg7cl\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.678547 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676428    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-system-cni-dir\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.678547 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676454    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-multus-cni-dir\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.678547 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676480    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-host-var-lib-cni-bin\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.678547 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676501    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-etc-modprobe-d\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.678547 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676504    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-host-var-lib-cni-multus\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.678547 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676552    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-system-cni-dir\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.678547 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676589    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-host-var-lib-cni-multus\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.678547 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676612    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.678547 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676632    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-multus-cni-dir\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.679106 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676636    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3209dca-9434-43c6-b423-2ace40e77574-host-var-lib-cni-bin\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.679106 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676675    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a3209dca-9434-43c6-b423-2ace40e77574-multus-daemon-config\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.679106 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676712    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-node-log\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.679106 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676735    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a523cf63-f5ce-46c3-b3ca-75daceb7c894-ovn-node-metrics-cert\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.679106 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676736    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a0b4d72f-b8a2-465f-a92d-2201d824ff19-serviceca\") pod \"node-ca-vntdq\" (UID: \"a0b4d72f-b8a2-465f-a92d-2201d824ff19\") " pod="openshift-image-registry/node-ca-vntdq"
Jul 15 20:59:14.679106 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676800    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-kubelet-config\") pod \"global-pull-secret-syncer-zqlwf\" (UID: \"714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91\") " pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:14.679106 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676843    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-node-log\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.679106 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676848    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.679106 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676883    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-dbus\") pod \"global-pull-secret-syncer-zqlwf\" (UID: \"714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91\") " pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:14.679106 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676934    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-kubelet-config\") pod \"global-pull-secret-syncer-zqlwf\" (UID: \"714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91\") " pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:14.679106 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676962    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-etc-kubernetes\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.679106 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.677004    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-etc-kubernetes\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.679106 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.676939    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-dbus\") pod \"global-pull-secret-syncer-zqlwf\" (UID: \"714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91\") " pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:14.679106 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.677046    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs\") pod \"network-metrics-daemon-k47j9\" (UID: \"4a380d70-7f9e-4fc4-b28d-520f61003def\") " pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:14.679106 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.677084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-run-ovn\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.679106 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.677087    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c78e80e5-a1ef-4c31-a40d-36f73bc1e7bf-iptables-alerter-script\") pod \"iptables-alerter-2xdsz\" (UID: \"c78e80e5-a1ef-4c31-a40d-36f73bc1e7bf\") " pod="openshift-network-operator/iptables-alerter-2xdsz"
Jul 15 20:59:14.679106 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.677110    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l4wr\" (UniqueName: \"kubernetes.io/projected/95d4da4f-d62c-4030-885d-ea52f665dc38-kube-api-access-5l4wr\") pod \"aws-ebs-csi-driver-node-qr4bc\" (UID: \"95d4da4f-d62c-4030-885d-ea52f665dc38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.679575 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.677144    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/936b35e9-8251-4100-b335-c91679e0c998-tmp-dir\") pod \"node-resolver-ndnjh\" (UID: \"936b35e9-8251-4100-b335-c91679e0c998\") " pod="openshift-dns/node-resolver-ndnjh"
Jul 15 20:59:14.679575 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.677166    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-var-lib-openvswitch\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.679575 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.677173    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a3209dca-9434-43c6-b423-2ace40e77574-multus-daemon-config\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.679575 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.677189    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-run-openvswitch\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.679575 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.677227    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-var-lib-openvswitch\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.679575 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:14.677252    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:14.679575 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:14.677307    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs podName:4a380d70-7f9e-4fc4-b28d-520f61003def nodeName:}" failed. No retries permitted until 2026-07-15 20:59:15.177293588 +0000 UTC m=+2.367972996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs") pod "network-metrics-daemon-k47j9" (UID: "4a380d70-7f9e-4fc4-b28d-520f61003def") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:14.679575 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.677342    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/63c63623-9437-4680-88c3-1495e3b67d8e-agent-certs\") pod \"konnectivity-agent-lbrvc\" (UID: \"63c63623-9437-4680-88c3-1495e3b67d8e\") " pod="kube-system/konnectivity-agent-lbrvc"
Jul 15 20:59:14.679575 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.677382    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-run-ovn\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.679575 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.677482    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/936b35e9-8251-4100-b335-c91679e0c998-tmp-dir\") pod \"node-resolver-ndnjh\" (UID: \"936b35e9-8251-4100-b335-c91679e0c998\") " pod="openshift-dns/node-resolver-ndnjh"
Jul 15 20:59:14.679575 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.677504    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-etc-sysctl-d\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.679575 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.677383    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-etc-sysctl-d\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.679575 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.677579    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a523cf63-f5ce-46c3-b3ca-75daceb7c894-run-openvswitch\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.679575 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.677608    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-var-lib-kubelet\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.679575 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.677669    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0b4d72f-b8a2-465f-a92d-2201d824ff19-host\") pod \"node-ca-vntdq\" (UID: \"a0b4d72f-b8a2-465f-a92d-2201d824ff19\") " pod="openshift-image-registry/node-ca-vntdq"
Jul 15 20:59:14.679575 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.677678    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9230613-fd2c-4231-85ca-187299a3a504-var-lib-kubelet\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.679575 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.677762    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0b4d72f-b8a2-465f-a92d-2201d824ff19-host\") pod \"node-ca-vntdq\" (UID: \"a0b4d72f-b8a2-465f-a92d-2201d824ff19\") " pod="openshift-image-registry/node-ca-vntdq"
Jul 15 20:59:14.679575 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.678013    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9230613-fd2c-4231-85ca-187299a3a504-tmp\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.680114 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.678181    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c9230613-fd2c-4231-85ca-187299a3a504-etc-tuned\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.680114 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.679004    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a523cf63-f5ce-46c3-b3ca-75daceb7c894-ovn-node-metrics-cert\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.680114 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.679484    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/63c63623-9437-4680-88c3-1495e3b67d8e-agent-certs\") pod \"konnectivity-agent-lbrvc\" (UID: \"63c63623-9437-4680-88c3-1495e3b67d8e\") " pod="kube-system/konnectivity-agent-lbrvc"
Jul 15 20:59:14.696266 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.696230    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gpdw\" (UniqueName: \"kubernetes.io/projected/c78e80e5-a1ef-4c31-a40d-36f73bc1e7bf-kube-api-access-9gpdw\") pod \"iptables-alerter-2xdsz\" (UID: \"c78e80e5-a1ef-4c31-a40d-36f73bc1e7bf\") " pod="openshift-network-operator/iptables-alerter-2xdsz"
Jul 15 20:59:14.696397 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.696288    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv779\" (UniqueName: \"kubernetes.io/projected/a0b4d72f-b8a2-465f-a92d-2201d824ff19-kube-api-access-nv779\") pod \"node-ca-vntdq\" (UID: \"a0b4d72f-b8a2-465f-a92d-2201d824ff19\") " pod="openshift-image-registry/node-ca-vntdq"
Jul 15 20:59:14.696397 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.696290    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rthc7\" (UniqueName: \"kubernetes.io/projected/936b35e9-8251-4100-b335-c91679e0c998-kube-api-access-rthc7\") pod \"node-resolver-ndnjh\" (UID: \"936b35e9-8251-4100-b335-c91679e0c998\") " pod="openshift-dns/node-resolver-ndnjh"
Jul 15 20:59:14.696508 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.696492    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m4xf\" (UniqueName: \"kubernetes.io/projected/c9230613-fd2c-4231-85ca-187299a3a504-kube-api-access-9m4xf\") pod \"tuned-w4h68\" (UID: \"c9230613-fd2c-4231-85ca-187299a3a504\") " pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.713912 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:14.713890    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 20:59:14.713988 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:14.713917    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 20:59:14.713988 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:14.713928    2560 projected.go:196] Error preparing data for projected volume kube-api-access-6q2h8 for pod openshift-network-diagnostics/network-check-target-z9bpw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:14.713988 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:14.713987    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8 podName:e670c826-029c-4b43-8594-3caf0693e896 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:15.213971964 +0000 UTC m=+2.404651372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6q2h8" (UniqueName: "kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8") pod "network-check-target-z9bpw" (UID: "e670c826-029c-4b43-8594-3caf0693e896") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:14.716635 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.716610    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg7cl\" (UniqueName: \"kubernetes.io/projected/a523cf63-f5ce-46c3-b3ca-75daceb7c894-kube-api-access-fg7cl\") pod \"ovnkube-node-5nl52\" (UID: \"a523cf63-f5ce-46c3-b3ca-75daceb7c894\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.717107 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.717086    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5x2c\" (UniqueName: \"kubernetes.io/projected/a3209dca-9434-43c6-b423-2ace40e77574-kube-api-access-p5x2c\") pod \"multus-2r9lp\" (UID: \"a3209dca-9434-43c6-b423-2ace40e77574\") " pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.718714 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.718690    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l4wr\" (UniqueName: \"kubernetes.io/projected/95d4da4f-d62c-4030-885d-ea52f665dc38-kube-api-access-5l4wr\") pod \"aws-ebs-csi-driver-node-qr4bc\" (UID: \"95d4da4f-d62c-4030-885d-ea52f665dc38\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.719502 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.719487    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8fxw\" (UniqueName: \"kubernetes.io/projected/4a380d70-7f9e-4fc4-b28d-520f61003def-kube-api-access-l8fxw\") pod \"network-metrics-daemon-k47j9\" (UID: \"4a380d70-7f9e-4fc4-b28d-520f61003def\") " pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:14.796019 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.795930    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kkgc7"
Jul 15 20:59:14.804947 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:14.804913    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod191159ed_06e6_43b3_8d6c_11452cd3aa7f.slice/crio-f638f708679d5ea9d8755c5ce32d3838f8cf7eda5e9b6f9a4f927955abc1d957 WatchSource:0}: Error finding container f638f708679d5ea9d8755c5ce32d3838f8cf7eda5e9b6f9a4f927955abc1d957: Status 404 returned error can't find the container with id f638f708679d5ea9d8755c5ce32d3838f8cf7eda5e9b6f9a4f927955abc1d957
Jul 15 20:59:14.815392 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.815363    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2r9lp"
Jul 15 20:59:14.823415 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:14.823389    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3209dca_9434_43c6_b423_2ace40e77574.slice/crio-81e6a0b621d6f5472139594fee43577fc2001f8b1f5b773d56732f4688d8a3e1 WatchSource:0}: Error finding container 81e6a0b621d6f5472139594fee43577fc2001f8b1f5b773d56732f4688d8a3e1: Status 404 returned error can't find the container with id 81e6a0b621d6f5472139594fee43577fc2001f8b1f5b773d56732f4688d8a3e1
Jul 15 20:59:14.840431 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.840400    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lbrvc"
Jul 15 20:59:14.844553 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.844528    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w4h68"
Jul 15 20:59:14.849445 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.849421    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:14.852944 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:14.852917    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c63623_9437_4680_88c3_1495e3b67d8e.slice/crio-93c539b8b792f2d6fc93ca1b63f113d9b1a642643ab2bcf355e13ce3196dc205 WatchSource:0}: Error finding container 93c539b8b792f2d6fc93ca1b63f113d9b1a642643ab2bcf355e13ce3196dc205: Status 404 returned error can't find the container with id 93c539b8b792f2d6fc93ca1b63f113d9b1a642643ab2bcf355e13ce3196dc205
Jul 15 20:59:14.853960 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:14.853924    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9230613_fd2c_4231_85ca_187299a3a504.slice/crio-469b1612bf91838039bb44df1283810ffaa510f8a66a9b3c7f2ce0434b580d62 WatchSource:0}: Error finding container 469b1612bf91838039bb44df1283810ffaa510f8a66a9b3c7f2ce0434b580d62: Status 404 returned error can't find the container with id 469b1612bf91838039bb44df1283810ffaa510f8a66a9b3c7f2ce0434b580d62
Jul 15 20:59:14.855583 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.855379    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2xdsz"
Jul 15 20:59:14.859821 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:14.859796    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda523cf63_f5ce_46c3_b3ca_75daceb7c894.slice/crio-ddf291db29abd46d88a9e2ba1e91a6f0f0a9f1a55ee99985ffeb5289fcf991d9 WatchSource:0}: Error finding container ddf291db29abd46d88a9e2ba1e91a6f0f0a9f1a55ee99985ffeb5289fcf991d9: Status 404 returned error can't find the container with id ddf291db29abd46d88a9e2ba1e91a6f0f0a9f1a55ee99985ffeb5289fcf991d9
Jul 15 20:59:14.861094 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.861073    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc"
Jul 15 20:59:14.865291 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:14.865267    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc78e80e5_a1ef_4c31_a40d_36f73bc1e7bf.slice/crio-95f2ec58efa9e347ab242b1628df9cc1bb35204ba433e5ed77b2d57a1989aa3f WatchSource:0}: Error finding container 95f2ec58efa9e347ab242b1628df9cc1bb35204ba433e5ed77b2d57a1989aa3f: Status 404 returned error can't find the container with id 95f2ec58efa9e347ab242b1628df9cc1bb35204ba433e5ed77b2d57a1989aa3f
Jul 15 20:59:14.866553 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.866530    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ndnjh"
Jul 15 20:59:14.871764 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:14.871731    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vntdq"
Jul 15 20:59:14.874969 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:14.874884    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95d4da4f_d62c_4030_885d_ea52f665dc38.slice/crio-b6f7668d03f8aa29b1c84b835c1805eea6bcf8003c5828de6bab49df863ba6ea WatchSource:0}: Error finding container b6f7668d03f8aa29b1c84b835c1805eea6bcf8003c5828de6bab49df863ba6ea: Status 404 returned error can't find the container with id b6f7668d03f8aa29b1c84b835c1805eea6bcf8003c5828de6bab49df863ba6ea
Jul 15 20:59:14.880702 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:14.880677    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod936b35e9_8251_4100_b335_c91679e0c998.slice/crio-6441bd1a42fa894a8b09ce776878c4e71cf823f25767930ca9e79a1bf1854d77 WatchSource:0}: Error finding container 6441bd1a42fa894a8b09ce776878c4e71cf823f25767930ca9e79a1bf1854d77: Status 404 returned error can't find the container with id 6441bd1a42fa894a8b09ce776878c4e71cf823f25767930ca9e79a1bf1854d77
Jul 15 20:59:14.886489 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:14.886442    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0b4d72f_b8a2_465f_a92d_2201d824ff19.slice/crio-8e4224f823ee6975ae00bab813a429d14ab3d44cda0ac7fd55ce4b8f050f89ab WatchSource:0}: Error finding container 8e4224f823ee6975ae00bab813a429d14ab3d44cda0ac7fd55ce4b8f050f89ab: Status 404 returned error can't find the container with id 8e4224f823ee6975ae00bab813a429d14ab3d44cda0ac7fd55ce4b8f050f89ab
Jul 15 20:59:15.021140 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:15.021101    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 20:59:15.181652 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:15.180936    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret\") pod \"global-pull-secret-syncer-zqlwf\" (UID: \"714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91\") " pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:15.181652 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:15.180992    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs\") pod \"network-metrics-daemon-k47j9\" (UID: \"4a380d70-7f9e-4fc4-b28d-520f61003def\") " pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:15.181652 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:15.181141    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:15.181652 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:15.181200    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs podName:4a380d70-7f9e-4fc4-b28d-520f61003def nodeName:}" failed. No retries permitted until 2026-07-15 20:59:16.18118338 +0000 UTC m=+3.371862795 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs") pod "network-metrics-daemon-k47j9" (UID: "4a380d70-7f9e-4fc4-b28d-520f61003def") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:15.181652 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:15.181572    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:15.181652 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:15.181617    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret podName:714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:16.181603318 +0000 UTC m=+3.372282728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret") pod "global-pull-secret-syncer-zqlwf" (UID: "714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91") : object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:15.282292 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:15.282045    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q2h8\" (UniqueName: \"kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8\") pod \"network-check-target-z9bpw\" (UID: \"e670c826-029c-4b43-8594-3caf0693e896\") " pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:15.282292 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:15.282206    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 20:59:15.282292 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:15.282228    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 20:59:15.282292 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:15.282242    2560 projected.go:196] Error preparing data for projected volume kube-api-access-6q2h8 for pod openshift-network-diagnostics/network-check-target-z9bpw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:15.282292 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:15.282308    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8 podName:e670c826-029c-4b43-8594-3caf0693e896 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:16.282288581 +0000 UTC m=+3.472967989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6q2h8" (UniqueName: "kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8") pod "network-check-target-z9bpw" (UID: "e670c826-029c-4b43-8594-3caf0693e896") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:15.512093 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:15.511997    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 20:54:14 +0000 UTC" deadline="2028-04-11 00:43:35.017880776 +0000 UTC"
Jul 15 20:59:15.512093 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:15.512043    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15243h44m19.505842427s"
Jul 15 20:59:15.599614 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:15.599574    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vntdq" event={"ID":"a0b4d72f-b8a2-465f-a92d-2201d824ff19","Type":"ContainerStarted","Data":"8e4224f823ee6975ae00bab813a429d14ab3d44cda0ac7fd55ce4b8f050f89ab"}
Jul 15 20:59:15.610993 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:15.610887    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc" event={"ID":"95d4da4f-d62c-4030-885d-ea52f665dc38","Type":"ContainerStarted","Data":"b6f7668d03f8aa29b1c84b835c1805eea6bcf8003c5828de6bab49df863ba6ea"}
Jul 15 20:59:15.621381 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:15.621331    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 20:59:15.629176 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:15.629112    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nl52" event={"ID":"a523cf63-f5ce-46c3-b3ca-75daceb7c894","Type":"ContainerStarted","Data":"ddf291db29abd46d88a9e2ba1e91a6f0f0a9f1a55ee99985ffeb5289fcf991d9"}
Jul 15 20:59:15.642729 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:15.642694    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w4h68" event={"ID":"c9230613-fd2c-4231-85ca-187299a3a504","Type":"ContainerStarted","Data":"469b1612bf91838039bb44df1283810ffaa510f8a66a9b3c7f2ce0434b580d62"}
Jul 15 20:59:15.652954 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:15.652843    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kkgc7" event={"ID":"191159ed-06e6-43b3-8d6c-11452cd3aa7f","Type":"ContainerStarted","Data":"f638f708679d5ea9d8755c5ce32d3838f8cf7eda5e9b6f9a4f927955abc1d957"}
Jul 15 20:59:15.655964 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:15.655926    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ndnjh" event={"ID":"936b35e9-8251-4100-b335-c91679e0c998","Type":"ContainerStarted","Data":"6441bd1a42fa894a8b09ce776878c4e71cf823f25767930ca9e79a1bf1854d77"}
Jul 15 20:59:15.658969 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:15.658887    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2xdsz" event={"ID":"c78e80e5-a1ef-4c31-a40d-36f73bc1e7bf","Type":"ContainerStarted","Data":"95f2ec58efa9e347ab242b1628df9cc1bb35204ba433e5ed77b2d57a1989aa3f"}
Jul 15 20:59:15.661482 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:15.661398    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lbrvc" event={"ID":"63c63623-9437-4680-88c3-1495e3b67d8e","Type":"ContainerStarted","Data":"93c539b8b792f2d6fc93ca1b63f113d9b1a642643ab2bcf355e13ce3196dc205"}
Jul 15 20:59:15.667097 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:15.667027    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2r9lp" event={"ID":"a3209dca-9434-43c6-b423-2ace40e77574","Type":"ContainerStarted","Data":"81e6a0b621d6f5472139594fee43577fc2001f8b1f5b773d56732f4688d8a3e1"}
Jul 15 20:59:16.190388 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:16.189415    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret\") pod \"global-pull-secret-syncer-zqlwf\" (UID: \"714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91\") " pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:16.190388 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:16.189481    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs\") pod \"network-metrics-daemon-k47j9\" (UID: \"4a380d70-7f9e-4fc4-b28d-520f61003def\") " pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:16.190388 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:16.189635    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:16.190388 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:16.189740    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs podName:4a380d70-7f9e-4fc4-b28d-520f61003def nodeName:}" failed. No retries permitted until 2026-07-15 20:59:18.189720038 +0000 UTC m=+5.380399447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs") pod "network-metrics-daemon-k47j9" (UID: "4a380d70-7f9e-4fc4-b28d-520f61003def") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:16.190388 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:16.190288    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:16.190388 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:16.190346    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret podName:714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:18.19032907 +0000 UTC m=+5.381008479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret") pod "global-pull-secret-syncer-zqlwf" (UID: "714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91") : object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:16.291214 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:16.290563    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q2h8\" (UniqueName: \"kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8\") pod \"network-check-target-z9bpw\" (UID: \"e670c826-029c-4b43-8594-3caf0693e896\") " pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:16.291214 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:16.290784    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 20:59:16.291214 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:16.290805    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 20:59:16.291214 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:16.290818    2560 projected.go:196] Error preparing data for projected volume kube-api-access-6q2h8 for pod openshift-network-diagnostics/network-check-target-z9bpw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:16.291214 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:16.290879    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8 podName:e670c826-029c-4b43-8594-3caf0693e896 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:18.290859955 +0000 UTC m=+5.481539365 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6q2h8" (UniqueName: "kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8") pod "network-check-target-z9bpw" (UID: "e670c826-029c-4b43-8594-3caf0693e896") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:16.512983 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:16.512866    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 20:54:14 +0000 UTC" deadline="2028-03-03 09:17:45.057267533 +0000 UTC"
Jul 15 20:59:16.512983 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:16.512932    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14316h18m28.54433973s"
Jul 15 20:59:16.568557 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:16.568524    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:16.568743 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:16.568669    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k47j9" podUID="4a380d70-7f9e-4fc4-b28d-520f61003def"
Jul 15 20:59:16.569174 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:16.569098    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:16.569250 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:16.569186    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bpw" podUID="e670c826-029c-4b43-8594-3caf0693e896"
Jul 15 20:59:16.569250 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:16.569245    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:16.569355 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:16.569316    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqlwf" podUID="714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91"
Jul 15 20:59:17.023795 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:17.023651    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 20:59:17.472699 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:17.472665    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 20:59:18.210460 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:18.210422    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret\") pod \"global-pull-secret-syncer-zqlwf\" (UID: \"714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91\") " pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:18.211001 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:18.210488    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs\") pod \"network-metrics-daemon-k47j9\" (UID: \"4a380d70-7f9e-4fc4-b28d-520f61003def\") " pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:18.211001 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:18.210623    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:18.211001 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:18.210683    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs podName:4a380d70-7f9e-4fc4-b28d-520f61003def nodeName:}" failed. No retries permitted until 2026-07-15 20:59:22.210665268 +0000 UTC m=+9.401344680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs") pod "network-metrics-daemon-k47j9" (UID: "4a380d70-7f9e-4fc4-b28d-520f61003def") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:18.211001 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:18.210864    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:18.211001 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:18.210912    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret podName:714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:22.21089709 +0000 UTC m=+9.401576503 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret") pod "global-pull-secret-syncer-zqlwf" (UID: "714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91") : object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:18.311747 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:18.311707    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q2h8\" (UniqueName: \"kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8\") pod \"network-check-target-z9bpw\" (UID: \"e670c826-029c-4b43-8594-3caf0693e896\") " pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:18.312007 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:18.311980    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 20:59:18.312113 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:18.312014    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 20:59:18.312113 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:18.312028    2560 projected.go:196] Error preparing data for projected volume kube-api-access-6q2h8 for pod openshift-network-diagnostics/network-check-target-z9bpw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:18.312113 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:18.312094    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8 podName:e670c826-029c-4b43-8594-3caf0693e896 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:22.312075898 +0000 UTC m=+9.502755305 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6q2h8" (UniqueName: "kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8") pod "network-check-target-z9bpw" (UID: "e670c826-029c-4b43-8594-3caf0693e896") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:18.568910 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:18.568315    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:18.568910 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:18.568450    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bpw" podUID="e670c826-029c-4b43-8594-3caf0693e896"
Jul 15 20:59:18.568910 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:18.568649    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:18.568910 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:18.568649    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:18.568910 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:18.568782    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqlwf" podUID="714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91"
Jul 15 20:59:18.568910 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:18.568834    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k47j9" podUID="4a380d70-7f9e-4fc4-b28d-520f61003def"
Jul 15 20:59:20.567988 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:20.567951    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:20.568453 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:20.568117    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k47j9" podUID="4a380d70-7f9e-4fc4-b28d-520f61003def"
Jul 15 20:59:20.568453 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:20.568209    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:20.568453 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:20.568219    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:20.568453 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:20.568296    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bpw" podUID="e670c826-029c-4b43-8594-3caf0693e896"
Jul 15 20:59:20.568453 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:20.568369    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqlwf" podUID="714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91"
Jul 15 20:59:22.249519 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:22.249460    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs\") pod \"network-metrics-daemon-k47j9\" (UID: \"4a380d70-7f9e-4fc4-b28d-520f61003def\") " pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:22.249996 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:22.249562    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret\") pod \"global-pull-secret-syncer-zqlwf\" (UID: \"714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91\") " pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:22.249996 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:22.249706    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:22.249996 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:22.249728    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:22.249996 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:22.249799    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs podName:4a380d70-7f9e-4fc4-b28d-520f61003def nodeName:}" failed. No retries permitted until 2026-07-15 20:59:30.249764594 +0000 UTC m=+17.440444004 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs") pod "network-metrics-daemon-k47j9" (UID: "4a380d70-7f9e-4fc4-b28d-520f61003def") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:22.249996 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:22.249820    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret podName:714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:30.249810685 +0000 UTC m=+17.440490097 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret") pod "global-pull-secret-syncer-zqlwf" (UID: "714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91") : object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:22.350152 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:22.350112    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q2h8\" (UniqueName: \"kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8\") pod \"network-check-target-z9bpw\" (UID: \"e670c826-029c-4b43-8594-3caf0693e896\") " pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:22.350330 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:22.350290    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 20:59:22.350330 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:22.350317    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 20:59:22.350330 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:22.350330    2560 projected.go:196] Error preparing data for projected volume kube-api-access-6q2h8 for pod openshift-network-diagnostics/network-check-target-z9bpw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:22.350520 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:22.350392    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8 podName:e670c826-029c-4b43-8594-3caf0693e896 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:30.3503734 +0000 UTC m=+17.541052821 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6q2h8" (UniqueName: "kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8") pod "network-check-target-z9bpw" (UID: "e670c826-029c-4b43-8594-3caf0693e896") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:22.568396 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:22.568309    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:22.568557 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:22.568486    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k47j9" podUID="4a380d70-7f9e-4fc4-b28d-520f61003def"
Jul 15 20:59:22.568650 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:22.568601    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:22.568782 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:22.568747    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bpw" podUID="e670c826-029c-4b43-8594-3caf0693e896"
Jul 15 20:59:22.568873 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:22.568760    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:22.568926 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:22.568899    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqlwf" podUID="714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91"
Jul 15 20:59:24.568296 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:24.568228    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:24.568747 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:24.568228    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:24.568747 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:24.568358    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqlwf" podUID="714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91"
Jul 15 20:59:24.568747 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:24.568445    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k47j9" podUID="4a380d70-7f9e-4fc4-b28d-520f61003def"
Jul 15 20:59:24.568747 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:24.568241    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:24.568747 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:24.568539    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bpw" podUID="e670c826-029c-4b43-8594-3caf0693e896"
Jul 15 20:59:26.567835 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:26.567799    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:26.567835 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:26.567815    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:26.568312 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:26.567815    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:26.568312 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:26.567928    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqlwf" podUID="714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91"
Jul 15 20:59:26.568312 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:26.568020    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k47j9" podUID="4a380d70-7f9e-4fc4-b28d-520f61003def"
Jul 15 20:59:26.568312 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:26.568105    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bpw" podUID="e670c826-029c-4b43-8594-3caf0693e896"
Jul 15 20:59:28.567528 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:28.567483    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:28.568006 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:28.567534    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:28.568006 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:28.567534    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:28.568006 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:28.567613    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqlwf" podUID="714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91"
Jul 15 20:59:28.568006 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:28.567710    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k47j9" podUID="4a380d70-7f9e-4fc4-b28d-520f61003def"
Jul 15 20:59:28.568006 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:28.567807    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bpw" podUID="e670c826-029c-4b43-8594-3caf0693e896"
Jul 15 20:59:30.319321 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:30.319106    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret\") pod \"global-pull-secret-syncer-zqlwf\" (UID: \"714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91\") " pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:30.319790 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:30.319364    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs\") pod \"network-metrics-daemon-k47j9\" (UID: \"4a380d70-7f9e-4fc4-b28d-520f61003def\") " pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:30.319790 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:30.319295    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:30.319790 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:30.319473    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret podName:714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:46.319456118 +0000 UTC m=+33.510135524 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret") pod "global-pull-secret-syncer-zqlwf" (UID: "714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91") : object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:30.319790 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:30.319518    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:30.319790 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:30.319596    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs podName:4a380d70-7f9e-4fc4-b28d-520f61003def nodeName:}" failed. No retries permitted until 2026-07-15 20:59:46.319564371 +0000 UTC m=+33.510243785 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs") pod "network-metrics-daemon-k47j9" (UID: "4a380d70-7f9e-4fc4-b28d-520f61003def") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:30.420455 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:30.420417    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q2h8\" (UniqueName: \"kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8\") pod \"network-check-target-z9bpw\" (UID: \"e670c826-029c-4b43-8594-3caf0693e896\") " pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:30.420642 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:30.420571    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 20:59:30.420642 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:30.420592    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 20:59:30.420642 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:30.420605    2560 projected.go:196] Error preparing data for projected volume kube-api-access-6q2h8 for pod openshift-network-diagnostics/network-check-target-z9bpw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:30.420810 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:30.420670    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8 podName:e670c826-029c-4b43-8594-3caf0693e896 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:46.420652217 +0000 UTC m=+33.611331627 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6q2h8" (UniqueName: "kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8") pod "network-check-target-z9bpw" (UID: "e670c826-029c-4b43-8594-3caf0693e896") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:30.568376 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:30.568340    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:30.568376 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:30.568369    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:30.568376 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:30.568338    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:30.568642 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:30.568477    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqlwf" podUID="714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91"
Jul 15 20:59:30.568642 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:30.568607    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k47j9" podUID="4a380d70-7f9e-4fc4-b28d-520f61003def"
Jul 15 20:59:30.568759 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:30.568723    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bpw" podUID="e670c826-029c-4b43-8594-3caf0693e896"
Jul 15 20:59:32.568496 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:32.568463    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:32.568896 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:32.568595    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:32.568896 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:32.568603    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqlwf" podUID="714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91"
Jul 15 20:59:32.568896 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:32.568706    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k47j9" podUID="4a380d70-7f9e-4fc4-b28d-520f61003def"
Jul 15 20:59:32.568896 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:32.568744    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:32.568896 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:32.568835    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bpw" podUID="e670c826-029c-4b43-8594-3caf0693e896"
Jul 15 20:59:34.568203 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:34.568165    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:34.568203 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:34.568194    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:34.568569 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:34.568268    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:34.568569 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:34.568282    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k47j9" podUID="4a380d70-7f9e-4fc4-b28d-520f61003def"
Jul 15 20:59:34.568569 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:34.568342    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bpw" podUID="e670c826-029c-4b43-8594-3caf0693e896"
Jul 15 20:59:34.568569 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:34.568396    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqlwf" podUID="714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91"
Jul 15 20:59:35.735612 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:35.735410    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nl52" event={"ID":"a523cf63-f5ce-46c3-b3ca-75daceb7c894","Type":"ContainerStarted","Data":"193b9fffdac77e78896183e9ccb2a7ada04e63e6f79ac9da13c74badb0a9ddcd"}
Jul 15 20:59:35.736374 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:35.735660    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nl52" event={"ID":"a523cf63-f5ce-46c3-b3ca-75daceb7c894","Type":"ContainerStarted","Data":"a4231bb38b7c4cd4eac89ba39323e6cdc0503df8ae51cfc6ffe0beac239c0c0a"}
Jul 15 20:59:35.736374 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:35.735696    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nl52" event={"ID":"a523cf63-f5ce-46c3-b3ca-75daceb7c894","Type":"ContainerStarted","Data":"1d1632f18acbc5c195c370673f79156d8f6d5274f5aef9cf05fbefacd6bbe252"}
Jul 15 20:59:35.736374 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:35.735732    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nl52" event={"ID":"a523cf63-f5ce-46c3-b3ca-75daceb7c894","Type":"ContainerStarted","Data":"4de8f3a60a8b2b43bc6ba01a084ad755ec518827c5dc7b6eb46445f9481ad598"}
Jul 15 20:59:35.736826 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:35.736805    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w4h68" event={"ID":"c9230613-fd2c-4231-85ca-187299a3a504","Type":"ContainerStarted","Data":"a11a441223cc1c6d90804b12f2d48daf6ed321ce164f1015d678eedb907dc343"}
Jul 15 20:59:35.738402 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:35.738376    2560 generic.go:356] "Generic (PLEG): container finished" podID="191159ed-06e6-43b3-8d6c-11452cd3aa7f" containerID="a44cb7b1e6e689cca6684a12b5586d648e1f5ef2f16a0d52c1396f2f1cbf1f31" exitCode=0
Jul 15 20:59:35.738505 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:35.738453    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kkgc7" event={"ID":"191159ed-06e6-43b3-8d6c-11452cd3aa7f","Type":"ContainerDied","Data":"a44cb7b1e6e689cca6684a12b5586d648e1f5ef2f16a0d52c1396f2f1cbf1f31"}
Jul 15 20:59:35.742359 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:35.742330    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-134.ec2.internal" event={"ID":"d096c15409b94daf881a74897409f344","Type":"ContainerStarted","Data":"8112f44863f578631f0df401281e4a65fec63936cc6c9da867cf3d0fb1b57eb1"}
Jul 15 20:59:35.746681 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:35.746658    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ndnjh" event={"ID":"936b35e9-8251-4100-b335-c91679e0c998","Type":"ContainerStarted","Data":"2b09026eef2469193213e9ccbe7bfbe500da6339f7091e76e8d2f412c27ca9b9"}
Jul 15 20:59:35.748704 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:35.748679    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lbrvc" event={"ID":"63c63623-9437-4680-88c3-1495e3b67d8e","Type":"ContainerStarted","Data":"20943782695a3bf8c9f34512525a7520af895162cfa1c9b1c6eb352a4781cb06"}
Jul 15 20:59:35.750086 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:35.750068    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2r9lp" event={"ID":"a3209dca-9434-43c6-b423-2ace40e77574","Type":"ContainerStarted","Data":"dfff75687c9667a271fa6a2e77225da6f9b5fab92fdbd35daa2101f9fe798c57"}
Jul 15 20:59:35.751491 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:35.751471    2560 generic.go:356] "Generic (PLEG): container finished" podID="8bdce92e82071ad2602beba49b95b8d5" containerID="40c2a36b49343931d4a8952d8e7896ce5ebdcd57bd08ea7cd1d98d461cef7f63" exitCode=0
Jul 15 20:59:35.751584 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:35.751529    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-134.ec2.internal" event={"ID":"8bdce92e82071ad2602beba49b95b8d5","Type":"ContainerDied","Data":"40c2a36b49343931d4a8952d8e7896ce5ebdcd57bd08ea7cd1d98d461cef7f63"}
Jul 15 20:59:35.752816 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:35.752797    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vntdq" event={"ID":"a0b4d72f-b8a2-465f-a92d-2201d824ff19","Type":"ContainerStarted","Data":"0b118c1bb25e22edf6fb2cca6f9258e17901d81c00af879c5a98e165e587b9fa"}
Jul 15 20:59:35.754089 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:35.754070    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc" event={"ID":"95d4da4f-d62c-4030-885d-ea52f665dc38","Type":"ContainerStarted","Data":"76be186577e5774120e3672b2f9ae83383bba05b1caac3bec515a4c6d4fc0fcf"}
Jul 15 20:59:35.755487 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:35.755447    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w4h68" podStartSLOduration=2.853274137 podStartE2EDuration="22.755435538s" totalImagesPullingTime="19.902161401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:35.755201262 +0000 UTC m=+22.945880690" watchObservedRunningTime="2026-07-15 20:59:35.755435538 +0000 UTC m=+22.946114966"
Jul 15 20:59:35.770883 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:35.770844    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lbrvc" podStartSLOduration=2.84055611 podStartE2EDuration="22.770828274s" totalImagesPullingTime="19.930272164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:35.770614529 +0000 UTC m=+22.961293959" watchObservedRunningTime="2026-07-15 20:59:35.770828274 +0000 UTC m=+22.961507706"
Jul 15 20:59:35.813724 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:35.813674    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vntdq" podStartSLOduration=2.944703504 podStartE2EDuration="22.813657002s" totalImagesPullingTime="19.868953498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:35.785611788 +0000 UTC m=+22.976291217" watchObservedRunningTime="2026-07-15 20:59:35.813657002 +0000 UTC m=+23.004336488"
Jul 15 20:59:35.828717 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:35.828666    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ndnjh" podStartSLOduration=2.9227309200000002 podStartE2EDuration="22.828645125s" totalImagesPullingTime="19.905914205s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:35.827984702 +0000 UTC m=+23.018664142" watchObservedRunningTime="2026-07-15 20:59:35.828645125 +0000 UTC m=+23.019324554"
Jul 15 20:59:35.844643 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:35.844597    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-134.ec2.internal" podStartSLOduration=21.844579899 podStartE2EDuration="21.844579899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:35.844083193 +0000 UTC m=+23.034762624" watchObservedRunningTime="2026-07-15 20:59:35.844579899 +0000 UTC m=+23.035259328"
Jul 15 20:59:35.862652 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:35.862470    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2r9lp" podStartSLOduration=2.89323558 podStartE2EDuration="22.862447084s" totalImagesPullingTime="19.969211504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:35.862252659 +0000 UTC m=+23.052932082" watchObservedRunningTime="2026-07-15 20:59:35.862447084 +0000 UTC m=+23.053126513"
Jul 15 20:59:36.567604 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:36.567523    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:36.567866 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:36.567522    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:36.567866 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:36.567680    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k47j9" podUID="4a380d70-7f9e-4fc4-b28d-520f61003def"
Jul 15 20:59:36.567866 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:36.567522    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:36.567866 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:36.567731    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bpw" podUID="e670c826-029c-4b43-8594-3caf0693e896"
Jul 15 20:59:36.567866 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:36.567849    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqlwf" podUID="714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91"
Jul 15 20:59:36.760596 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:36.760139    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nl52" event={"ID":"a523cf63-f5ce-46c3-b3ca-75daceb7c894","Type":"ContainerStarted","Data":"b6546b0e66fa863a1a83f3a8cb2f7d635e2e10653e7f8090a28ebba53bf6402c"}
Jul 15 20:59:36.760596 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:36.760234    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nl52" event={"ID":"a523cf63-f5ce-46c3-b3ca-75daceb7c894","Type":"ContainerStarted","Data":"152887edba22d81cc4642ac6217fe1f4ca8aaa30a385a65f1b4a5ced1f9b8264"}
Jul 15 20:59:36.762413 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:36.762376    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2xdsz" event={"ID":"c78e80e5-a1ef-4c31-a40d-36f73bc1e7bf","Type":"ContainerStarted","Data":"46231f3a2ad95fa67f5eb95e0e06e699d3296de66a0b9ae95ffbbd26615b4eae"}
Jul 15 20:59:36.779997 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:36.779953    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2xdsz" podStartSLOduration=3.891151537 podStartE2EDuration="23.77993305s" totalImagesPullingTime="19.888781513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:36.779141766 +0000 UTC m=+23.969821196" watchObservedRunningTime="2026-07-15 20:59:36.77993305 +0000 UTC m=+23.970612478"
Jul 15 20:59:36.839737 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:36.839700    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 20:59:37.547092 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:37.546937    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T20:59:36.839729626Z","UUID":"b249e9bc-9a68-4300-846b-d34fc98c833b","Handler":null,"Name":"","Endpoint":""}
Jul 15 20:59:37.548892 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:37.548864    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 20:59:37.549040 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:37.548906    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 20:59:37.767404 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:37.767369    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc" event={"ID":"95d4da4f-d62c-4030-885d-ea52f665dc38","Type":"ContainerStarted","Data":"d56cc9eb4beb8d4b4b38a47afddc8abf4b24f9b5143d1d7af7793b914f444a57"}
Jul 15 20:59:37.769445 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:37.769406    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-134.ec2.internal" event={"ID":"8bdce92e82071ad2602beba49b95b8d5","Type":"ContainerStarted","Data":"75e57a6e96542112399165b2686c3f8ffd33037cb3ce2ea0601559d296fdde91"}
Jul 15 20:59:37.795882 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:37.795818    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-134.ec2.internal" podStartSLOduration=23.79579667 podStartE2EDuration="23.79579667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:37.79474898 +0000 UTC m=+24.985428409" watchObservedRunningTime="2026-07-15 20:59:37.79579667 +0000 UTC m=+24.986476103"
Jul 15 20:59:38.568063 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:38.568028    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:38.568335 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:38.568041    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:38.568335 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:38.568174    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k47j9" podUID="4a380d70-7f9e-4fc4-b28d-520f61003def"
Jul 15 20:59:38.568335 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:38.568041    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:38.568335 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:38.568232    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqlwf" podUID="714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91"
Jul 15 20:59:38.568335 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:38.568323    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bpw" podUID="e670c826-029c-4b43-8594-3caf0693e896"
Jul 15 20:59:38.774150 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:38.774102    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc" event={"ID":"95d4da4f-d62c-4030-885d-ea52f665dc38","Type":"ContainerStarted","Data":"7f2f207e23e25b368315a76185c1102667b38be7308abfeb995f5c2afeef361a"}
Jul 15 20:59:38.777878 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:38.777841    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nl52" event={"ID":"a523cf63-f5ce-46c3-b3ca-75daceb7c894","Type":"ContainerStarted","Data":"ca6e758d1003d58a315cc5647407174596ab912f676c401620731e75e2486995"}
Jul 15 20:59:38.795731 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:38.795675    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr4bc" podStartSLOduration=3.677888212 podStartE2EDuration="25.79565855s" totalImagesPullingTime="22.117770338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:38.794951643 +0000 UTC m=+25.985631073" watchObservedRunningTime="2026-07-15 20:59:38.79565855 +0000 UTC m=+25.986337978"
Jul 15 20:59:39.536626 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:39.536585    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lbrvc"
Jul 15 20:59:39.537375 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:39.537356    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lbrvc"
Jul 15 20:59:39.780823 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:39.780783    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lbrvc"
Jul 15 20:59:39.781492 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:39.781467    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lbrvc"
Jul 15 20:59:40.568169 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:40.567932    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:40.568319 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:40.567939    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:40.568319 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:40.568213    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k47j9" podUID="4a380d70-7f9e-4fc4-b28d-520f61003def"
Jul 15 20:59:40.568319 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:40.567943    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:40.568319 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:40.568272    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bpw" podUID="e670c826-029c-4b43-8594-3caf0693e896"
Jul 15 20:59:40.568467 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:40.568338    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqlwf" podUID="714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91"
Jul 15 20:59:40.786012 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:40.785969    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nl52" event={"ID":"a523cf63-f5ce-46c3-b3ca-75daceb7c894","Type":"ContainerStarted","Data":"89573082d6da45ecf54c3c71ff14b16f4e3db2a466fb098c669d39e22511d135"}
Jul 15 20:59:40.786825 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:40.786208    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:40.787952 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:40.787928    2560 generic.go:356] "Generic (PLEG): container finished" podID="191159ed-06e6-43b3-8d6c-11452cd3aa7f" containerID="503bddc32b9fe5655a3d87d3b6d746d5e1a9df14ad3413579520da5f609ff7f2" exitCode=0
Jul 15 20:59:40.788086 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:40.787987    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kkgc7" event={"ID":"191159ed-06e6-43b3-8d6c-11452cd3aa7f","Type":"ContainerDied","Data":"503bddc32b9fe5655a3d87d3b6d746d5e1a9df14ad3413579520da5f609ff7f2"}
Jul 15 20:59:40.802561 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:40.802538    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:40.817356 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:40.817305    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5nl52" podStartSLOduration=7.421286892 podStartE2EDuration="27.817289854s" totalImagesPullingTime="20.396002962s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:40.816688691 +0000 UTC m=+28.007368120" watchObservedRunningTime="2026-07-15 20:59:40.817289854 +0000 UTC m=+28.007969282"
Jul 15 20:59:41.790862 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:41.790824    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:41.791520 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:41.790895    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:41.862607 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:41.862290    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 20:59:42.464845 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:42.464800    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k47j9"]
Jul 15 20:59:42.465069 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:42.464952    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:42.465137 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:42.465068    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k47j9" podUID="4a380d70-7f9e-4fc4-b28d-520f61003def"
Jul 15 20:59:42.467571 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:42.467535    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zqlwf"]
Jul 15 20:59:42.467690 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:42.467661    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:42.467815 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:42.467764    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqlwf" podUID="714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91"
Jul 15 20:59:42.468190 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:42.468171    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z9bpw"]
Jul 15 20:59:42.468277 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:42.468263    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:42.468373 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:42.468353    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bpw" podUID="e670c826-029c-4b43-8594-3caf0693e896"
Jul 15 20:59:42.794325 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:42.794291    2560 generic.go:356] "Generic (PLEG): container finished" podID="191159ed-06e6-43b3-8d6c-11452cd3aa7f" containerID="13ad98bf890039e82e177b09839996f6f6efdac0181582f88e526fd4886e8b61" exitCode=0
Jul 15 20:59:42.794717 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:42.794388    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kkgc7" event={"ID":"191159ed-06e6-43b3-8d6c-11452cd3aa7f","Type":"ContainerDied","Data":"13ad98bf890039e82e177b09839996f6f6efdac0181582f88e526fd4886e8b61"}
Jul 15 20:59:43.798921 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:43.798883    2560 generic.go:356] "Generic (PLEG): container finished" podID="191159ed-06e6-43b3-8d6c-11452cd3aa7f" containerID="7104e55ca298c6e36bf58be6f5ad232b063b26b8e47c50570d76e3c8d1a9eeb8" exitCode=0
Jul 15 20:59:43.799348 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:43.798930    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kkgc7" event={"ID":"191159ed-06e6-43b3-8d6c-11452cd3aa7f","Type":"ContainerDied","Data":"7104e55ca298c6e36bf58be6f5ad232b063b26b8e47c50570d76e3c8d1a9eeb8"}
Jul 15 20:59:44.567580 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:44.567511    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:44.567739 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:44.567511    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:44.567739 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:44.567625    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqlwf" podUID="714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91"
Jul 15 20:59:44.567870 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:44.567736    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k47j9" podUID="4a380d70-7f9e-4fc4-b28d-520f61003def"
Jul 15 20:59:44.567870 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:44.567511    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:44.568019 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:44.567929    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bpw" podUID="e670c826-029c-4b43-8594-3caf0693e896"
Jul 15 20:59:46.352012 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:46.351962    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret\") pod \"global-pull-secret-syncer-zqlwf\" (UID: \"714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91\") " pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:46.352427 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:46.352027    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs\") pod \"network-metrics-daemon-k47j9\" (UID: \"4a380d70-7f9e-4fc4-b28d-520f61003def\") " pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:46.352427 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:46.352134    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:46.352427 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:46.352152    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:46.352427 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:46.352221    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret podName:714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91 nodeName:}" failed. No retries permitted until 2026-07-15 21:00:18.352200217 +0000 UTC m=+65.542879625 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret") pod "global-pull-secret-syncer-zqlwf" (UID: "714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91") : object "kube-system"/"original-pull-secret" not registered
Jul 15 20:59:46.352427 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:46.352245    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs podName:4a380d70-7f9e-4fc4-b28d-520f61003def nodeName:}" failed. No retries permitted until 2026-07-15 21:00:18.352233774 +0000 UTC m=+65.542913184 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs") pod "network-metrics-daemon-k47j9" (UID: "4a380d70-7f9e-4fc4-b28d-520f61003def") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:59:46.452519 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:46.452472    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q2h8\" (UniqueName: \"kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8\") pod \"network-check-target-z9bpw\" (UID: \"e670c826-029c-4b43-8594-3caf0693e896\") " pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:46.452713 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:46.452646    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 20:59:46.452713 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:46.452671    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 20:59:46.452713 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:46.452685    2560 projected.go:196] Error preparing data for projected volume kube-api-access-6q2h8 for pod openshift-network-diagnostics/network-check-target-z9bpw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:46.452902 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:46.452753    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8 podName:e670c826-029c-4b43-8594-3caf0693e896 nodeName:}" failed. No retries permitted until 2026-07-15 21:00:18.452732795 +0000 UTC m=+65.643412216 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6q2h8" (UniqueName: "kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8") pod "network-check-target-z9bpw" (UID: "e670c826-029c-4b43-8594-3caf0693e896") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:59:46.567852 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:46.567752    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:46.568009 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:46.567886    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:46.568009 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:46.567899    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9bpw" podUID="e670c826-029c-4b43-8594-3caf0693e896"
Jul 15 20:59:46.568009 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:46.567937    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:46.568154 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:46.568007    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k47j9" podUID="4a380d70-7f9e-4fc4-b28d-520f61003def"
Jul 15 20:59:46.568154 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:46.568073    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zqlwf" podUID="714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91"
Jul 15 20:59:48.124204 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.124128    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-134.ec2.internal" event="NodeReady"
Jul 15 20:59:48.124544 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.124259    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 20:59:48.173332 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.173297    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wlr98"]
Jul 15 20:59:48.193285 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.193239    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8gbcf"]
Jul 15 20:59:48.193444 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.193334    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wlr98"
Jul 15 20:59:48.197016 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.196749    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 20:59:48.197163 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.196843    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 20:59:48.197226 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.196869    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9rgfh\""
Jul 15 20:59:48.211432 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.211405    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wlr98"]
Jul 15 20:59:48.211565 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.211446    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8gbcf"]
Jul 15 20:59:48.211565 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.211521    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8gbcf"
Jul 15 20:59:48.214397 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.214376    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 20:59:48.214954 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.214922    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cjhbj\""
Jul 15 20:59:48.215070 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.214966    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 20:59:48.215070 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.215038    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 20:59:48.367237 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.367206    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/075f5125-e010-4d9c-833a-d2602c7594e8-metrics-tls\") pod \"dns-default-wlr98\" (UID: \"075f5125-e010-4d9c-833a-d2602c7594e8\") " pod="openshift-dns/dns-default-wlr98"
Jul 15 20:59:48.367367 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.367246    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/075f5125-e010-4d9c-833a-d2602c7594e8-tmp-dir\") pod \"dns-default-wlr98\" (UID: \"075f5125-e010-4d9c-833a-d2602c7594e8\") " pod="openshift-dns/dns-default-wlr98"
Jul 15 20:59:48.367367 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.367274    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/075f5125-e010-4d9c-833a-d2602c7594e8-config-volume\") pod \"dns-default-wlr98\" (UID: \"075f5125-e010-4d9c-833a-d2602c7594e8\") " pod="openshift-dns/dns-default-wlr98"
Jul 15 20:59:48.367367 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.367300    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpxf6\" (UniqueName: \"kubernetes.io/projected/075f5125-e010-4d9c-833a-d2602c7594e8-kube-api-access-lpxf6\") pod \"dns-default-wlr98\" (UID: \"075f5125-e010-4d9c-833a-d2602c7594e8\") " pod="openshift-dns/dns-default-wlr98"
Jul 15 20:59:48.367367 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.367320    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c36943f-6089-442b-a6f1-1d5a2e666a0e-cert\") pod \"ingress-canary-8gbcf\" (UID: \"0c36943f-6089-442b-a6f1-1d5a2e666a0e\") " pod="openshift-ingress-canary/ingress-canary-8gbcf"
Jul 15 20:59:48.367367 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.367357    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkfkc\" (UniqueName: \"kubernetes.io/projected/0c36943f-6089-442b-a6f1-1d5a2e666a0e-kube-api-access-qkfkc\") pod \"ingress-canary-8gbcf\" (UID: \"0c36943f-6089-442b-a6f1-1d5a2e666a0e\") " pod="openshift-ingress-canary/ingress-canary-8gbcf"
Jul 15 20:59:48.468544 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.468500    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/075f5125-e010-4d9c-833a-d2602c7594e8-tmp-dir\") pod \"dns-default-wlr98\" (UID: \"075f5125-e010-4d9c-833a-d2602c7594e8\") " pod="openshift-dns/dns-default-wlr98"
Jul 15 20:59:48.468724 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.468554    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/075f5125-e010-4d9c-833a-d2602c7594e8-config-volume\") pod \"dns-default-wlr98\" (UID: \"075f5125-e010-4d9c-833a-d2602c7594e8\") " pod="openshift-dns/dns-default-wlr98"
Jul 15 20:59:48.468724 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.468676    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpxf6\" (UniqueName: \"kubernetes.io/projected/075f5125-e010-4d9c-833a-d2602c7594e8-kube-api-access-lpxf6\") pod \"dns-default-wlr98\" (UID: \"075f5125-e010-4d9c-833a-d2602c7594e8\") " pod="openshift-dns/dns-default-wlr98"
Jul 15 20:59:48.468724 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.468716    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c36943f-6089-442b-a6f1-1d5a2e666a0e-cert\") pod \"ingress-canary-8gbcf\" (UID: \"0c36943f-6089-442b-a6f1-1d5a2e666a0e\") " pod="openshift-ingress-canary/ingress-canary-8gbcf"
Jul 15 20:59:48.468910 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.468739    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkfkc\" (UniqueName: \"kubernetes.io/projected/0c36943f-6089-442b-a6f1-1d5a2e666a0e-kube-api-access-qkfkc\") pod \"ingress-canary-8gbcf\" (UID: \"0c36943f-6089-442b-a6f1-1d5a2e666a0e\") " pod="openshift-ingress-canary/ingress-canary-8gbcf"
Jul 15 20:59:48.468910 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.468893    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/075f5125-e010-4d9c-833a-d2602c7594e8-tmp-dir\") pod \"dns-default-wlr98\" (UID: \"075f5125-e010-4d9c-833a-d2602c7594e8\") " pod="openshift-dns/dns-default-wlr98"
Jul 15 20:59:48.469006 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.468931    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/075f5125-e010-4d9c-833a-d2602c7594e8-metrics-tls\") pod \"dns-default-wlr98\" (UID: \"075f5125-e010-4d9c-833a-d2602c7594e8\") " pod="openshift-dns/dns-default-wlr98"
Jul 15 20:59:48.469053 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:48.469038    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 20:59:48.469113 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:48.469102    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/075f5125-e010-4d9c-833a-d2602c7594e8-metrics-tls podName:075f5125-e010-4d9c-833a-d2602c7594e8 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:48.969083131 +0000 UTC m=+36.159762539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/075f5125-e010-4d9c-833a-d2602c7594e8-metrics-tls") pod "dns-default-wlr98" (UID: "075f5125-e010-4d9c-833a-d2602c7594e8") : secret "dns-default-metrics-tls" not found
Jul 15 20:59:48.469201 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.469183    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/075f5125-e010-4d9c-833a-d2602c7594e8-config-volume\") pod \"dns-default-wlr98\" (UID: \"075f5125-e010-4d9c-833a-d2602c7594e8\") " pod="openshift-dns/dns-default-wlr98"
Jul 15 20:59:48.473124 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.473106    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c36943f-6089-442b-a6f1-1d5a2e666a0e-cert\") pod \"ingress-canary-8gbcf\" (UID: \"0c36943f-6089-442b-a6f1-1d5a2e666a0e\") " pod="openshift-ingress-canary/ingress-canary-8gbcf"
Jul 15 20:59:48.481431 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.481401    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpxf6\" (UniqueName: \"kubernetes.io/projected/075f5125-e010-4d9c-833a-d2602c7594e8-kube-api-access-lpxf6\") pod \"dns-default-wlr98\" (UID: \"075f5125-e010-4d9c-833a-d2602c7594e8\") " pod="openshift-dns/dns-default-wlr98"
Jul 15 20:59:48.486626 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.486600    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkfkc\" (UniqueName: \"kubernetes.io/projected/0c36943f-6089-442b-a6f1-1d5a2e666a0e-kube-api-access-qkfkc\") pod \"ingress-canary-8gbcf\" (UID: \"0c36943f-6089-442b-a6f1-1d5a2e666a0e\") " pod="openshift-ingress-canary/ingress-canary-8gbcf"
Jul 15 20:59:48.539034 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.538990    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8gbcf"
Jul 15 20:59:48.568512 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.568482    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 20:59:48.568634 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.568497    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 20:59:48.568680 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.568651    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 20:59:48.573408 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.573284    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 20:59:48.573513 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.573303    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 20:59:48.573513 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.573315    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 20:59:48.573616 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.573324    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ffp72\""
Jul 15 20:59:48.573616 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.573340    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jnsrt\""
Jul 15 20:59:48.573709 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.573353    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 20:59:48.743447 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.743413    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8gbcf"]
Jul 15 20:59:48.751210 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:48.751179    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c36943f_6089_442b_a6f1_1d5a2e666a0e.slice/crio-3cc551f1b2736ecb9cfa96bb160484429497bdbedacece203a53b240f8b0b55e WatchSource:0}: Error finding container 3cc551f1b2736ecb9cfa96bb160484429497bdbedacece203a53b240f8b0b55e: Status 404 returned error can't find the container with id 3cc551f1b2736ecb9cfa96bb160484429497bdbedacece203a53b240f8b0b55e
Jul 15 20:59:48.815821 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.815766    2560 generic.go:356] "Generic (PLEG): container finished" podID="191159ed-06e6-43b3-8d6c-11452cd3aa7f" containerID="7e50ce1794a6a325089ae5b11f3f9baf9910fcc5a1d4e1a229ddaed5ef90e44a" exitCode=0
Jul 15 20:59:48.815821 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.815809    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kkgc7" event={"ID":"191159ed-06e6-43b3-8d6c-11452cd3aa7f","Type":"ContainerDied","Data":"7e50ce1794a6a325089ae5b11f3f9baf9910fcc5a1d4e1a229ddaed5ef90e44a"}
Jul 15 20:59:48.817018 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.816997    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8gbcf" event={"ID":"0c36943f-6089-442b-a6f1-1d5a2e666a0e","Type":"ContainerStarted","Data":"3cc551f1b2736ecb9cfa96bb160484429497bdbedacece203a53b240f8b0b55e"}
Jul 15 20:59:48.972991 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:48.972796    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/075f5125-e010-4d9c-833a-d2602c7594e8-metrics-tls\") pod \"dns-default-wlr98\" (UID: \"075f5125-e010-4d9c-833a-d2602c7594e8\") " pod="openshift-dns/dns-default-wlr98"
Jul 15 20:59:48.973156 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:48.972951    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 20:59:48.973156 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:48.973128    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/075f5125-e010-4d9c-833a-d2602c7594e8-metrics-tls podName:075f5125-e010-4d9c-833a-d2602c7594e8 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:49.973107805 +0000 UTC m=+37.163787235 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/075f5125-e010-4d9c-833a-d2602c7594e8-metrics-tls") pod "dns-default-wlr98" (UID: "075f5125-e010-4d9c-833a-d2602c7594e8") : secret "dns-default-metrics-tls" not found
Jul 15 20:59:49.823480 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:49.823442    2560 generic.go:356] "Generic (PLEG): container finished" podID="191159ed-06e6-43b3-8d6c-11452cd3aa7f" containerID="4bc0883561a9a1c67846d2664cc5418c7b690438f40a33c97c51cde59c5b43f8" exitCode=0
Jul 15 20:59:49.824247 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:49.823501    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kkgc7" event={"ID":"191159ed-06e6-43b3-8d6c-11452cd3aa7f","Type":"ContainerDied","Data":"4bc0883561a9a1c67846d2664cc5418c7b690438f40a33c97c51cde59c5b43f8"}
Jul 15 20:59:49.980808 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:49.980752    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/075f5125-e010-4d9c-833a-d2602c7594e8-metrics-tls\") pod \"dns-default-wlr98\" (UID: \"075f5125-e010-4d9c-833a-d2602c7594e8\") " pod="openshift-dns/dns-default-wlr98"
Jul 15 20:59:49.980975 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:49.980954    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 20:59:49.981048 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:49.981032    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/075f5125-e010-4d9c-833a-d2602c7594e8-metrics-tls podName:075f5125-e010-4d9c-833a-d2602c7594e8 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:51.981010627 +0000 UTC m=+39.171690049 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/075f5125-e010-4d9c-833a-d2602c7594e8-metrics-tls") pod "dns-default-wlr98" (UID: "075f5125-e010-4d9c-833a-d2602c7594e8") : secret "dns-default-metrics-tls" not found
Jul 15 20:59:50.830579 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:50.830535    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kkgc7" event={"ID":"191159ed-06e6-43b3-8d6c-11452cd3aa7f","Type":"ContainerStarted","Data":"948d7a6eac51f6f7653f3238b6d8fc409a456589d8e49dbf614ea6177321b909"}
Jul 15 20:59:50.837428 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:50.837383    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8gbcf" event={"ID":"0c36943f-6089-442b-a6f1-1d5a2e666a0e","Type":"ContainerStarted","Data":"6148ac2ca6d465d6c0f4d89ddea0b74092fc4b02d117619ad4280efce730107e"}
Jul 15 20:59:50.866712 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:50.866657    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kkgc7" podStartSLOduration=7.311295192 podStartE2EDuration="37.866642971s" totalImagesPullingTime="30.555347779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:50.866281246 +0000 UTC m=+38.056960675" watchObservedRunningTime="2026-07-15 20:59:50.866642971 +0000 UTC m=+38.057322400"
Jul 15 20:59:50.890415 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:50.890353    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8gbcf" podStartSLOduration=0.964358689 podStartE2EDuration="2.890331378s" totalImagesPullingTime="1.925972689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:59:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:50.889269398 +0000 UTC m=+38.079948828" watchObservedRunningTime="2026-07-15 20:59:50.890331378 +0000 UTC m=+38.081010809"
Jul 15 20:59:51.478084 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:51.478050    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-stl92"]
Jul 15 20:59:51.480027 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:51.480011    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 20:59:51.483688 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:51.483664    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 20:59:51.483836 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:51.483675    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 20:59:51.483836 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:51.483744    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 20:59:51.483950 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:51.483750    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 20:59:51.483950 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:51.483750    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m65gh\""
Jul 15 20:59:51.496055 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:51.496030    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-stl92"]
Jul 15 20:59:51.591930 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:51.591886    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cceb473-9450-4dde-a82c-b92e94c92cf3-data-volume\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 20:59:51.591930 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:51.591924    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cceb473-9450-4dde-a82c-b92e94c92cf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 20:59:51.592189 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:51.592036    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn5dl\" (UniqueName: \"kubernetes.io/projected/2cceb473-9450-4dde-a82c-b92e94c92cf3-kube-api-access-sn5dl\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 20:59:51.592189 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:51.592073    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cceb473-9450-4dde-a82c-b92e94c92cf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 20:59:51.592189 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:51.592120    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2cceb473-9450-4dde-a82c-b92e94c92cf3-crio-socket\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 20:59:51.692765 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:51.692726    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2cceb473-9450-4dde-a82c-b92e94c92cf3-crio-socket\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 20:59:51.692893 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:51.692810    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cceb473-9450-4dde-a82c-b92e94c92cf3-data-volume\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 20:59:51.692893 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:51.692836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cceb473-9450-4dde-a82c-b92e94c92cf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 20:59:51.693011 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:51.692916    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn5dl\" (UniqueName: \"kubernetes.io/projected/2cceb473-9450-4dde-a82c-b92e94c92cf3-kube-api-access-sn5dl\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 20:59:51.693011 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:51.692943    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cceb473-9450-4dde-a82c-b92e94c92cf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 20:59:51.693011 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:51.692977    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2cceb473-9450-4dde-a82c-b92e94c92cf3-crio-socket\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 20:59:51.693122 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:51.693037    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 20:59:51.693122 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:51.693098    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cceb473-9450-4dde-a82c-b92e94c92cf3-insights-runtime-extractor-tls podName:2cceb473-9450-4dde-a82c-b92e94c92cf3 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:52.193081953 +0000 UTC m=+39.383761360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cceb473-9450-4dde-a82c-b92e94c92cf3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stl92" (UID: "2cceb473-9450-4dde-a82c-b92e94c92cf3") : secret "insights-runtime-extractor-tls" not found
Jul 15 20:59:51.693226 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:51.693037    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 20:59:51.693226 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:51.693187    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cceb473-9450-4dde-a82c-b92e94c92cf3-data-volume\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 20:59:51.693226 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:51.693215    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cceb473-9450-4dde-a82c-b92e94c92cf3-kube-rbac-proxy-cm podName:2cceb473-9450-4dde-a82c-b92e94c92cf3 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:52.193196942 +0000 UTC m=+39.383876351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2cceb473-9450-4dde-a82c-b92e94c92cf3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stl92" (UID: "2cceb473-9450-4dde-a82c-b92e94c92cf3") : configmap "kube-rbac-proxy" not found
Jul 15 20:59:51.703404 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:51.703287    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn5dl\" (UniqueName: \"kubernetes.io/projected/2cceb473-9450-4dde-a82c-b92e94c92cf3-kube-api-access-sn5dl\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 20:59:51.995963 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:51.995915    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/075f5125-e010-4d9c-833a-d2602c7594e8-metrics-tls\") pod \"dns-default-wlr98\" (UID: \"075f5125-e010-4d9c-833a-d2602c7594e8\") " pod="openshift-dns/dns-default-wlr98"
Jul 15 20:59:51.996328 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:51.996028    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 20:59:51.996328 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:51.996090    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/075f5125-e010-4d9c-833a-d2602c7594e8-metrics-tls podName:075f5125-e010-4d9c-833a-d2602c7594e8 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:55.996076806 +0000 UTC m=+43.186756214 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/075f5125-e010-4d9c-833a-d2602c7594e8-metrics-tls") pod "dns-default-wlr98" (UID: "075f5125-e010-4d9c-833a-d2602c7594e8") : secret "dns-default-metrics-tls" not found
Jul 15 20:59:52.196862 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:52.196820    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cceb473-9450-4dde-a82c-b92e94c92cf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 20:59:52.197050 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:52.196897    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cceb473-9450-4dde-a82c-b92e94c92cf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 20:59:52.197050 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:52.196941    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 20:59:52.197050 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:52.197010    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cceb473-9450-4dde-a82c-b92e94c92cf3-kube-rbac-proxy-cm podName:2cceb473-9450-4dde-a82c-b92e94c92cf3 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:53.196992938 +0000 UTC m=+40.387672366 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2cceb473-9450-4dde-a82c-b92e94c92cf3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stl92" (UID: "2cceb473-9450-4dde-a82c-b92e94c92cf3") : configmap "kube-rbac-proxy" not found
Jul 15 20:59:52.197050 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:52.197025    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 20:59:52.197198 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:52.197069    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cceb473-9450-4dde-a82c-b92e94c92cf3-insights-runtime-extractor-tls podName:2cceb473-9450-4dde-a82c-b92e94c92cf3 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:53.197059238 +0000 UTC m=+40.387738645 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cceb473-9450-4dde-a82c-b92e94c92cf3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stl92" (UID: "2cceb473-9450-4dde-a82c-b92e94c92cf3") : secret "insights-runtime-extractor-tls" not found
Jul 15 20:59:52.294131 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:52.294092    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qnmm"]
Jul 15 20:59:52.296011 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:52.295993    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qnmm"
Jul 15 20:59:52.298212 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:52.298182    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 15 20:59:52.298322 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:52.298285    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 15 20:59:52.298322 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:52.298306    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-2x2m2\""
Jul 15 20:59:52.308145 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:52.308117    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qnmm"]
Jul 15 20:59:52.398083 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:52.398043    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppxh7\" (UniqueName: \"kubernetes.io/projected/6bfb7f51-82da-4cf2-a660-717189d0ab29-kube-api-access-ppxh7\") pod \"migrator-7f59b54f6c-2qnmm\" (UID: \"6bfb7f51-82da-4cf2-a660-717189d0ab29\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qnmm"
Jul 15 20:59:52.499345 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:52.499257    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppxh7\" (UniqueName: \"kubernetes.io/projected/6bfb7f51-82da-4cf2-a660-717189d0ab29-kube-api-access-ppxh7\") pod \"migrator-7f59b54f6c-2qnmm\" (UID: \"6bfb7f51-82da-4cf2-a660-717189d0ab29\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qnmm"
Jul 15 20:59:52.507709 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:52.507680    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppxh7\" (UniqueName: \"kubernetes.io/projected/6bfb7f51-82da-4cf2-a660-717189d0ab29-kube-api-access-ppxh7\") pod \"migrator-7f59b54f6c-2qnmm\" (UID: \"6bfb7f51-82da-4cf2-a660-717189d0ab29\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qnmm"
Jul 15 20:59:52.605330 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:52.605288    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qnmm"
Jul 15 20:59:52.730813 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:52.730783    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qnmm"]
Jul 15 20:59:52.733613 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:52.733581    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bfb7f51_82da_4cf2_a660_717189d0ab29.slice/crio-3f3161e74f1b9a418df9fc41b72620f4d4adc7e773e8c9dcc254932132e5634c WatchSource:0}: Error finding container 3f3161e74f1b9a418df9fc41b72620f4d4adc7e773e8c9dcc254932132e5634c: Status 404 returned error can't find the container with id 3f3161e74f1b9a418df9fc41b72620f4d4adc7e773e8c9dcc254932132e5634c
Jul 15 20:59:52.842708 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:52.842614    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qnmm" event={"ID":"6bfb7f51-82da-4cf2-a660-717189d0ab29","Type":"ContainerStarted","Data":"3f3161e74f1b9a418df9fc41b72620f4d4adc7e773e8c9dcc254932132e5634c"}
Jul 15 20:59:53.204412 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:53.204369    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cceb473-9450-4dde-a82c-b92e94c92cf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 20:59:53.204824 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:53.204485    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 20:59:53.204824 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:53.204529    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 20:59:53.204824 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:53.204484    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cceb473-9450-4dde-a82c-b92e94c92cf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 20:59:53.204824 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:53.204552    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cceb473-9450-4dde-a82c-b92e94c92cf3-insights-runtime-extractor-tls podName:2cceb473-9450-4dde-a82c-b92e94c92cf3 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:55.204533071 +0000 UTC m=+42.395212499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cceb473-9450-4dde-a82c-b92e94c92cf3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stl92" (UID: "2cceb473-9450-4dde-a82c-b92e94c92cf3") : secret "insights-runtime-extractor-tls" not found
Jul 15 20:59:53.204824 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:53.204603    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cceb473-9450-4dde-a82c-b92e94c92cf3-kube-rbac-proxy-cm podName:2cceb473-9450-4dde-a82c-b92e94c92cf3 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:55.204584604 +0000 UTC m=+42.395264016 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2cceb473-9450-4dde-a82c-b92e94c92cf3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stl92" (UID: "2cceb473-9450-4dde-a82c-b92e94c92cf3") : configmap "kube-rbac-proxy" not found
Jul 15 20:59:53.428425 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:53.428395    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ndnjh_936b35e9-8251-4100-b335-c91679e0c998/dns-node-resolver/0.log"
Jul 15 20:59:53.976952 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:53.976921    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-rzgnz"]
Jul 15 20:59:53.978879 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:53.978862    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-rzgnz"
Jul 15 20:59:53.981317 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:53.981291    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 15 20:59:53.981656 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:53.981643    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 15 20:59:53.982650 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:53.982628    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 15 20:59:53.982650 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:53.982648    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qblg6\""
Jul 15 20:59:53.982828 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:53.982648    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 15 20:59:53.991951 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:53.991923    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-rzgnz"]
Jul 15 20:59:54.112576 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:54.112483    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/565eaad7-8524-436f-81e0-c7d64461e679-signing-cabundle\") pod \"service-ca-79f68b9f4f-rzgnz\" (UID: \"565eaad7-8524-436f-81e0-c7d64461e679\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rzgnz"
Jul 15 20:59:54.112576 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:54.112552    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/565eaad7-8524-436f-81e0-c7d64461e679-signing-key\") pod \"service-ca-79f68b9f4f-rzgnz\" (UID: \"565eaad7-8524-436f-81e0-c7d64461e679\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rzgnz"
Jul 15 20:59:54.112753 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:54.112589    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g96lz\" (UniqueName: \"kubernetes.io/projected/565eaad7-8524-436f-81e0-c7d64461e679-kube-api-access-g96lz\") pod \"service-ca-79f68b9f4f-rzgnz\" (UID: \"565eaad7-8524-436f-81e0-c7d64461e679\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rzgnz"
Jul 15 20:59:54.213015 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:54.212977    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/565eaad7-8524-436f-81e0-c7d64461e679-signing-cabundle\") pod \"service-ca-79f68b9f4f-rzgnz\" (UID: \"565eaad7-8524-436f-81e0-c7d64461e679\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rzgnz"
Jul 15 20:59:54.213397 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:54.213118    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/565eaad7-8524-436f-81e0-c7d64461e679-signing-key\") pod \"service-ca-79f68b9f4f-rzgnz\" (UID: \"565eaad7-8524-436f-81e0-c7d64461e679\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rzgnz"
Jul 15 20:59:54.213397 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:54.213138    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g96lz\" (UniqueName: \"kubernetes.io/projected/565eaad7-8524-436f-81e0-c7d64461e679-kube-api-access-g96lz\") pod \"service-ca-79f68b9f4f-rzgnz\" (UID: \"565eaad7-8524-436f-81e0-c7d64461e679\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rzgnz"
Jul 15 20:59:54.213639 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:54.213618    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/565eaad7-8524-436f-81e0-c7d64461e679-signing-cabundle\") pod \"service-ca-79f68b9f4f-rzgnz\" (UID: \"565eaad7-8524-436f-81e0-c7d64461e679\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rzgnz"
Jul 15 20:59:54.215499 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:54.215482    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/565eaad7-8524-436f-81e0-c7d64461e679-signing-key\") pod \"service-ca-79f68b9f4f-rzgnz\" (UID: \"565eaad7-8524-436f-81e0-c7d64461e679\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rzgnz"
Jul 15 20:59:54.227742 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:54.227710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g96lz\" (UniqueName: \"kubernetes.io/projected/565eaad7-8524-436f-81e0-c7d64461e679-kube-api-access-g96lz\") pod \"service-ca-79f68b9f4f-rzgnz\" (UID: \"565eaad7-8524-436f-81e0-c7d64461e679\") " pod="openshift-service-ca/service-ca-79f68b9f4f-rzgnz"
Jul 15 20:59:54.287735 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:54.287691    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-rzgnz"
Jul 15 20:59:54.410965 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:54.410932    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-rzgnz"]
Jul 15 20:59:54.414449 ip-10-0-130-134 kubenswrapper[2560]: W0715 20:59:54.414416    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod565eaad7_8524_436f_81e0_c7d64461e679.slice/crio-3eed5ff2fad9d5cd10d4ee1374bdc1d2193b0641ebe8819a5b275e909c3ac756 WatchSource:0}: Error finding container 3eed5ff2fad9d5cd10d4ee1374bdc1d2193b0641ebe8819a5b275e909c3ac756: Status 404 returned error can't find the container with id 3eed5ff2fad9d5cd10d4ee1374bdc1d2193b0641ebe8819a5b275e909c3ac756
Jul 15 20:59:54.629081 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:54.629015    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vntdq_a0b4d72f-b8a2-465f-a92d-2201d824ff19/node-ca/0.log"
Jul 15 20:59:54.848518 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:54.848483    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-rzgnz" event={"ID":"565eaad7-8524-436f-81e0-c7d64461e679","Type":"ContainerStarted","Data":"3eed5ff2fad9d5cd10d4ee1374bdc1d2193b0641ebe8819a5b275e909c3ac756"}
Jul 15 20:59:54.850141 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:54.850117    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qnmm" event={"ID":"6bfb7f51-82da-4cf2-a660-717189d0ab29","Type":"ContainerStarted","Data":"30f499bcd63794e8f451cc23414b9c64ee0e5f9aea80612debf266a1344c5a27"}
Jul 15 20:59:54.850250 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:54.850166    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qnmm" event={"ID":"6bfb7f51-82da-4cf2-a660-717189d0ab29","Type":"ContainerStarted","Data":"4204c9aba9611b33a35fd07575a1a26a19216206d30fbc560701c0a6057b748b"}
Jul 15 20:59:54.870368 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:54.870306    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qnmm" podStartSLOduration=1.75715522 podStartE2EDuration="2.870287013s" totalImagesPullingTime="1.113131793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:59:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:54.869729361 +0000 UTC m=+42.060408790" watchObservedRunningTime="2026-07-15 20:59:54.870287013 +0000 UTC m=+42.060966443"
Jul 15 20:59:55.222015 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:55.219683    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cceb473-9450-4dde-a82c-b92e94c92cf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 20:59:55.222015 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:55.219820    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cceb473-9450-4dde-a82c-b92e94c92cf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 20:59:55.222015 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:55.220027    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 20:59:55.222015 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:55.220100    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cceb473-9450-4dde-a82c-b92e94c92cf3-insights-runtime-extractor-tls podName:2cceb473-9450-4dde-a82c-b92e94c92cf3 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:59.220073343 +0000 UTC m=+46.410752764 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cceb473-9450-4dde-a82c-b92e94c92cf3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stl92" (UID: "2cceb473-9450-4dde-a82c-b92e94c92cf3") : secret "insights-runtime-extractor-tls" not found
Jul 15 20:59:55.222015 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:55.220162    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 20:59:55.222015 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:55.220199    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2cceb473-9450-4dde-a82c-b92e94c92cf3-kube-rbac-proxy-cm podName:2cceb473-9450-4dde-a82c-b92e94c92cf3 nodeName:}" failed. No retries permitted until 2026-07-15 20:59:59.220188531 +0000 UTC m=+46.410867956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2cceb473-9450-4dde-a82c-b92e94c92cf3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stl92" (UID: "2cceb473-9450-4dde-a82c-b92e94c92cf3") : configmap "kube-rbac-proxy" not found
Jul 15 20:59:55.228617 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:55.228591    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8gbcf_0c36943f-6089-442b-a6f1-1d5a2e666a0e/serve-healthcheck-canary/0.log"
Jul 15 20:59:56.025291 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:56.025254    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/075f5125-e010-4d9c-833a-d2602c7594e8-metrics-tls\") pod \"dns-default-wlr98\" (UID: \"075f5125-e010-4d9c-833a-d2602c7594e8\") " pod="openshift-dns/dns-default-wlr98"
Jul 15 20:59:56.025479 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:56.025402    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 20:59:56.025479 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:56.025472    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/075f5125-e010-4d9c-833a-d2602c7594e8-metrics-tls podName:075f5125-e010-4d9c-833a-d2602c7594e8 nodeName:}" failed. No retries permitted until 2026-07-15 21:00:04.025453208 +0000 UTC m=+51.216132616 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/075f5125-e010-4d9c-833a-d2602c7594e8-metrics-tls") pod "dns-default-wlr98" (UID: "075f5125-e010-4d9c-833a-d2602c7594e8") : secret "dns-default-metrics-tls" not found
Jul 15 20:59:57.859256 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:57.859220    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-rzgnz" event={"ID":"565eaad7-8524-436f-81e0-c7d64461e679","Type":"ContainerStarted","Data":"39a45d086307ca9f471374328d2c3dca0cb11abacabcf2979e114436dcc10d12"}
Jul 15 20:59:57.883966 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:57.883910    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-rzgnz" podStartSLOduration=2.459520183 podStartE2EDuration="4.883892871s" totalImagesPullingTime="2.424372688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:59:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:59:57.881819736 +0000 UTC m=+45.072499166" watchObservedRunningTime="2026-07-15 20:59:57.883892871 +0000 UTC m=+45.074572301"
Jul 15 20:59:59.247793 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:59.247738    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cceb473-9450-4dde-a82c-b92e94c92cf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 20:59:59.248243 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:59.247927    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cceb473-9450-4dde-a82c-b92e94c92cf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 20:59:59.248243 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:59.248075    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 20:59:59.248243 ip-10-0-130-134 kubenswrapper[2560]: E0715 20:59:59.248149    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cceb473-9450-4dde-a82c-b92e94c92cf3-insights-runtime-extractor-tls podName:2cceb473-9450-4dde-a82c-b92e94c92cf3 nodeName:}" failed. No retries permitted until 2026-07-15 21:00:07.248130279 +0000 UTC m=+54.438809686 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cceb473-9450-4dde-a82c-b92e94c92cf3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stl92" (UID: "2cceb473-9450-4dde-a82c-b92e94c92cf3") : secret "insights-runtime-extractor-tls" not found
Jul 15 20:59:59.248410 ip-10-0-130-134 kubenswrapper[2560]: I0715 20:59:59.248382    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cceb473-9450-4dde-a82c-b92e94c92cf3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 21:00:04.085663 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:04.085618    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/075f5125-e010-4d9c-833a-d2602c7594e8-metrics-tls\") pod \"dns-default-wlr98\" (UID: \"075f5125-e010-4d9c-833a-d2602c7594e8\") " pod="openshift-dns/dns-default-wlr98"
Jul 15 21:00:04.087999 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:04.087975    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/075f5125-e010-4d9c-833a-d2602c7594e8-metrics-tls\") pod \"dns-default-wlr98\" (UID: \"075f5125-e010-4d9c-833a-d2602c7594e8\") " pod="openshift-dns/dns-default-wlr98"
Jul 15 21:00:04.105982 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:04.105952    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wlr98"
Jul 15 21:00:04.258907 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:04.258876    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wlr98"]
Jul 15 21:00:04.262386 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:00:04.262355    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod075f5125_e010_4d9c_833a_d2602c7594e8.slice/crio-87010b5fb507e1ece3a4afb8f55da1869c7e6bd71a903be3efeb7bf19a02e45f WatchSource:0}: Error finding container 87010b5fb507e1ece3a4afb8f55da1869c7e6bd71a903be3efeb7bf19a02e45f: Status 404 returned error can't find the container with id 87010b5fb507e1ece3a4afb8f55da1869c7e6bd71a903be3efeb7bf19a02e45f
Jul 15 21:00:04.879090 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:04.879050    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wlr98" event={"ID":"075f5125-e010-4d9c-833a-d2602c7594e8","Type":"ContainerStarted","Data":"87010b5fb507e1ece3a4afb8f55da1869c7e6bd71a903be3efeb7bf19a02e45f"}
Jul 15 21:00:07.310686 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:07.310656    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cceb473-9450-4dde-a82c-b92e94c92cf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 21:00:07.312985 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:07.312961    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cceb473-9450-4dde-a82c-b92e94c92cf3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stl92\" (UID: \"2cceb473-9450-4dde-a82c-b92e94c92cf3\") " pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 21:00:07.388898 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:07.388859    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-stl92"
Jul 15 21:00:07.551814 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:07.551764    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-stl92"]
Jul 15 21:00:07.555135 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:00:07.555109    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cceb473_9450_4dde_a82c_b92e94c92cf3.slice/crio-fb9d3cc836fe9d584cc09f67d346769b3d8a0f554c39bf03548a153b85689ed3 WatchSource:0}: Error finding container fb9d3cc836fe9d584cc09f67d346769b3d8a0f554c39bf03548a153b85689ed3: Status 404 returned error can't find the container with id fb9d3cc836fe9d584cc09f67d346769b3d8a0f554c39bf03548a153b85689ed3
Jul 15 21:00:07.891623 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:07.891527    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wlr98" event={"ID":"075f5125-e010-4d9c-833a-d2602c7594e8","Type":"ContainerStarted","Data":"bf0a2659601de40711e74154ede1d0aad4b583098a7f190aed8200836a570dc5"}
Jul 15 21:00:07.891623 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:07.891599    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wlr98"
Jul 15 21:00:07.891623 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:07.891623    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wlr98" event={"ID":"075f5125-e010-4d9c-833a-d2602c7594e8","Type":"ContainerStarted","Data":"f42506d0ea5bf65f9d21b52bbf900bd7320c4e6edd0bc19ece18af3351515077"}
Jul 15 21:00:07.892599 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:07.892571    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stl92" event={"ID":"2cceb473-9450-4dde-a82c-b92e94c92cf3","Type":"ContainerStarted","Data":"fb9d3cc836fe9d584cc09f67d346769b3d8a0f554c39bf03548a153b85689ed3"}
Jul 15 21:00:07.920486 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:07.919706    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wlr98" podStartSLOduration=17.138236673 podStartE2EDuration="19.91968708s" totalImagesPullingTime="2.781450407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:59:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:07.918890913 +0000 UTC m=+55.109570352" watchObservedRunningTime="2026-07-15 21:00:07.91968708 +0000 UTC m=+55.110366487"
Jul 15 21:00:12.912377 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:12.912340    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stl92" event={"ID":"2cceb473-9450-4dde-a82c-b92e94c92cf3","Type":"ContainerStarted","Data":"22bc7a6cedaee4374ac7b9f1cc679cb18adca19528b69c4bb5af041a8ca102d3"}
Jul 15 21:00:13.818337 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:13.818303    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nl52"
Jul 15 21:00:15.026483 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.026423    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-668df9dcfb-hfttz"]
Jul 15 21:00:15.131959 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.131896    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"]
Jul 15 21:00:15.132132 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.132030    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-668df9dcfb-hfttz"
Jul 15 21:00:15.134815 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.134765    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 15 21:00:15.135004 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.134976    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 15 21:00:15.135121 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.135071    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 15 21:00:15.136000 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.135970    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 15 21:00:15.136110 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.135981    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-j52pn\""
Jul 15 21:00:15.171008 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.170974    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-668df9dcfb-hfttz"]
Jul 15 21:00:15.171008 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.171012    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"]
Jul 15 21:00:15.171233 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.171088    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"
Jul 15 21:00:15.176423 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.176384    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 15 21:00:15.176423 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.176384    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 15 21:00:15.176926 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.176747    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 15 21:00:15.177660 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.177478    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 15 21:00:15.177854 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.177828    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fe5f8a61-62cd-4fa5-a0dc-e41919ba24c8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-668df9dcfb-hfttz\" (UID: \"fe5f8a61-62cd-4fa5-a0dc-e41919ba24c8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-668df9dcfb-hfttz"
Jul 15 21:00:15.177957 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.177881    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vb6n\" (UniqueName: \"kubernetes.io/projected/fe5f8a61-62cd-4fa5-a0dc-e41919ba24c8-kube-api-access-4vb6n\") pod \"managed-serviceaccount-addon-agent-668df9dcfb-hfttz\" (UID: \"fe5f8a61-62cd-4fa5-a0dc-e41919ba24c8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-668df9dcfb-hfttz"
Jul 15 21:00:15.278748 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.278621    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/04722939-8de4-4bb0-976c-fb4fc2a1bfdf-hub\") pod \"cluster-proxy-proxy-agent-6fffd4ff58-9gd7r\" (UID: \"04722939-8de4-4bb0-976c-fb4fc2a1bfdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"
Jul 15 21:00:15.278748 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.278672    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04722939-8de4-4bb0-976c-fb4fc2a1bfdf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6fffd4ff58-9gd7r\" (UID: \"04722939-8de4-4bb0-976c-fb4fc2a1bfdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"
Jul 15 21:00:15.278748 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.278699    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/04722939-8de4-4bb0-976c-fb4fc2a1bfdf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6fffd4ff58-9gd7r\" (UID: \"04722939-8de4-4bb0-976c-fb4fc2a1bfdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"
Jul 15 21:00:15.279038 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.278786    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/04722939-8de4-4bb0-976c-fb4fc2a1bfdf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6fffd4ff58-9gd7r\" (UID: \"04722939-8de4-4bb0-976c-fb4fc2a1bfdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"
Jul 15 21:00:15.279038 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.278843    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p78nk\" (UniqueName: \"kubernetes.io/projected/04722939-8de4-4bb0-976c-fb4fc2a1bfdf-kube-api-access-p78nk\") pod \"cluster-proxy-proxy-agent-6fffd4ff58-9gd7r\" (UID: \"04722939-8de4-4bb0-976c-fb4fc2a1bfdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"
Jul 15 21:00:15.279038 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.278874    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fe5f8a61-62cd-4fa5-a0dc-e41919ba24c8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-668df9dcfb-hfttz\" (UID: \"fe5f8a61-62cd-4fa5-a0dc-e41919ba24c8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-668df9dcfb-hfttz"
Jul 15 21:00:15.279038 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.278936    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/04722939-8de4-4bb0-976c-fb4fc2a1bfdf-ca\") pod \"cluster-proxy-proxy-agent-6fffd4ff58-9gd7r\" (UID: \"04722939-8de4-4bb0-976c-fb4fc2a1bfdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"
Jul 15 21:00:15.279038 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.278996    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vb6n\" (UniqueName: \"kubernetes.io/projected/fe5f8a61-62cd-4fa5-a0dc-e41919ba24c8-kube-api-access-4vb6n\") pod \"managed-serviceaccount-addon-agent-668df9dcfb-hfttz\" (UID: \"fe5f8a61-62cd-4fa5-a0dc-e41919ba24c8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-668df9dcfb-hfttz"
Jul 15 21:00:15.282007 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.281977    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fe5f8a61-62cd-4fa5-a0dc-e41919ba24c8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-668df9dcfb-hfttz\" (UID: \"fe5f8a61-62cd-4fa5-a0dc-e41919ba24c8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-668df9dcfb-hfttz"
Jul 15 21:00:15.330669 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.330632    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vb6n\" (UniqueName: \"kubernetes.io/projected/fe5f8a61-62cd-4fa5-a0dc-e41919ba24c8-kube-api-access-4vb6n\") pod \"managed-serviceaccount-addon-agent-668df9dcfb-hfttz\" (UID: \"fe5f8a61-62cd-4fa5-a0dc-e41919ba24c8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-668df9dcfb-hfttz"
Jul 15 21:00:15.380134 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.380091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p78nk\" (UniqueName: \"kubernetes.io/projected/04722939-8de4-4bb0-976c-fb4fc2a1bfdf-kube-api-access-p78nk\") pod \"cluster-proxy-proxy-agent-6fffd4ff58-9gd7r\" (UID: \"04722939-8de4-4bb0-976c-fb4fc2a1bfdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"
Jul 15 21:00:15.380134 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.380138    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/04722939-8de4-4bb0-976c-fb4fc2a1bfdf-ca\") pod \"cluster-proxy-proxy-agent-6fffd4ff58-9gd7r\" (UID: \"04722939-8de4-4bb0-976c-fb4fc2a1bfdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"
Jul 15 21:00:15.380371 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.380177    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/04722939-8de4-4bb0-976c-fb4fc2a1bfdf-hub\") pod \"cluster-proxy-proxy-agent-6fffd4ff58-9gd7r\" (UID: \"04722939-8de4-4bb0-976c-fb4fc2a1bfdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"
Jul 15 21:00:15.380371 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.380193    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04722939-8de4-4bb0-976c-fb4fc2a1bfdf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6fffd4ff58-9gd7r\" (UID: \"04722939-8de4-4bb0-976c-fb4fc2a1bfdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"
Jul 15 21:00:15.380371 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.380209    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/04722939-8de4-4bb0-976c-fb4fc2a1bfdf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6fffd4ff58-9gd7r\" (UID: \"04722939-8de4-4bb0-976c-fb4fc2a1bfdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"
Jul 15 21:00:15.380371 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.380263    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/04722939-8de4-4bb0-976c-fb4fc2a1bfdf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6fffd4ff58-9gd7r\" (UID: \"04722939-8de4-4bb0-976c-fb4fc2a1bfdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"
Jul 15 21:00:15.381243 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.381212    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/04722939-8de4-4bb0-976c-fb4fc2a1bfdf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6fffd4ff58-9gd7r\" (UID: \"04722939-8de4-4bb0-976c-fb4fc2a1bfdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"
Jul 15 21:00:15.383241 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.383214    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/04722939-8de4-4bb0-976c-fb4fc2a1bfdf-ca\") pod \"cluster-proxy-proxy-agent-6fffd4ff58-9gd7r\" (UID: \"04722939-8de4-4bb0-976c-fb4fc2a1bfdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"
Jul 15 21:00:15.383463 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.383442    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/04722939-8de4-4bb0-976c-fb4fc2a1bfdf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6fffd4ff58-9gd7r\" (UID: \"04722939-8de4-4bb0-976c-fb4fc2a1bfdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"
Jul 15 21:00:15.383583 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.383561    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04722939-8de4-4bb0-976c-fb4fc2a1bfdf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6fffd4ff58-9gd7r\" (UID: \"04722939-8de4-4bb0-976c-fb4fc2a1bfdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"
Jul 15 21:00:15.383652 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.383622    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/04722939-8de4-4bb0-976c-fb4fc2a1bfdf-hub\") pod \"cluster-proxy-proxy-agent-6fffd4ff58-9gd7r\" (UID: \"04722939-8de4-4bb0-976c-fb4fc2a1bfdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"
Jul 15 21:00:15.395989 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.395954    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p78nk\" (UniqueName: \"kubernetes.io/projected/04722939-8de4-4bb0-976c-fb4fc2a1bfdf-kube-api-access-p78nk\") pod \"cluster-proxy-proxy-agent-6fffd4ff58-9gd7r\" (UID: \"04722939-8de4-4bb0-976c-fb4fc2a1bfdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"
Jul 15 21:00:15.449906 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.449872    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-668df9dcfb-hfttz"
Jul 15 21:00:15.482022 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:15.481982    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"
Jul 15 21:00:16.384226 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:16.384185    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-668df9dcfb-hfttz"]
Jul 15 21:00:16.395671 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:16.395646    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r"]
Jul 15 21:00:16.398386 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:00:16.398350    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04722939_8de4_4bb0_976c_fb4fc2a1bfdf.slice/crio-9a3eabf778a2687225420edfbaccc34b1c47f29ea5a4ca1ce55742df67ffe275 WatchSource:0}: Error finding container 9a3eabf778a2687225420edfbaccc34b1c47f29ea5a4ca1ce55742df67ffe275: Status 404 returned error can't find the container with id 9a3eabf778a2687225420edfbaccc34b1c47f29ea5a4ca1ce55742df67ffe275
Jul 15 21:00:16.927283 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:16.927237    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r" event={"ID":"04722939-8de4-4bb0-976c-fb4fc2a1bfdf","Type":"ContainerStarted","Data":"9a3eabf778a2687225420edfbaccc34b1c47f29ea5a4ca1ce55742df67ffe275"}
Jul 15 21:00:16.929269 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:16.929239    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stl92" event={"ID":"2cceb473-9450-4dde-a82c-b92e94c92cf3","Type":"ContainerStarted","Data":"3683fee36759ee5f96aa577f05f302504e87490fb79c838cc3c389504192d22b"}
Jul 15 21:00:16.930532 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:16.930491    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-668df9dcfb-hfttz" event={"ID":"fe5f8a61-62cd-4fa5-a0dc-e41919ba24c8","Type":"ContainerStarted","Data":"1a5dbb4f2b65e2b5a297848dd6e18b9f88ef9287ea67fab52b74a5d8770d15f0"}
Jul 15 21:00:17.899972 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:17.898928    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wlr98"
Jul 15 21:00:18.406620 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:18.406451    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret\") pod \"global-pull-secret-syncer-zqlwf\" (UID: \"714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91\") " pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 21:00:18.406620 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:18.406501    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs\") pod \"network-metrics-daemon-k47j9\" (UID: \"4a380d70-7f9e-4fc4-b28d-520f61003def\") " pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 21:00:18.412548 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:18.412305    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 21:00:18.412548 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:18.412439    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 21:00:18.421833 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:18.421755    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91-original-pull-secret\") pod \"global-pull-secret-syncer-zqlwf\" (UID: \"714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91\") " pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 21:00:18.422509 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:18.422318    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a380d70-7f9e-4fc4-b28d-520f61003def-metrics-certs\") pod \"network-metrics-daemon-k47j9\" (UID: \"4a380d70-7f9e-4fc4-b28d-520f61003def\") " pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 21:00:18.507259 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:18.507113    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q2h8\" (UniqueName: \"kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8\") pod \"network-check-target-z9bpw\" (UID: \"e670c826-029c-4b43-8594-3caf0693e896\") " pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 21:00:18.514166 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:18.513942    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 21:00:18.522664 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:18.522419    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 21:00:18.531998 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:18.531890    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q2h8\" (UniqueName: \"kubernetes.io/projected/e670c826-029c-4b43-8594-3caf0693e896-kube-api-access-6q2h8\") pod \"network-check-target-z9bpw\" (UID: \"e670c826-029c-4b43-8594-3caf0693e896\") " pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 21:00:18.584762 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:18.584535    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jnsrt\""
Jul 15 21:00:18.591182 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:18.591149    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ffp72\""
Jul 15 21:00:18.591380 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:18.591363    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k47j9"
Jul 15 21:00:18.592190 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:18.592165    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zqlwf"
Jul 15 21:00:18.598277 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:18.598257    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 21:00:23.253142 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:23.253114    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k47j9"]
Jul 15 21:00:23.256570 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:00:23.256543    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a380d70_7f9e_4fc4_b28d_520f61003def.slice/crio-cb42d148585dcc704054fdae98f69f842162e006552c0641e8d4c869e5e293ff WatchSource:0}: Error finding container cb42d148585dcc704054fdae98f69f842162e006552c0641e8d4c869e5e293ff: Status 404 returned error can't find the container with id cb42d148585dcc704054fdae98f69f842162e006552c0641e8d4c869e5e293ff
Jul 15 21:00:23.430307 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:23.430227    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zqlwf"]
Jul 15 21:00:23.434257 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:00:23.434226    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod714b4c14_6a46_4bb6_8fa4_cb4b18bb6b91.slice/crio-f12b1c23d9f5aa092de52d6cfe97dfc069d501eca73a3f67a78dac51d58ba01e WatchSource:0}: Error finding container f12b1c23d9f5aa092de52d6cfe97dfc069d501eca73a3f67a78dac51d58ba01e: Status 404 returned error can't find the container with id f12b1c23d9f5aa092de52d6cfe97dfc069d501eca73a3f67a78dac51d58ba01e
Jul 15 21:00:23.434859 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:23.434822    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z9bpw"]
Jul 15 21:00:23.437963 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:00:23.437937    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode670c826_029c_4b43_8594_3caf0693e896.slice/crio-f8a3b71a63984b94aaa46ebbe0c252282ac9cb24ebcbd09864ab18ff3e9c510b WatchSource:0}: Error finding container f8a3b71a63984b94aaa46ebbe0c252282ac9cb24ebcbd09864ab18ff3e9c510b: Status 404 returned error can't find the container with id f8a3b71a63984b94aaa46ebbe0c252282ac9cb24ebcbd09864ab18ff3e9c510b
Jul 15 21:00:23.958308 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:23.958265    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stl92" event={"ID":"2cceb473-9450-4dde-a82c-b92e94c92cf3","Type":"ContainerStarted","Data":"a3a313877309a89d976946ef9d88efef01ad3fb47c56b4b9b9de7834c9a27063"}
Jul 15 21:00:23.959945 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:23.959911    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-668df9dcfb-hfttz" event={"ID":"fe5f8a61-62cd-4fa5-a0dc-e41919ba24c8","Type":"ContainerStarted","Data":"25a66c2f286038a4f07092ede4a2be3ee5381c983dbb70dd5212adc96e503101"}
Jul 15 21:00:23.961226 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:23.961195    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zqlwf" event={"ID":"714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91","Type":"ContainerStarted","Data":"f12b1c23d9f5aa092de52d6cfe97dfc069d501eca73a3f67a78dac51d58ba01e"}
Jul 15 21:00:23.963719 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:23.963696    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r" event={"ID":"04722939-8de4-4bb0-976c-fb4fc2a1bfdf","Type":"ContainerStarted","Data":"f83b30c0a31a8269a5eb6ea559fdfa078d336e77bfd20a80c9c679076554c280"}
Jul 15 21:00:23.963904 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:23.963729    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r" event={"ID":"04722939-8de4-4bb0-976c-fb4fc2a1bfdf","Type":"ContainerStarted","Data":"d9d6ec5764ed8683cf63718de25c19e34036b3cd2a1c63574604a0c2159a6b9a"}
Jul 15 21:00:23.963904 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:23.963756    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r" event={"ID":"04722939-8de4-4bb0-976c-fb4fc2a1bfdf","Type":"ContainerStarted","Data":"5d8a1cedd7be07e82eac517e009e01d6e5fa09f6a5c3f402bb4b56c3bdb171b7"}
Jul 15 21:00:23.965035 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:23.965014    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z9bpw" event={"ID":"e670c826-029c-4b43-8594-3caf0693e896","Type":"ContainerStarted","Data":"f8a3b71a63984b94aaa46ebbe0c252282ac9cb24ebcbd09864ab18ff3e9c510b"}
Jul 15 21:00:23.966170 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:23.966153    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k47j9" event={"ID":"4a380d70-7f9e-4fc4-b28d-520f61003def","Type":"ContainerStarted","Data":"cb42d148585dcc704054fdae98f69f842162e006552c0641e8d4c869e5e293ff"}
Jul 15 21:00:24.005673 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:24.005605    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-stl92" podStartSLOduration=17.655785103 podStartE2EDuration="33.005583476s" totalImagesPullingTime="15.349798373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:23.984000457 +0000 UTC m=+71.174679890" watchObservedRunningTime="2026-07-15 21:00:24.005583476 +0000 UTC m=+71.196262907"
Jul 15 21:00:24.032201 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:24.032136    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-668df9dcfb-hfttz" podStartSLOduration=3.372847697 podStartE2EDuration="10.0321133s" totalImagesPullingTime="6.659265603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:00:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:24.005472919 +0000 UTC m=+71.196152347" watchObservedRunningTime="2026-07-15 21:00:24.0321133 +0000 UTC m=+71.222792730"
Jul 15 21:00:24.032397 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:24.032236    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fffd4ff58-9gd7r" podStartSLOduration=3.364237932 podStartE2EDuration="10.032228408s" totalImagesPullingTime="6.667990476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:00:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:24.030918814 +0000 UTC m=+71.221598257" watchObservedRunningTime="2026-07-15 21:00:24.032228408 +0000 UTC m=+71.222907839"
Jul 15 21:00:25.976744 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:25.976650    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k47j9" event={"ID":"4a380d70-7f9e-4fc4-b28d-520f61003def","Type":"ContainerStarted","Data":"74a0ac1f6aee4f994e92eb6161f7d5529040838f066b7e85f2536d43d04279f5"}
Jul 15 21:00:25.976744 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:25.976712    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k47j9" event={"ID":"4a380d70-7f9e-4fc4-b28d-520f61003def","Type":"ContainerStarted","Data":"0a67efb52b4f534eadc8b314e1a3b51d25ee2b61de837063e7cc80fb87ddf746"}
Jul 15 21:00:28.988173 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:28.988138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z9bpw" event={"ID":"e670c826-029c-4b43-8594-3caf0693e896","Type":"ContainerStarted","Data":"f13ef91bc4fd5d58b4c0e73056e9ea0780dfc1e8c94604eca1019f4fd6acd3b0"}
Jul 15 21:00:28.988596 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:28.988272    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 21:00:28.989646 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:28.989626    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zqlwf" event={"ID":"714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91","Type":"ContainerStarted","Data":"fd364cd02a9aad8d50e4a8128935ab4b5bc1b13ca51e893ed80ad1252feac297"}
Jul 15 21:00:29.005557 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:29.005506    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k47j9" podStartSLOduration=74.011871963 podStartE2EDuration="1m16.005492342s" totalImagesPullingTime="1.993620379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:26.03553071 +0000 UTC m=+73.226210161" watchObservedRunningTime="2026-07-15 21:00:29.005492342 +0000 UTC m=+76.196171831"
Jul 15 21:00:29.005863 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:29.005842    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z9bpw" podStartSLOduration=71.010429183 podStartE2EDuration="1m16.005837191s" totalImagesPullingTime="4.995408008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:29.004593027 +0000 UTC m=+76.195272457" watchObservedRunningTime="2026-07-15 21:00:29.005837191 +0000 UTC m=+76.196516665"
Jul 15 21:00:29.025193 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:29.025125    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zqlwf" podStartSLOduration=71.026336846 podStartE2EDuration="1m16.025100843s" totalImagesPullingTime="4.998763997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:29.024046083 +0000 UTC m=+76.214725513" watchObservedRunningTime="2026-07-15 21:00:29.025100843 +0000 UTC m=+76.215780273"
Jul 15 21:00:44.389672 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.389522    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ftmvg"]
Jul 15 21:00:44.410708 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.410672    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.413451 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.413426    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 21:00:44.413594 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.413492    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dwmzk\""
Jul 15 21:00:44.414004 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.413984    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 21:00:44.414091 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.413984    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 21:00:44.414303 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.414275    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 21:00:44.414376 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.414299    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 21:00:44.414528 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.414509    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 21:00:44.495029 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.494995    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-node-exporter-textfile\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.495029 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.495030    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltx4p\" (UniqueName: \"kubernetes.io/projected/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-kube-api-access-ltx4p\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.495236 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.495056    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-metrics-client-ca\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.495236 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.495166    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-node-exporter-wtmp\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.495236 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.495199    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.495326 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.495279    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-root\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.495326 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.495305    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-sys\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.495326 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.495320    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-node-exporter-tls\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.495418 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.495341    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-node-exporter-accelerators-collector-config\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.596596 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.596555    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-root\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.596596 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.596597    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-sys\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.596841 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.596613    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-node-exporter-tls\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.596841 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.596634    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-node-exporter-accelerators-collector-config\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.596841 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.596682    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-root\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.596841 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.596682    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-sys\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.596841 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.596691    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-node-exporter-textfile\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.596841 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:00:44.596753    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 15 21:00:44.596841 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.596786    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltx4p\" (UniqueName: \"kubernetes.io/projected/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-kube-api-access-ltx4p\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.596841 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.596816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-metrics-client-ca\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.596841 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:00:44.596839    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-node-exporter-tls podName:aa20c6ec-b8d5-4564-91d7-ab88dc623f69 nodeName:}" failed. No retries permitted until 2026-07-15 21:00:45.096816678 +0000 UTC m=+92.287496097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-node-exporter-tls") pod "node-exporter-ftmvg" (UID: "aa20c6ec-b8d5-4564-91d7-ab88dc623f69") : secret "node-exporter-tls" not found
Jul 15 21:00:44.597212 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.596895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-node-exporter-wtmp\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.597212 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.596933    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.597212 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.597019    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-node-exporter-textfile\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.597212 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.597074    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-node-exporter-wtmp\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.597394 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.597363    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-node-exporter-accelerators-collector-config\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.597523 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.597484    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-metrics-client-ca\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.599149 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.599131    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:44.621274 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:44.621244    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltx4p\" (UniqueName: \"kubernetes.io/projected/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-kube-api-access-ltx4p\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:45.101153 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:45.101106    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-node-exporter-tls\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:45.101335 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:00:45.101302    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 15 21:00:45.101432 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:00:45.101389    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-node-exporter-tls podName:aa20c6ec-b8d5-4564-91d7-ab88dc623f69 nodeName:}" failed. No retries permitted until 2026-07-15 21:00:46.10136817 +0000 UTC m=+93.292047578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-node-exporter-tls") pod "node-exporter-ftmvg" (UID: "aa20c6ec-b8d5-4564-91d7-ab88dc623f69") : secret "node-exporter-tls" not found
Jul 15 21:00:46.108965 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:46.108928    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-node-exporter-tls\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:46.111465 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:46.111426    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aa20c6ec-b8d5-4564-91d7-ab88dc623f69-node-exporter-tls\") pod \"node-exporter-ftmvg\" (UID: \"aa20c6ec-b8d5-4564-91d7-ab88dc623f69\") " pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:46.222863 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:46.222797    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ftmvg"
Jul 15 21:00:46.232954 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:00:46.232926    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa20c6ec_b8d5_4564_91d7_ab88dc623f69.slice/crio-50ec1516a198a7894b9fb4dc51c55f716bebb5ac3b760c7f583832730c5db4f9 WatchSource:0}: Error finding container 50ec1516a198a7894b9fb4dc51c55f716bebb5ac3b760c7f583832730c5db4f9: Status 404 returned error can't find the container with id 50ec1516a198a7894b9fb4dc51c55f716bebb5ac3b760c7f583832730c5db4f9
Jul 15 21:00:47.055025 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:47.054989    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ftmvg" event={"ID":"aa20c6ec-b8d5-4564-91d7-ab88dc623f69","Type":"ContainerStarted","Data":"50ec1516a198a7894b9fb4dc51c55f716bebb5ac3b760c7f583832730c5db4f9"}
Jul 15 21:00:48.059664 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:48.059626    2560 generic.go:356] "Generic (PLEG): container finished" podID="aa20c6ec-b8d5-4564-91d7-ab88dc623f69" containerID="9f34e6b5e4f47978cf310f67b69a4013bb882ab1cef37acb2dae13e58f0d5f79" exitCode=0
Jul 15 21:00:48.060130 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:48.059691    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ftmvg" event={"ID":"aa20c6ec-b8d5-4564-91d7-ab88dc623f69","Type":"ContainerDied","Data":"9f34e6b5e4f47978cf310f67b69a4013bb882ab1cef37acb2dae13e58f0d5f79"}
Jul 15 21:00:49.064900 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:49.064847    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ftmvg" event={"ID":"aa20c6ec-b8d5-4564-91d7-ab88dc623f69","Type":"ContainerStarted","Data":"db1c1098cbff419bd4f83cc62b78b0a0f48ce4d7e206143f380ae45a66ef7931"}
Jul 15 21:00:49.065286 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:49.064935    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ftmvg" event={"ID":"aa20c6ec-b8d5-4564-91d7-ab88dc623f69","Type":"ContainerStarted","Data":"fbef1a100e6d69f985dbfea8e21328c0dc8e938f5c75c9c598a3884b7f68163a"}
Jul 15 21:00:49.105416 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:49.105357    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ftmvg" podStartSLOduration=4.004743378 podStartE2EDuration="5.105337885s" totalImagesPullingTime="1.033097533s" totalInitContainerRuntime="67.496974ms" isStatefulPod=true podCreationTimestamp="2026-07-15 21:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:49.105305902 +0000 UTC m=+96.295985336" watchObservedRunningTime="2026-07-15 21:00:49.105337885 +0000 UTC m=+96.296017371"
Jul 15 21:00:59.995859 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:00:59.995824    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z9bpw"
Jul 15 21:01:02.150764 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:01:02.150734    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8gbcf_0c36943f-6089-442b-a6f1-1d5a2e666a0e/serve-healthcheck-canary/0.log"
Jul 15 21:03:41.168639 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:03:41.168558    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kq6wr"]
Jul 15 21:03:41.170857 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:03:41.170840    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-kq6wr"
Jul 15 21:03:41.174271 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:03:41.174240    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 21:03:41.174376 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:03:41.174238    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-4ktgn\""
Jul 15 21:03:41.174754 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:03:41.174736    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 21:03:41.187350 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:03:41.187321    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kq6wr"]
Jul 15 21:03:41.230117 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:03:41.230083    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp82x\" (UniqueName: \"kubernetes.io/projected/804c6706-f487-4eef-a5c8-fac6c02b7bb9-kube-api-access-mp82x\") pod \"cert-manager-webhook-6486ffd997-kq6wr\" (UID: \"804c6706-f487-4eef-a5c8-fac6c02b7bb9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kq6wr"
Jul 15 21:03:41.230298 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:03:41.230134    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/804c6706-f487-4eef-a5c8-fac6c02b7bb9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kq6wr\" (UID: \"804c6706-f487-4eef-a5c8-fac6c02b7bb9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kq6wr"
Jul 15 21:03:41.330538 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:03:41.330485    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp82x\" (UniqueName: \"kubernetes.io/projected/804c6706-f487-4eef-a5c8-fac6c02b7bb9-kube-api-access-mp82x\") pod \"cert-manager-webhook-6486ffd997-kq6wr\" (UID: \"804c6706-f487-4eef-a5c8-fac6c02b7bb9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kq6wr"
Jul 15 21:03:41.330538 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:03:41.330547    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/804c6706-f487-4eef-a5c8-fac6c02b7bb9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kq6wr\" (UID: \"804c6706-f487-4eef-a5c8-fac6c02b7bb9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kq6wr"
Jul 15 21:03:41.341114 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:03:41.341081    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/804c6706-f487-4eef-a5c8-fac6c02b7bb9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kq6wr\" (UID: \"804c6706-f487-4eef-a5c8-fac6c02b7bb9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kq6wr"
Jul 15 21:03:41.344974 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:03:41.344943    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp82x\" (UniqueName: \"kubernetes.io/projected/804c6706-f487-4eef-a5c8-fac6c02b7bb9-kube-api-access-mp82x\") pod \"cert-manager-webhook-6486ffd997-kq6wr\" (UID: \"804c6706-f487-4eef-a5c8-fac6c02b7bb9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kq6wr"
Jul 15 21:03:41.480018 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:03:41.479930    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-kq6wr"
Jul 15 21:03:41.607957 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:03:41.607922    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kq6wr"]
Jul 15 21:03:41.610957 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:03:41.610927    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod804c6706_f487_4eef_a5c8_fac6c02b7bb9.slice/crio-4e737179d636b50fd461a6fc583d013e84040bec4a45a7430f031afeb45d2ce9 WatchSource:0}: Error finding container 4e737179d636b50fd461a6fc583d013e84040bec4a45a7430f031afeb45d2ce9: Status 404 returned error can't find the container with id 4e737179d636b50fd461a6fc583d013e84040bec4a45a7430f031afeb45d2ce9
Jul 15 21:03:41.623909 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:03:41.623859    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-kq6wr" event={"ID":"804c6706-f487-4eef-a5c8-fac6c02b7bb9","Type":"ContainerStarted","Data":"4e737179d636b50fd461a6fc583d013e84040bec4a45a7430f031afeb45d2ce9"}
Jul 15 21:03:45.640831 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:03:45.640796    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-kq6wr" event={"ID":"804c6706-f487-4eef-a5c8-fac6c02b7bb9","Type":"ContainerStarted","Data":"3bdf4d5ef11986e53062589aad4d7544b526747ee1ed0b0274fb3bbc9dd348fa"}
Jul 15 21:03:45.641213 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:03:45.640906    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-kq6wr"
Jul 15 21:03:45.657645 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:03:45.657591    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-kq6wr" podStartSLOduration=1.670226269 podStartE2EDuration="4.657573516s" totalImagesPullingTime="2.987347247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:03:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:03:45.657382712 +0000 UTC m=+272.848062138" watchObservedRunningTime="2026-07-15 21:03:45.657573516 +0000 UTC m=+272.848252947"
Jul 15 21:03:51.647355 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:03:51.647323    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-kq6wr"
Jul 15 21:04:06.699501 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.699461    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw"]
Jul 15 21:04:06.701730 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.701711    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw"
Jul 15 21:04:06.704808 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.704783    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lktzz\""
Jul 15 21:04:06.705032 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.705015    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 21:04:06.705141 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.705079    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 21:04:06.705278 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.705205    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 21:04:06.705560 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.705542    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 21:04:06.719080 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.719045    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw"]
Jul 15 21:04:06.809260 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.809218    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69rbs\" (UniqueName: \"kubernetes.io/projected/183d73c0-9a39-4c66-af0c-c600e103a479-kube-api-access-69rbs\") pod \"opendatahub-operator-controller-manager-74776f8bd9-f79jw\" (UID: \"183d73c0-9a39-4c66-af0c-c600e103a479\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw"
Jul 15 21:04:06.809449 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.809281    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/183d73c0-9a39-4c66-af0c-c600e103a479-tmp\") pod \"opendatahub-operator-controller-manager-74776f8bd9-f79jw\" (UID: \"183d73c0-9a39-4c66-af0c-c600e103a479\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw"
Jul 15 21:04:06.809449 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.809350    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/183d73c0-9a39-4c66-af0c-c600e103a479-webhook-cert\") pod \"opendatahub-operator-controller-manager-74776f8bd9-f79jw\" (UID: \"183d73c0-9a39-4c66-af0c-c600e103a479\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw"
Jul 15 21:04:06.809449 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.809396    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/183d73c0-9a39-4c66-af0c-c600e103a479-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74776f8bd9-f79jw\" (UID: \"183d73c0-9a39-4c66-af0c-c600e103a479\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw"
Jul 15 21:04:06.809449 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.809424    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/183d73c0-9a39-4c66-af0c-c600e103a479-manifests\") pod \"opendatahub-operator-controller-manager-74776f8bd9-f79jw\" (UID: \"183d73c0-9a39-4c66-af0c-c600e103a479\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw"
Jul 15 21:04:06.910117 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.910079    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/183d73c0-9a39-4c66-af0c-c600e103a479-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74776f8bd9-f79jw\" (UID: \"183d73c0-9a39-4c66-af0c-c600e103a479\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw"
Jul 15 21:04:06.910117 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.910121    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/183d73c0-9a39-4c66-af0c-c600e103a479-manifests\") pod \"opendatahub-operator-controller-manager-74776f8bd9-f79jw\" (UID: \"183d73c0-9a39-4c66-af0c-c600e103a479\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw"
Jul 15 21:04:06.910361 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.910158    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69rbs\" (UniqueName: \"kubernetes.io/projected/183d73c0-9a39-4c66-af0c-c600e103a479-kube-api-access-69rbs\") pod \"opendatahub-operator-controller-manager-74776f8bd9-f79jw\" (UID: \"183d73c0-9a39-4c66-af0c-c600e103a479\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw"
Jul 15 21:04:06.910361 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.910206    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/183d73c0-9a39-4c66-af0c-c600e103a479-tmp\") pod \"opendatahub-operator-controller-manager-74776f8bd9-f79jw\" (UID: \"183d73c0-9a39-4c66-af0c-c600e103a479\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw"
Jul 15 21:04:06.910361 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.910238    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/183d73c0-9a39-4c66-af0c-c600e103a479-webhook-cert\") pod \"opendatahub-operator-controller-manager-74776f8bd9-f79jw\" (UID: \"183d73c0-9a39-4c66-af0c-c600e103a479\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw"
Jul 15 21:04:06.910514 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.910497    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/183d73c0-9a39-4c66-af0c-c600e103a479-manifests\") pod \"opendatahub-operator-controller-manager-74776f8bd9-f79jw\" (UID: \"183d73c0-9a39-4c66-af0c-c600e103a479\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw"
Jul 15 21:04:06.912840 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.912816    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/183d73c0-9a39-4c66-af0c-c600e103a479-tmp\") pod \"opendatahub-operator-controller-manager-74776f8bd9-f79jw\" (UID: \"183d73c0-9a39-4c66-af0c-c600e103a479\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw"
Jul 15 21:04:06.913101 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.913081    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/183d73c0-9a39-4c66-af0c-c600e103a479-webhook-cert\") pod \"opendatahub-operator-controller-manager-74776f8bd9-f79jw\" (UID: \"183d73c0-9a39-4c66-af0c-c600e103a479\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw"
Jul 15 21:04:06.913172 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.913087    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/183d73c0-9a39-4c66-af0c-c600e103a479-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74776f8bd9-f79jw\" (UID: \"183d73c0-9a39-4c66-af0c-c600e103a479\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw"
Jul 15 21:04:06.925054 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:06.925028    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69rbs\" (UniqueName: \"kubernetes.io/projected/183d73c0-9a39-4c66-af0c-c600e103a479-kube-api-access-69rbs\") pod \"opendatahub-operator-controller-manager-74776f8bd9-f79jw\" (UID: \"183d73c0-9a39-4c66-af0c-c600e103a479\") " pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw"
Jul 15 21:04:07.012259 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:07.012158    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw"
Jul 15 21:04:07.145843 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:07.145806    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw"]
Jul 15 21:04:07.149341 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:04:07.149315    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod183d73c0_9a39_4c66_af0c_c600e103a479.slice/crio-a7081f1efec148a4bf3275e2123722c7f3a0b3f48780fa70f661d5cf4cf2afea WatchSource:0}: Error finding container a7081f1efec148a4bf3275e2123722c7f3a0b3f48780fa70f661d5cf4cf2afea: Status 404 returned error can't find the container with id a7081f1efec148a4bf3275e2123722c7f3a0b3f48780fa70f661d5cf4cf2afea
Jul 15 21:04:07.711998 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:07.711960    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw" event={"ID":"183d73c0-9a39-4c66-af0c-c600e103a479","Type":"ContainerStarted","Data":"a7081f1efec148a4bf3275e2123722c7f3a0b3f48780fa70f661d5cf4cf2afea"}
Jul 15 21:04:10.724052 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:10.724013    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw" event={"ID":"183d73c0-9a39-4c66-af0c-c600e103a479","Type":"ContainerStarted","Data":"7ad1ddd29e985dcacf7d23faa5bc063bae1a68c7723cfe74cc8141b652def119"}
Jul 15 21:04:11.728497 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:11.728466    2560 generic.go:356] "Generic (PLEG): container finished" podID="183d73c0-9a39-4c66-af0c-c600e103a479" containerID="7ad1ddd29e985dcacf7d23faa5bc063bae1a68c7723cfe74cc8141b652def119" exitCode=0
Jul 15 21:04:11.728927 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:11.728525    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw" event={"ID":"183d73c0-9a39-4c66-af0c-c600e103a479","Type":"ContainerDied","Data":"7ad1ddd29e985dcacf7d23faa5bc063bae1a68c7723cfe74cc8141b652def119"}
Jul 15 21:04:12.733451 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:12.733417    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw" event={"ID":"183d73c0-9a39-4c66-af0c-c600e103a479","Type":"ContainerStarted","Data":"fc19751163ae5f0e0369e75b57dd1d3aee314492dab2a86d9dbbb6c2ee41e8e9"}
Jul 15 21:04:12.733924 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:12.733555    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw"
Jul 15 21:04:12.756583 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:12.756523    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw" podStartSLOduration=2.294522308 podStartE2EDuration="6.7564995s" totalImagesPullingTime="3.378396564s" totalInitContainerRuntime="1.083580628s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:04:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:04:12.754988447 +0000 UTC m=+299.945667876" watchObservedRunningTime="2026-07-15 21:04:12.7564995 +0000 UTC m=+299.947178930"
Jul 15 21:04:13.489975 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:13.489946    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 21:04:23.739219 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:23.739185    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74776f8bd9-f79jw"
Jul 15 21:04:26.680345 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.680311    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-649f4f97b8-6pdmt"]
Jul 15 21:04:26.682642 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.682598    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-649f4f97b8-6pdmt"
Jul 15 21:04:26.691585 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.691561    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 21:04:26.691940 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.691912    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 21:04:26.692394 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.692380    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 21:04:26.692660 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.692643    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tp66v\""
Jul 15 21:04:26.692761 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.692660    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 21:04:26.692761 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.692737    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 21:04:26.723994 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.723841    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-55c97b5545-qc5nw"]
Jul 15 21:04:26.727087 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.727057    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-649f4f97b8-6pdmt"]
Jul 15 21:04:26.727233 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.727155    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55c97b5545-qc5nw"
Jul 15 21:04:26.731702 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:04:26.731668    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-tls\" is forbidden: User \"system:node:ip-10-0-130-134.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-134.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret"
Jul 15 21:04:26.731900 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:04:26.731763    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-134.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-134.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 15 21:04:26.731900 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:04:26.731825    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-creds\" is forbidden: User \"system:node:ip-10-0-130-134.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-134.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" type="*v1.Secret"
Jul 15 21:04:26.731900 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:04:26.731867    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-134.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-134.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 15 21:04:26.732111 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:04:26.732087    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-dockercfg-6rzmb\" is forbidden: User \"system:node:ip-10-0-130-134.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-134.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6rzmb\"" type="*v1.Secret"
Jul 15 21:04:26.764974 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.764941    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55c97b5545-qc5nw"]
Jul 15 21:04:26.766079 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.766050    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c81a6b6a-9715-4a56-852a-9d952d35ba51-metrics-cert\") pod \"lws-controller-manager-649f4f97b8-6pdmt\" (UID: \"c81a6b6a-9715-4a56-852a-9d952d35ba51\") " pod="openshift-lws-operator/lws-controller-manager-649f4f97b8-6pdmt"
Jul 15 21:04:26.766211 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.766101    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmr5d\" (UniqueName: \"kubernetes.io/projected/c81a6b6a-9715-4a56-852a-9d952d35ba51-kube-api-access-cmr5d\") pod \"lws-controller-manager-649f4f97b8-6pdmt\" (UID: \"c81a6b6a-9715-4a56-852a-9d952d35ba51\") " pod="openshift-lws-operator/lws-controller-manager-649f4f97b8-6pdmt"
Jul 15 21:04:26.766262 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.766209    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c81a6b6a-9715-4a56-852a-9d952d35ba51-cert\") pod \"lws-controller-manager-649f4f97b8-6pdmt\" (UID: \"c81a6b6a-9715-4a56-852a-9d952d35ba51\") " pod="openshift-lws-operator/lws-controller-manager-649f4f97b8-6pdmt"
Jul 15 21:04:26.766308 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.766277    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c81a6b6a-9715-4a56-852a-9d952d35ba51-manager-config\") pod \"lws-controller-manager-649f4f97b8-6pdmt\" (UID: \"c81a6b6a-9715-4a56-852a-9d952d35ba51\") " pod="openshift-lws-operator/lws-controller-manager-649f4f97b8-6pdmt"
Jul 15 21:04:26.867319 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.867278    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c03bff64-521d-4569-88a5-533fc52fb746-tmp\") pod \"kube-auth-proxy-55c97b5545-qc5nw\" (UID: \"c03bff64-521d-4569-88a5-533fc52fb746\") " pod="openshift-ingress/kube-auth-proxy-55c97b5545-qc5nw"
Jul 15 21:04:26.867507 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.867345    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c81a6b6a-9715-4a56-852a-9d952d35ba51-cert\") pod \"lws-controller-manager-649f4f97b8-6pdmt\" (UID: \"c81a6b6a-9715-4a56-852a-9d952d35ba51\") " pod="openshift-lws-operator/lws-controller-manager-649f4f97b8-6pdmt"
Jul 15 21:04:26.867507 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.867370    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c03bff64-521d-4569-88a5-533fc52fb746-tls-certs\") pod \"kube-auth-proxy-55c97b5545-qc5nw\" (UID: \"c03bff64-521d-4569-88a5-533fc52fb746\") " pod="openshift-ingress/kube-auth-proxy-55c97b5545-qc5nw"
Jul 15 21:04:26.867507 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.867406    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd5q8\" (UniqueName: \"kubernetes.io/projected/c03bff64-521d-4569-88a5-533fc52fb746-kube-api-access-nd5q8\") pod \"kube-auth-proxy-55c97b5545-qc5nw\" (UID: \"c03bff64-521d-4569-88a5-533fc52fb746\") " pod="openshift-ingress/kube-auth-proxy-55c97b5545-qc5nw"
Jul 15 21:04:26.867507 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.867446    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c81a6b6a-9715-4a56-852a-9d952d35ba51-manager-config\") pod \"lws-controller-manager-649f4f97b8-6pdmt\" (UID: \"c81a6b6a-9715-4a56-852a-9d952d35ba51\") " pod="openshift-lws-operator/lws-controller-manager-649f4f97b8-6pdmt"
Jul 15 21:04:26.867507 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.867496    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c81a6b6a-9715-4a56-852a-9d952d35ba51-metrics-cert\") pod \"lws-controller-manager-649f4f97b8-6pdmt\" (UID: \"c81a6b6a-9715-4a56-852a-9d952d35ba51\") " pod="openshift-lws-operator/lws-controller-manager-649f4f97b8-6pdmt"
Jul 15 21:04:26.867701 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.867534    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmr5d\" (UniqueName: \"kubernetes.io/projected/c81a6b6a-9715-4a56-852a-9d952d35ba51-kube-api-access-cmr5d\") pod \"lws-controller-manager-649f4f97b8-6pdmt\" (UID: \"c81a6b6a-9715-4a56-852a-9d952d35ba51\") " pod="openshift-lws-operator/lws-controller-manager-649f4f97b8-6pdmt"
Jul 15 21:04:26.868266 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.868237    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c81a6b6a-9715-4a56-852a-9d952d35ba51-manager-config\") pod \"lws-controller-manager-649f4f97b8-6pdmt\" (UID: \"c81a6b6a-9715-4a56-852a-9d952d35ba51\") " pod="openshift-lws-operator/lws-controller-manager-649f4f97b8-6pdmt"
Jul 15 21:04:26.870492 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.870465    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c81a6b6a-9715-4a56-852a-9d952d35ba51-cert\") pod \"lws-controller-manager-649f4f97b8-6pdmt\" (UID: \"c81a6b6a-9715-4a56-852a-9d952d35ba51\") " pod="openshift-lws-operator/lws-controller-manager-649f4f97b8-6pdmt"
Jul 15 21:04:26.870626 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.870523    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c81a6b6a-9715-4a56-852a-9d952d35ba51-metrics-cert\") pod \"lws-controller-manager-649f4f97b8-6pdmt\" (UID: \"c81a6b6a-9715-4a56-852a-9d952d35ba51\") " pod="openshift-lws-operator/lws-controller-manager-649f4f97b8-6pdmt"
Jul 15 21:04:26.882292 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.882258    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmr5d\" (UniqueName: \"kubernetes.io/projected/c81a6b6a-9715-4a56-852a-9d952d35ba51-kube-api-access-cmr5d\") pod \"lws-controller-manager-649f4f97b8-6pdmt\" (UID: \"c81a6b6a-9715-4a56-852a-9d952d35ba51\") " pod="openshift-lws-operator/lws-controller-manager-649f4f97b8-6pdmt"
Jul 15 21:04:26.968527 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.968432    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c03bff64-521d-4569-88a5-533fc52fb746-tls-certs\") pod \"kube-auth-proxy-55c97b5545-qc5nw\" (UID: \"c03bff64-521d-4569-88a5-533fc52fb746\") " pod="openshift-ingress/kube-auth-proxy-55c97b5545-qc5nw"
Jul 15 21:04:26.968527 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.968472    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd5q8\" (UniqueName: \"kubernetes.io/projected/c03bff64-521d-4569-88a5-533fc52fb746-kube-api-access-nd5q8\") pod \"kube-auth-proxy-55c97b5545-qc5nw\" (UID: \"c03bff64-521d-4569-88a5-533fc52fb746\") " pod="openshift-ingress/kube-auth-proxy-55c97b5545-qc5nw"
Jul 15 21:04:26.968732 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.968593    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c03bff64-521d-4569-88a5-533fc52fb746-tmp\") pod \"kube-auth-proxy-55c97b5545-qc5nw\" (UID: \"c03bff64-521d-4569-88a5-533fc52fb746\") " pod="openshift-ingress/kube-auth-proxy-55c97b5545-qc5nw"
Jul 15 21:04:26.970807 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.970756    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c03bff64-521d-4569-88a5-533fc52fb746-tmp\") pod \"kube-auth-proxy-55c97b5545-qc5nw\" (UID: \"c03bff64-521d-4569-88a5-533fc52fb746\") " pod="openshift-ingress/kube-auth-proxy-55c97b5545-qc5nw"
Jul 15 21:04:26.992932 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:26.992892    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-649f4f97b8-6pdmt"
Jul 15 21:04:27.143536 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:27.143503    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-649f4f97b8-6pdmt"]
Jul 15 21:04:27.147294 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:04:27.147256    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc81a6b6a_9715_4a56_852a_9d952d35ba51.slice/crio-ea0a1648a9d5e985c4132a35298308e01fc351bb13b781a0509e1cef9d50f067 WatchSource:0}: Error finding container ea0a1648a9d5e985c4132a35298308e01fc351bb13b781a0509e1cef9d50f067: Status 404 returned error can't find the container with id ea0a1648a9d5e985c4132a35298308e01fc351bb13b781a0509e1cef9d50f067
Jul 15 21:04:27.149282 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:27.149266    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 21:04:27.788252 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:27.788217    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-649f4f97b8-6pdmt" event={"ID":"c81a6b6a-9715-4a56-852a-9d952d35ba51","Type":"ContainerStarted","Data":"ea0a1648a9d5e985c4132a35298308e01fc351bb13b781a0509e1cef9d50f067"}
Jul 15 21:04:27.789862 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:27.789840    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 21:04:27.876834 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:27.876802    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 21:04:27.968996 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:04:27.968964    2560 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: failed to sync secret cache: timed out waiting for the condition
Jul 15 21:04:27.969166 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:04:27.969055    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c03bff64-521d-4569-88a5-533fc52fb746-tls-certs podName:c03bff64-521d-4569-88a5-533fc52fb746 nodeName:}" failed. No retries permitted until 2026-07-15 21:04:28.469031161 +0000 UTC m=+315.659710582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c03bff64-521d-4569-88a5-533fc52fb746-tls-certs") pod "kube-auth-proxy-55c97b5545-qc5nw" (UID: "c03bff64-521d-4569-88a5-533fc52fb746") : failed to sync secret cache: timed out waiting for the condition
Jul 15 21:04:27.981700 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:27.981671    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 21:04:27.984344 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:27.984317    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd5q8\" (UniqueName: \"kubernetes.io/projected/c03bff64-521d-4569-88a5-533fc52fb746-kube-api-access-nd5q8\") pod \"kube-auth-proxy-55c97b5545-qc5nw\" (UID: \"c03bff64-521d-4569-88a5-533fc52fb746\") " pod="openshift-ingress/kube-auth-proxy-55c97b5545-qc5nw"
Jul 15 21:04:28.008713 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:28.008682    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 21:04:28.112886 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:28.112735    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6rzmb\""
Jul 15 21:04:28.483019 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:28.482981    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c03bff64-521d-4569-88a5-533fc52fb746-tls-certs\") pod \"kube-auth-proxy-55c97b5545-qc5nw\" (UID: \"c03bff64-521d-4569-88a5-533fc52fb746\") " pod="openshift-ingress/kube-auth-proxy-55c97b5545-qc5nw"
Jul 15 21:04:28.486242 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:28.486212    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c03bff64-521d-4569-88a5-533fc52fb746-tls-certs\") pod \"kube-auth-proxy-55c97b5545-qc5nw\" (UID: \"c03bff64-521d-4569-88a5-533fc52fb746\") " pod="openshift-ingress/kube-auth-proxy-55c97b5545-qc5nw"
Jul 15 21:04:28.537358 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:28.537318    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55c97b5545-qc5nw"
Jul 15 21:04:28.700427 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:28.700367    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55c97b5545-qc5nw"]
Jul 15 21:04:28.703086 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:04:28.703053    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc03bff64_521d_4569_88a5_533fc52fb746.slice/crio-f26921127710e53b5203bc85db6433982634c20d2e5f042cecebbacca72a1301 WatchSource:0}: Error finding container f26921127710e53b5203bc85db6433982634c20d2e5f042cecebbacca72a1301: Status 404 returned error can't find the container with id f26921127710e53b5203bc85db6433982634c20d2e5f042cecebbacca72a1301
Jul 15 21:04:28.794942 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:28.794855    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55c97b5545-qc5nw" event={"ID":"c03bff64-521d-4569-88a5-533fc52fb746","Type":"ContainerStarted","Data":"f26921127710e53b5203bc85db6433982634c20d2e5f042cecebbacca72a1301"}
Jul 15 21:04:30.804852 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:30.804810    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-649f4f97b8-6pdmt" event={"ID":"c81a6b6a-9715-4a56-852a-9d952d35ba51","Type":"ContainerStarted","Data":"2ca6d4102df980b81699d698b44d7b41f2493763b7e03904c13b89a640a95990"}
Jul 15 21:04:30.805280 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:30.804922    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-649f4f97b8-6pdmt"
Jul 15 21:04:30.824047 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:30.823986    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-649f4f97b8-6pdmt" podStartSLOduration=2.148695769 podStartE2EDuration="4.823963413s" totalImagesPullingTime="2.675267644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:04:30.822604712 +0000 UTC m=+318.013284145" watchObservedRunningTime="2026-07-15 21:04:30.823963413 +0000 UTC m=+318.014642842"
Jul 15 21:04:31.809963 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:31.809860    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55c97b5545-qc5nw" event={"ID":"c03bff64-521d-4569-88a5-533fc52fb746","Type":"ContainerStarted","Data":"ab1286f535e8f23c20b269a578df6feca15f856b22aa45973e8464b183db24b3"}
Jul 15 21:04:31.841965 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:31.841911    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-55c97b5545-qc5nw" podStartSLOduration=3.0007847 podStartE2EDuration="5.841891351s" totalImagesPullingTime="2.841106651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:04:31.841410458 +0000 UTC m=+319.032089888" watchObservedRunningTime="2026-07-15 21:04:31.841891351 +0000 UTC m=+319.032570781"
Jul 15 21:04:41.812027 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:04:41.811995    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-649f4f97b8-6pdmt"
Jul 15 21:06:12.249735 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:12.249696    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pp5jb"]
Jul 15 21:06:12.253171 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:12.253147    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pp5jb"
Jul 15 21:06:12.256157 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:12.256132    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 21:06:12.256288 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:12.256161    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4qntx\""
Jul 15 21:06:12.256663 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:12.256648    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 15 21:06:12.256789 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:12.256711    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 21:06:12.257055 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:12.257040    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 15 21:06:12.262842 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:12.262819    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pp5jb"]
Jul 15 21:06:12.280198 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:12.280167    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh78m\" (UniqueName: \"kubernetes.io/projected/92cc0df2-954f-4f58-a9f4-f5c69ffd5213-kube-api-access-xh78m\") pod \"kuadrant-console-plugin-66b5774985-pp5jb\" (UID: \"92cc0df2-954f-4f58-a9f4-f5c69ffd5213\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pp5jb"
Jul 15 21:06:12.280358 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:12.280202    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/92cc0df2-954f-4f58-a9f4-f5c69ffd5213-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pp5jb\" (UID: \"92cc0df2-954f-4f58-a9f4-f5c69ffd5213\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pp5jb"
Jul 15 21:06:12.280358 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:12.280223    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/92cc0df2-954f-4f58-a9f4-f5c69ffd5213-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pp5jb\" (UID: \"92cc0df2-954f-4f58-a9f4-f5c69ffd5213\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pp5jb"
Jul 15 21:06:12.381123 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:12.381083    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh78m\" (UniqueName: \"kubernetes.io/projected/92cc0df2-954f-4f58-a9f4-f5c69ffd5213-kube-api-access-xh78m\") pod \"kuadrant-console-plugin-66b5774985-pp5jb\" (UID: \"92cc0df2-954f-4f58-a9f4-f5c69ffd5213\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pp5jb"
Jul 15 21:06:12.381123 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:12.381120    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/92cc0df2-954f-4f58-a9f4-f5c69ffd5213-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pp5jb\" (UID: \"92cc0df2-954f-4f58-a9f4-f5c69ffd5213\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pp5jb"
Jul 15 21:06:12.381382 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:12.381144    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/92cc0df2-954f-4f58-a9f4-f5c69ffd5213-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pp5jb\" (UID: \"92cc0df2-954f-4f58-a9f4-f5c69ffd5213\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pp5jb"
Jul 15 21:06:12.381382 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:06:12.381238    2560 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 15 21:06:12.381382 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:06:12.381318    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92cc0df2-954f-4f58-a9f4-f5c69ffd5213-plugin-serving-cert podName:92cc0df2-954f-4f58-a9f4-f5c69ffd5213 nodeName:}" failed. No retries permitted until 2026-07-15 21:06:12.881299339 +0000 UTC m=+420.071978748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/92cc0df2-954f-4f58-a9f4-f5c69ffd5213-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-pp5jb" (UID: "92cc0df2-954f-4f58-a9f4-f5c69ffd5213") : secret "plugin-serving-cert" not found
Jul 15 21:06:12.381862 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:12.381834    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/92cc0df2-954f-4f58-a9f4-f5c69ffd5213-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pp5jb\" (UID: \"92cc0df2-954f-4f58-a9f4-f5c69ffd5213\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pp5jb"
Jul 15 21:06:12.393227 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:12.393204    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh78m\" (UniqueName: \"kubernetes.io/projected/92cc0df2-954f-4f58-a9f4-f5c69ffd5213-kube-api-access-xh78m\") pod \"kuadrant-console-plugin-66b5774985-pp5jb\" (UID: \"92cc0df2-954f-4f58-a9f4-f5c69ffd5213\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pp5jb"
Jul 15 21:06:12.883265 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:12.883223    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/92cc0df2-954f-4f58-a9f4-f5c69ffd5213-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pp5jb\" (UID: \"92cc0df2-954f-4f58-a9f4-f5c69ffd5213\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pp5jb"
Jul 15 21:06:12.885739 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:12.885713    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/92cc0df2-954f-4f58-a9f4-f5c69ffd5213-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pp5jb\" (UID: \"92cc0df2-954f-4f58-a9f4-f5c69ffd5213\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pp5jb"
Jul 15 21:06:13.163819 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:13.163788    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pp5jb"
Jul 15 21:06:13.292691 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:13.292657    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pp5jb"]
Jul 15 21:06:13.295719 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:06:13.295686    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92cc0df2_954f_4f58_a9f4_f5c69ffd5213.slice/crio-a9a3486b2e5745f5062b3e2b7d574f372f2a232847c8e9128369667f83e7f54d WatchSource:0}: Error finding container a9a3486b2e5745f5062b3e2b7d574f372f2a232847c8e9128369667f83e7f54d: Status 404 returned error can't find the container with id a9a3486b2e5745f5062b3e2b7d574f372f2a232847c8e9128369667f83e7f54d
Jul 15 21:06:14.166122 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:14.166080    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pp5jb" event={"ID":"92cc0df2-954f-4f58-a9f4-f5c69ffd5213","Type":"ContainerStarted","Data":"a9a3486b2e5745f5062b3e2b7d574f372f2a232847c8e9128369667f83e7f54d"}
Jul 15 21:06:37.261458 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:37.261420    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pp5jb" event={"ID":"92cc0df2-954f-4f58-a9f4-f5c69ffd5213","Type":"ContainerStarted","Data":"5ef910502d56b358d665d245e51fc927d976da071b4e08411f99c4b1cb36549b"}
Jul 15 21:06:37.281209 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:37.281157    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pp5jb" podStartSLOduration=1.6954455 podStartE2EDuration="25.281141251s" totalImagesPullingTime="23.585695751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:37.280282854 +0000 UTC m=+444.470962285" watchObservedRunningTime="2026-07-15 21:06:37.281141251 +0000 UTC m=+444.471820723"
Jul 15 21:06:53.751831 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:53.751789    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-vknlq"]
Jul 15 21:06:53.754459 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:53.754440    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vknlq"
Jul 15 21:06:53.756984 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:53.756964    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jlbmc\""
Jul 15 21:06:53.763535 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:53.763512    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-vknlq"]
Jul 15 21:06:53.903435 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:53.903404    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqx24\" (UniqueName: \"kubernetes.io/projected/1c0d56fb-1a94-4209-8dcd-23582a0706fb-kube-api-access-vqx24\") pod \"authorino-58cd955675-vknlq\" (UID: \"1c0d56fb-1a94-4209-8dcd-23582a0706fb\") " pod="kuadrant-system/authorino-58cd955675-vknlq"
Jul 15 21:06:53.943689 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:53.943647    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-gbjzv"]
Jul 15 21:06:53.946900 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:53.946872    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gbjzv"
Jul 15 21:06:53.954717 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:53.954693    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gbjzv"]
Jul 15 21:06:54.004689 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:54.004602    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d65jg\" (UniqueName: \"kubernetes.io/projected/b1067862-1ee7-49e5-91db-558309019649-kube-api-access-d65jg\") pod \"authorino-75d556bd77-gbjzv\" (UID: \"b1067862-1ee7-49e5-91db-558309019649\") " pod="kuadrant-system/authorino-75d556bd77-gbjzv"
Jul 15 21:06:54.004689 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:54.004661    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqx24\" (UniqueName: \"kubernetes.io/projected/1c0d56fb-1a94-4209-8dcd-23582a0706fb-kube-api-access-vqx24\") pod \"authorino-58cd955675-vknlq\" (UID: \"1c0d56fb-1a94-4209-8dcd-23582a0706fb\") " pod="kuadrant-system/authorino-58cd955675-vknlq"
Jul 15 21:06:54.013637 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:54.013611    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqx24\" (UniqueName: \"kubernetes.io/projected/1c0d56fb-1a94-4209-8dcd-23582a0706fb-kube-api-access-vqx24\") pod \"authorino-58cd955675-vknlq\" (UID: \"1c0d56fb-1a94-4209-8dcd-23582a0706fb\") " pod="kuadrant-system/authorino-58cd955675-vknlq"
Jul 15 21:06:54.064557 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:54.064515    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vknlq"
Jul 15 21:06:54.105378 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:54.105340    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d65jg\" (UniqueName: \"kubernetes.io/projected/b1067862-1ee7-49e5-91db-558309019649-kube-api-access-d65jg\") pod \"authorino-75d556bd77-gbjzv\" (UID: \"b1067862-1ee7-49e5-91db-558309019649\") " pod="kuadrant-system/authorino-75d556bd77-gbjzv"
Jul 15 21:06:54.114729 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:54.114699    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d65jg\" (UniqueName: \"kubernetes.io/projected/b1067862-1ee7-49e5-91db-558309019649-kube-api-access-d65jg\") pod \"authorino-75d556bd77-gbjzv\" (UID: \"b1067862-1ee7-49e5-91db-558309019649\") " pod="kuadrant-system/authorino-75d556bd77-gbjzv"
Jul 15 21:06:54.188348 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:54.188316    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-vknlq"]
Jul 15 21:06:54.191460 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:06:54.191431    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c0d56fb_1a94_4209_8dcd_23582a0706fb.slice/crio-29dd5e01dbf95dbde6f6237418933ad45d393c8da503f3c8c259a9daf9195bcb WatchSource:0}: Error finding container 29dd5e01dbf95dbde6f6237418933ad45d393c8da503f3c8c259a9daf9195bcb: Status 404 returned error can't find the container with id 29dd5e01dbf95dbde6f6237418933ad45d393c8da503f3c8c259a9daf9195bcb
Jul 15 21:06:54.256513 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:54.256429    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gbjzv"
Jul 15 21:06:54.321976 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:54.321929    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vknlq" event={"ID":"1c0d56fb-1a94-4209-8dcd-23582a0706fb","Type":"ContainerStarted","Data":"29dd5e01dbf95dbde6f6237418933ad45d393c8da503f3c8c259a9daf9195bcb"}
Jul 15 21:06:54.398218 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:54.398185    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gbjzv"]
Jul 15 21:06:54.401403 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:06:54.401376    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1067862_1ee7_49e5_91db_558309019649.slice/crio-90e91d763dd6283090b6427e8b12b68ee92d242047693981b13c2effc9ca02aa WatchSource:0}: Error finding container 90e91d763dd6283090b6427e8b12b68ee92d242047693981b13c2effc9ca02aa: Status 404 returned error can't find the container with id 90e91d763dd6283090b6427e8b12b68ee92d242047693981b13c2effc9ca02aa
Jul 15 21:06:55.329879 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:55.329804    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gbjzv" event={"ID":"b1067862-1ee7-49e5-91db-558309019649","Type":"ContainerStarted","Data":"90e91d763dd6283090b6427e8b12b68ee92d242047693981b13c2effc9ca02aa"}
Jul 15 21:06:58.342036 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:58.341997    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vknlq" event={"ID":"1c0d56fb-1a94-4209-8dcd-23582a0706fb","Type":"ContainerStarted","Data":"1e543b3640fa74c9fd1f6febb837a880a959ba4be96df5b63e63db1ed95ad529"}
Jul 15 21:06:58.343484 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:58.343456    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gbjzv" event={"ID":"b1067862-1ee7-49e5-91db-558309019649","Type":"ContainerStarted","Data":"a4a38758a3a29f168ece404588467668ee35eefa12af31d502ccf2aca41bdfb3"}
Jul 15 21:06:58.359872 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:58.359709    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-vknlq" podStartSLOduration=1.886298981 podStartE2EDuration="5.359694249s" totalImagesPullingTime="3.473395268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:58.358703941 +0000 UTC m=+465.549383370" watchObservedRunningTime="2026-07-15 21:06:58.359694249 +0000 UTC m=+465.550373678"
Jul 15 21:06:58.374604 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:58.374003    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-gbjzv" podStartSLOduration=2.099026378 podStartE2EDuration="5.373983021s" totalImagesPullingTime="3.274956643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:06:58.373426673 +0000 UTC m=+465.564106097" watchObservedRunningTime="2026-07-15 21:06:58.373983021 +0000 UTC m=+465.564662457"
Jul 15 21:06:58.403964 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:06:58.403936    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-vknlq"]
Jul 15 21:07:00.350917 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:00.350878    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-vknlq" podUID="1c0d56fb-1a94-4209-8dcd-23582a0706fb" containerName="authorino" containerID="cri-o://1e543b3640fa74c9fd1f6febb837a880a959ba4be96df5b63e63db1ed95ad529" gracePeriod=30
Jul 15 21:07:00.649812 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:00.649725    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vknlq"
Jul 15 21:07:00.761688 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:00.761657    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqx24\" (UniqueName: \"kubernetes.io/projected/1c0d56fb-1a94-4209-8dcd-23582a0706fb-kube-api-access-vqx24\") pod \"1c0d56fb-1a94-4209-8dcd-23582a0706fb\" (UID: \"1c0d56fb-1a94-4209-8dcd-23582a0706fb\") "
Jul 15 21:07:00.763892 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:00.763856    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c0d56fb-1a94-4209-8dcd-23582a0706fb-kube-api-access-vqx24" (OuterVolumeSpecName: "kube-api-access-vqx24") pod "1c0d56fb-1a94-4209-8dcd-23582a0706fb" (UID: "1c0d56fb-1a94-4209-8dcd-23582a0706fb"). InnerVolumeSpecName "kube-api-access-vqx24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:07:00.863202 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:00.863171    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqx24\" (UniqueName: \"kubernetes.io/projected/1c0d56fb-1a94-4209-8dcd-23582a0706fb-kube-api-access-vqx24\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:07:01.356057 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:01.356022    2560 generic.go:356] "Generic (PLEG): container finished" podID="1c0d56fb-1a94-4209-8dcd-23582a0706fb" containerID="1e543b3640fa74c9fd1f6febb837a880a959ba4be96df5b63e63db1ed95ad529" exitCode=0
Jul 15 21:07:01.356057 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:01.356060    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vknlq"
Jul 15 21:07:01.356507 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:01.356103    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vknlq" event={"ID":"1c0d56fb-1a94-4209-8dcd-23582a0706fb","Type":"ContainerDied","Data":"1e543b3640fa74c9fd1f6febb837a880a959ba4be96df5b63e63db1ed95ad529"}
Jul 15 21:07:01.356507 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:01.356140    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vknlq" event={"ID":"1c0d56fb-1a94-4209-8dcd-23582a0706fb","Type":"ContainerDied","Data":"29dd5e01dbf95dbde6f6237418933ad45d393c8da503f3c8c259a9daf9195bcb"}
Jul 15 21:07:01.356507 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:01.356157    2560 scope.go:117] "RemoveContainer" containerID="1e543b3640fa74c9fd1f6febb837a880a959ba4be96df5b63e63db1ed95ad529"
Jul 15 21:07:01.369551 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:01.369534    2560 scope.go:117] "RemoveContainer" containerID="1e543b3640fa74c9fd1f6febb837a880a959ba4be96df5b63e63db1ed95ad529"
Jul 15 21:07:01.369815 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:07:01.369791    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e543b3640fa74c9fd1f6febb837a880a959ba4be96df5b63e63db1ed95ad529\": container with ID starting with 1e543b3640fa74c9fd1f6febb837a880a959ba4be96df5b63e63db1ed95ad529 not found: ID does not exist" containerID="1e543b3640fa74c9fd1f6febb837a880a959ba4be96df5b63e63db1ed95ad529"
Jul 15 21:07:01.369918 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:01.369820    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e543b3640fa74c9fd1f6febb837a880a959ba4be96df5b63e63db1ed95ad529"} err="failed to get container status \"1e543b3640fa74c9fd1f6febb837a880a959ba4be96df5b63e63db1ed95ad529\": rpc error: code = NotFound desc = could not find container \"1e543b3640fa74c9fd1f6febb837a880a959ba4be96df5b63e63db1ed95ad529\": container with ID starting with 1e543b3640fa74c9fd1f6febb837a880a959ba4be96df5b63e63db1ed95ad529 not found: ID does not exist"
Jul 15 21:07:01.385527 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:01.385502    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-vknlq"]
Jul 15 21:07:01.389562 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:01.389544    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-vknlq"]
Jul 15 21:07:01.572519 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:01.572484    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c0d56fb-1a94-4209-8dcd-23582a0706fb" path="/var/lib/kubelet/pods/1c0d56fb-1a94-4209-8dcd-23582a0706fb/volumes"
Jul 15 21:07:21.601470 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:21.601436    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hq2bp"]
Jul 15 21:07:21.601981 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:21.601854    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c0d56fb-1a94-4209-8dcd-23582a0706fb" containerName="authorino"
Jul 15 21:07:21.601981 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:21.601875    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c0d56fb-1a94-4209-8dcd-23582a0706fb" containerName="authorino"
Jul 15 21:07:21.601981 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:21.601957    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c0d56fb-1a94-4209-8dcd-23582a0706fb" containerName="authorino"
Jul 15 21:07:21.637901 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:21.637867    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hq2bp"]
Jul 15 21:07:21.638046 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:21.637963    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hq2bp"
Jul 15 21:07:21.712744 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:21.712709    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm2wb\" (UniqueName: \"kubernetes.io/projected/109602b0-592f-470c-82af-e2a4df840487-kube-api-access-zm2wb\") pod \"authorino-5d4b67c446-hq2bp\" (UID: \"109602b0-592f-470c-82af-e2a4df840487\") " pod="kuadrant-system/authorino-5d4b67c446-hq2bp"
Jul 15 21:07:21.813244 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:21.813213    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm2wb\" (UniqueName: \"kubernetes.io/projected/109602b0-592f-470c-82af-e2a4df840487-kube-api-access-zm2wb\") pod \"authorino-5d4b67c446-hq2bp\" (UID: \"109602b0-592f-470c-82af-e2a4df840487\") " pod="kuadrant-system/authorino-5d4b67c446-hq2bp"
Jul 15 21:07:21.816488 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:21.816464    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hq2bp"]
Jul 15 21:07:21.816632 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:07:21.816614    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-zm2wb], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-hq2bp" podUID="109602b0-592f-470c-82af-e2a4df840487"
Jul 15 21:07:21.821416 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:21.821399    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm2wb\" (UniqueName: \"kubernetes.io/projected/109602b0-592f-470c-82af-e2a4df840487-kube-api-access-zm2wb\") pod \"authorino-5d4b67c446-hq2bp\" (UID: \"109602b0-592f-470c-82af-e2a4df840487\") " pod="kuadrant-system/authorino-5d4b67c446-hq2bp"
Jul 15 21:07:21.924122 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:21.924096    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6fcd5bc95c-gczgr"]
Jul 15 21:07:21.927210 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:21.927195    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fcd5bc95c-gczgr"
Jul 15 21:07:21.929681 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:21.929665    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 15 21:07:21.936489 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:21.936458    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6fcd5bc95c-gczgr"]
Jul 15 21:07:22.014678 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:22.014651    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9mkh\" (UniqueName: \"kubernetes.io/projected/999badb6-cacc-4305-9dbd-f82f59d60335-kube-api-access-j9mkh\") pod \"authorino-6fcd5bc95c-gczgr\" (UID: \"999badb6-cacc-4305-9dbd-f82f59d60335\") " pod="kuadrant-system/authorino-6fcd5bc95c-gczgr"
Jul 15 21:07:22.014806 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:22.014716    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/999badb6-cacc-4305-9dbd-f82f59d60335-tls-cert\") pod \"authorino-6fcd5bc95c-gczgr\" (UID: \"999badb6-cacc-4305-9dbd-f82f59d60335\") " pod="kuadrant-system/authorino-6fcd5bc95c-gczgr"
Jul 15 21:07:22.115739 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:22.115716    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9mkh\" (UniqueName: \"kubernetes.io/projected/999badb6-cacc-4305-9dbd-f82f59d60335-kube-api-access-j9mkh\") pod \"authorino-6fcd5bc95c-gczgr\" (UID: \"999badb6-cacc-4305-9dbd-f82f59d60335\") " pod="kuadrant-system/authorino-6fcd5bc95c-gczgr"
Jul 15 21:07:22.115851 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:22.115793    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/999badb6-cacc-4305-9dbd-f82f59d60335-tls-cert\") pod \"authorino-6fcd5bc95c-gczgr\" (UID: \"999badb6-cacc-4305-9dbd-f82f59d60335\") " pod="kuadrant-system/authorino-6fcd5bc95c-gczgr"
Jul 15 21:07:22.118101 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:22.118078    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/999badb6-cacc-4305-9dbd-f82f59d60335-tls-cert\") pod \"authorino-6fcd5bc95c-gczgr\" (UID: \"999badb6-cacc-4305-9dbd-f82f59d60335\") " pod="kuadrant-system/authorino-6fcd5bc95c-gczgr"
Jul 15 21:07:22.124975 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:22.124952    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9mkh\" (UniqueName: \"kubernetes.io/projected/999badb6-cacc-4305-9dbd-f82f59d60335-kube-api-access-j9mkh\") pod \"authorino-6fcd5bc95c-gczgr\" (UID: \"999badb6-cacc-4305-9dbd-f82f59d60335\") " pod="kuadrant-system/authorino-6fcd5bc95c-gczgr"
Jul 15 21:07:22.236875 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:22.236790    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fcd5bc95c-gczgr"
Jul 15 21:07:22.367308 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:22.367277    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6fcd5bc95c-gczgr"]
Jul 15 21:07:22.370319 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:07:22.370290    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod999badb6_cacc_4305_9dbd_f82f59d60335.slice/crio-ae5ce1d8619132fb7fa416fbf51113bde33912b6f455c46ffb0c03cc7208be22 WatchSource:0}: Error finding container ae5ce1d8619132fb7fa416fbf51113bde33912b6f455c46ffb0c03cc7208be22: Status 404 returned error can't find the container with id ae5ce1d8619132fb7fa416fbf51113bde33912b6f455c46ffb0c03cc7208be22
Jul 15 21:07:22.435448 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:22.435421    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hq2bp"
Jul 15 21:07:22.435448 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:22.435428    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fcd5bc95c-gczgr" event={"ID":"999badb6-cacc-4305-9dbd-f82f59d60335","Type":"ContainerStarted","Data":"ae5ce1d8619132fb7fa416fbf51113bde33912b6f455c46ffb0c03cc7208be22"}
Jul 15 21:07:22.443492 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:22.443473    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hq2bp"
Jul 15 21:07:22.519081 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:22.519019    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zm2wb\" (UniqueName: \"kubernetes.io/projected/109602b0-592f-470c-82af-e2a4df840487-kube-api-access-zm2wb\") pod \"109602b0-592f-470c-82af-e2a4df840487\" (UID: \"109602b0-592f-470c-82af-e2a4df840487\") "
Jul 15 21:07:22.521077 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:22.521045    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/109602b0-592f-470c-82af-e2a4df840487-kube-api-access-zm2wb" (OuterVolumeSpecName: "kube-api-access-zm2wb") pod "109602b0-592f-470c-82af-e2a4df840487" (UID: "109602b0-592f-470c-82af-e2a4df840487"). InnerVolumeSpecName "kube-api-access-zm2wb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:07:22.619599 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:22.619575    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zm2wb\" (UniqueName: \"kubernetes.io/projected/109602b0-592f-470c-82af-e2a4df840487-kube-api-access-zm2wb\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:07:23.440186 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:23.440143    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fcd5bc95c-gczgr" event={"ID":"999badb6-cacc-4305-9dbd-f82f59d60335","Type":"ContainerStarted","Data":"580b74eba052c95a5ed618802f6bc32a492b7c424f333320c4304fdf0563baea"}
Jul 15 21:07:23.440370 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:23.440243    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hq2bp"
Jul 15 21:07:23.456738 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:23.456695    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6fcd5bc95c-gczgr" podStartSLOduration=2.111858238 podStartE2EDuration="2.456681558s" totalImagesPullingTime="344.82332ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:23.455889699 +0000 UTC m=+490.646569152" watchObservedRunningTime="2026-07-15 21:07:23.456681558 +0000 UTC m=+490.647360987"
Jul 15 21:07:23.480676 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:23.480646    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hq2bp"]
Jul 15 21:07:23.485630 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:23.485606    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gbjzv"]
Jul 15 21:07:23.485828 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:23.485800    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-gbjzv" podUID="b1067862-1ee7-49e5-91db-558309019649" containerName="authorino" containerID="cri-o://a4a38758a3a29f168ece404588467668ee35eefa12af31d502ccf2aca41bdfb3" gracePeriod=30
Jul 15 21:07:23.487126 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:23.487108    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hq2bp"]
Jul 15 21:07:23.576279 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:23.576243    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="109602b0-592f-470c-82af-e2a4df840487" path="/var/lib/kubelet/pods/109602b0-592f-470c-82af-e2a4df840487/volumes"
Jul 15 21:07:23.726498 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:23.726476    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gbjzv"
Jul 15 21:07:23.826741 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:23.826716    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d65jg\" (UniqueName: \"kubernetes.io/projected/b1067862-1ee7-49e5-91db-558309019649-kube-api-access-d65jg\") pod \"b1067862-1ee7-49e5-91db-558309019649\" (UID: \"b1067862-1ee7-49e5-91db-558309019649\") "
Jul 15 21:07:23.828636 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:23.828617    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1067862-1ee7-49e5-91db-558309019649-kube-api-access-d65jg" (OuterVolumeSpecName: "kube-api-access-d65jg") pod "b1067862-1ee7-49e5-91db-558309019649" (UID: "b1067862-1ee7-49e5-91db-558309019649"). InnerVolumeSpecName "kube-api-access-d65jg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:07:23.927320 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:23.927296    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d65jg\" (UniqueName: \"kubernetes.io/projected/b1067862-1ee7-49e5-91db-558309019649-kube-api-access-d65jg\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:07:24.444463 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:24.444431    2560 generic.go:356] "Generic (PLEG): container finished" podID="b1067862-1ee7-49e5-91db-558309019649" containerID="a4a38758a3a29f168ece404588467668ee35eefa12af31d502ccf2aca41bdfb3" exitCode=0
Jul 15 21:07:24.444612 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:24.444472    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-gbjzv"
Jul 15 21:07:24.444612 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:24.444513    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gbjzv" event={"ID":"b1067862-1ee7-49e5-91db-558309019649","Type":"ContainerDied","Data":"a4a38758a3a29f168ece404588467668ee35eefa12af31d502ccf2aca41bdfb3"}
Jul 15 21:07:24.444612 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:24.444550    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-gbjzv" event={"ID":"b1067862-1ee7-49e5-91db-558309019649","Type":"ContainerDied","Data":"90e91d763dd6283090b6427e8b12b68ee92d242047693981b13c2effc9ca02aa"}
Jul 15 21:07:24.444612 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:24.444567    2560 scope.go:117] "RemoveContainer" containerID="a4a38758a3a29f168ece404588467668ee35eefa12af31d502ccf2aca41bdfb3"
Jul 15 21:07:24.452557 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:24.452544    2560 scope.go:117] "RemoveContainer" containerID="a4a38758a3a29f168ece404588467668ee35eefa12af31d502ccf2aca41bdfb3"
Jul 15 21:07:24.452808 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:07:24.452788    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4a38758a3a29f168ece404588467668ee35eefa12af31d502ccf2aca41bdfb3\": container with ID starting with a4a38758a3a29f168ece404588467668ee35eefa12af31d502ccf2aca41bdfb3 not found: ID does not exist" containerID="a4a38758a3a29f168ece404588467668ee35eefa12af31d502ccf2aca41bdfb3"
Jul 15 21:07:24.452914 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:24.452815    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4a38758a3a29f168ece404588467668ee35eefa12af31d502ccf2aca41bdfb3"} err="failed to get container status \"a4a38758a3a29f168ece404588467668ee35eefa12af31d502ccf2aca41bdfb3\": rpc error: code = NotFound desc = could not find container \"a4a38758a3a29f168ece404588467668ee35eefa12af31d502ccf2aca41bdfb3\": container with ID starting with a4a38758a3a29f168ece404588467668ee35eefa12af31d502ccf2aca41bdfb3 not found: ID does not exist"
Jul 15 21:07:24.468432 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:24.468412    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gbjzv"]
Jul 15 21:07:24.473081 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:24.473062    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-gbjzv"]
Jul 15 21:07:25.573064 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:25.573023    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1067862-1ee7-49e5-91db-558309019649" path="/var/lib/kubelet/pods/b1067862-1ee7-49e5-91db-558309019649/volumes"
Jul 15 21:07:28.383305 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:28.383272    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59d5c68977-f4t9d"]
Jul 15 21:07:28.383917 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:28.383882    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1067862-1ee7-49e5-91db-558309019649" containerName="authorino"
Jul 15 21:07:28.384002 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:28.383921    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1067862-1ee7-49e5-91db-558309019649" containerName="authorino"
Jul 15 21:07:28.384215 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:28.384194    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1067862-1ee7-49e5-91db-558309019649" containerName="authorino"
Jul 15 21:07:28.390562 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:28.390540    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59d5c68977-f4t9d"
Jul 15 21:07:28.393322 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:28.393298    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 21:07:28.393443 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:28.393302    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 21:07:28.393443 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:28.393389    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pf5dc\""
Jul 15 21:07:28.398628 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:28.398604    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59d5c68977-f4t9d"]
Jul 15 21:07:28.454512 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:28.454487    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ce5503f-2225-478c-bbf8-7ef36ccfd7f9-webhook-cert\") pod \"maas-controller-59d5c68977-f4t9d\" (UID: \"2ce5503f-2225-478c-bbf8-7ef36ccfd7f9\") " pod="opendatahub/maas-controller-59d5c68977-f4t9d"
Jul 15 21:07:28.454668 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:28.454517    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhdj2\" (UniqueName: \"kubernetes.io/projected/2ce5503f-2225-478c-bbf8-7ef36ccfd7f9-kube-api-access-fhdj2\") pod \"maas-controller-59d5c68977-f4t9d\" (UID: \"2ce5503f-2225-478c-bbf8-7ef36ccfd7f9\") " pod="opendatahub/maas-controller-59d5c68977-f4t9d"
Jul 15 21:07:28.555070 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:28.555048    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ce5503f-2225-478c-bbf8-7ef36ccfd7f9-webhook-cert\") pod \"maas-controller-59d5c68977-f4t9d\" (UID: \"2ce5503f-2225-478c-bbf8-7ef36ccfd7f9\") " pod="opendatahub/maas-controller-59d5c68977-f4t9d"
Jul 15 21:07:28.555179 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:28.555084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhdj2\" (UniqueName: \"kubernetes.io/projected/2ce5503f-2225-478c-bbf8-7ef36ccfd7f9-kube-api-access-fhdj2\") pod \"maas-controller-59d5c68977-f4t9d\" (UID: \"2ce5503f-2225-478c-bbf8-7ef36ccfd7f9\") " pod="opendatahub/maas-controller-59d5c68977-f4t9d"
Jul 15 21:07:28.555223 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:07:28.555209    2560 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 15 21:07:28.555303 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:07:28.555291    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ce5503f-2225-478c-bbf8-7ef36ccfd7f9-webhook-cert podName:2ce5503f-2225-478c-bbf8-7ef36ccfd7f9 nodeName:}" failed. No retries permitted until 2026-07-15 21:07:29.05526951 +0000 UTC m=+496.245948923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/2ce5503f-2225-478c-bbf8-7ef36ccfd7f9-webhook-cert") pod "maas-controller-59d5c68977-f4t9d" (UID: "2ce5503f-2225-478c-bbf8-7ef36ccfd7f9") : secret "maas-controller-webhook-cert" not found
Jul 15 21:07:28.564037 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:28.564011    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhdj2\" (UniqueName: \"kubernetes.io/projected/2ce5503f-2225-478c-bbf8-7ef36ccfd7f9-kube-api-access-fhdj2\") pod \"maas-controller-59d5c68977-f4t9d\" (UID: \"2ce5503f-2225-478c-bbf8-7ef36ccfd7f9\") " pod="opendatahub/maas-controller-59d5c68977-f4t9d"
Jul 15 21:07:29.058959 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:29.058930    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ce5503f-2225-478c-bbf8-7ef36ccfd7f9-webhook-cert\") pod \"maas-controller-59d5c68977-f4t9d\" (UID: \"2ce5503f-2225-478c-bbf8-7ef36ccfd7f9\") " pod="opendatahub/maas-controller-59d5c68977-f4t9d"
Jul 15 21:07:29.061112 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:29.061087    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ce5503f-2225-478c-bbf8-7ef36ccfd7f9-webhook-cert\") pod \"maas-controller-59d5c68977-f4t9d\" (UID: \"2ce5503f-2225-478c-bbf8-7ef36ccfd7f9\") " pod="opendatahub/maas-controller-59d5c68977-f4t9d"
Jul 15 21:07:29.301453 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:29.301425    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59d5c68977-f4t9d"
Jul 15 21:07:29.470356 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:29.470327    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59d5c68977-f4t9d"]
Jul 15 21:07:29.473131 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:07:29.473104    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce5503f_2225_478c_bbf8_7ef36ccfd7f9.slice/crio-10e3110e59ee91be868c333e94e4eeca39bb4fa03af9117723daf8a9412fdadb WatchSource:0}: Error finding container 10e3110e59ee91be868c333e94e4eeca39bb4fa03af9117723daf8a9412fdadb: Status 404 returned error can't find the container with id 10e3110e59ee91be868c333e94e4eeca39bb4fa03af9117723daf8a9412fdadb
Jul 15 21:07:30.471282 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:30.471241    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59d5c68977-f4t9d" event={"ID":"2ce5503f-2225-478c-bbf8-7ef36ccfd7f9","Type":"ContainerStarted","Data":"10e3110e59ee91be868c333e94e4eeca39bb4fa03af9117723daf8a9412fdadb"}
Jul 15 21:07:32.480740 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:32.480705    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59d5c68977-f4t9d" event={"ID":"2ce5503f-2225-478c-bbf8-7ef36ccfd7f9","Type":"ContainerStarted","Data":"5af04f2c5483c7a7ca440c68a99930f367423984d08d8b9d6009f02248246280"}
Jul 15 21:07:32.481119 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:32.480794    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59d5c68977-f4t9d"
Jul 15 21:07:32.538604 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:32.538556    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59d5c68977-f4t9d" podStartSLOduration=2.227570739 podStartE2EDuration="4.538539684s" totalImagesPullingTime="2.310968945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:07:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:07:32.535845787 +0000 UTC m=+499.726525215" watchObservedRunningTime="2026-07-15 21:07:32.538539684 +0000 UTC m=+499.729219113"
Jul 15 21:07:43.486927 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:07:43.486890    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59d5c68977-f4t9d"
Jul 15 21:08:05.293885 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:05.293801    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-jhqbb"]
Jul 15 21:08:05.298861 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:05.298838    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jhqbb"
Jul 15 21:08:05.301603 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:05.301582    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 15 21:08:05.308550 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:05.308499    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-jhqbb"]
Jul 15 21:08:05.436057 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:05.436015    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9glz5\" (UniqueName: \"kubernetes.io/projected/bb571233-f893-4484-897d-74c294f8d514-kube-api-access-9glz5\") pod \"payload-pre-processing-74584bb9f8-jhqbb\" (UID: \"bb571233-f893-4484-897d-74c294f8d514\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jhqbb"
Jul 15 21:08:05.436220 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:05.436134    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb571233-f893-4484-897d-74c294f8d514-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-jhqbb\" (UID: \"bb571233-f893-4484-897d-74c294f8d514\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jhqbb"
Jul 15 21:08:05.537309 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:05.537278    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9glz5\" (UniqueName: \"kubernetes.io/projected/bb571233-f893-4484-897d-74c294f8d514-kube-api-access-9glz5\") pod \"payload-pre-processing-74584bb9f8-jhqbb\" (UID: \"bb571233-f893-4484-897d-74c294f8d514\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jhqbb"
Jul 15 21:08:05.537485 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:05.537326    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb571233-f893-4484-897d-74c294f8d514-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-jhqbb\" (UID: \"bb571233-f893-4484-897d-74c294f8d514\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jhqbb"
Jul 15 21:08:05.537995 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:05.537976    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb571233-f893-4484-897d-74c294f8d514-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-jhqbb\" (UID: \"bb571233-f893-4484-897d-74c294f8d514\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jhqbb"
Jul 15 21:08:05.549252 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:05.549188    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9glz5\" (UniqueName: \"kubernetes.io/projected/bb571233-f893-4484-897d-74c294f8d514-kube-api-access-9glz5\") pod \"payload-pre-processing-74584bb9f8-jhqbb\" (UID: \"bb571233-f893-4484-897d-74c294f8d514\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-jhqbb"
Jul 15 21:08:05.610145 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:05.610117    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jhqbb"
Jul 15 21:08:05.774217 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:05.774192    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-jhqbb"]
Jul 15 21:08:05.775903 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:08:05.775870    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb571233_f893_4484_897d_74c294f8d514.slice/crio-006906f37c239da63a1a8183d73d51ed9ab8b99043f08b59379c890df76028e5 WatchSource:0}: Error finding container 006906f37c239da63a1a8183d73d51ed9ab8b99043f08b59379c890df76028e5: Status 404 returned error can't find the container with id 006906f37c239da63a1a8183d73d51ed9ab8b99043f08b59379c890df76028e5
Jul 15 21:08:06.604360 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:06.604328    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jhqbb" event={"ID":"bb571233-f893-4484-897d-74c294f8d514","Type":"ContainerStarted","Data":"006906f37c239da63a1a8183d73d51ed9ab8b99043f08b59379c890df76028e5"}
Jul 15 21:08:07.609404 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:07.609369    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jhqbb" event={"ID":"bb571233-f893-4484-897d-74c294f8d514","Type":"ContainerStarted","Data":"ffb8e347df7bb3a2489864133c9ebf68bbeed9648da1e6512ef76365fa29cf0b"}
Jul 15 21:08:07.609806 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:07.609483    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jhqbb"
Jul 15 21:08:07.626567 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:07.626518    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jhqbb" podStartSLOduration=1.024716848 podStartE2EDuration="2.626504454s" totalImagesPullingTime="1.601787606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:08:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:08:07.625892986 +0000 UTC m=+534.816572417" watchObservedRunningTime="2026-07-15 21:08:07.626504454 +0000 UTC m=+534.817183883"
Jul 15 21:08:18.615374 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:18.615340    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-jhqbb"
Jul 15 21:08:31.403360 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.403328    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"]
Jul 15 21:08:31.407872 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.407850    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:31.411159 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.411134    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vqths\""
Jul 15 21:08:31.411274 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.411146    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 21:08:31.411274 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.411141    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 15 21:08:31.411429 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.411406    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 21:08:31.420047 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.420027    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"]
Jul 15 21:08:31.447415 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.447381    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/004b962b-264a-48b0-b221-f1752f08992a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn\" (UID: \"004b962b-264a-48b0-b221-f1752f08992a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:31.447415 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.447416    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/004b962b-264a-48b0-b221-f1752f08992a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn\" (UID: \"004b962b-264a-48b0-b221-f1752f08992a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:31.447582 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.447447    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/004b962b-264a-48b0-b221-f1752f08992a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn\" (UID: \"004b962b-264a-48b0-b221-f1752f08992a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:31.447582 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.447501    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/004b962b-264a-48b0-b221-f1752f08992a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn\" (UID: \"004b962b-264a-48b0-b221-f1752f08992a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:31.447582 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.447533    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rdh8\" (UniqueName: \"kubernetes.io/projected/004b962b-264a-48b0-b221-f1752f08992a-kube-api-access-7rdh8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn\" (UID: \"004b962b-264a-48b0-b221-f1752f08992a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:31.447582 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.447562    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/004b962b-264a-48b0-b221-f1752f08992a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn\" (UID: \"004b962b-264a-48b0-b221-f1752f08992a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:31.548525 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.548487    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/004b962b-264a-48b0-b221-f1752f08992a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn\" (UID: \"004b962b-264a-48b0-b221-f1752f08992a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:31.548693 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.548553    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/004b962b-264a-48b0-b221-f1752f08992a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn\" (UID: \"004b962b-264a-48b0-b221-f1752f08992a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:31.548693 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.548579    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/004b962b-264a-48b0-b221-f1752f08992a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn\" (UID: \"004b962b-264a-48b0-b221-f1752f08992a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:31.548693 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.548606    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/004b962b-264a-48b0-b221-f1752f08992a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn\" (UID: \"004b962b-264a-48b0-b221-f1752f08992a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:31.548693 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.548626    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/004b962b-264a-48b0-b221-f1752f08992a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn\" (UID: \"004b962b-264a-48b0-b221-f1752f08992a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:31.548693 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.548654    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rdh8\" (UniqueName: \"kubernetes.io/projected/004b962b-264a-48b0-b221-f1752f08992a-kube-api-access-7rdh8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn\" (UID: \"004b962b-264a-48b0-b221-f1752f08992a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:31.549074 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.549053    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/004b962b-264a-48b0-b221-f1752f08992a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn\" (UID: \"004b962b-264a-48b0-b221-f1752f08992a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:31.549133 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.549105    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/004b962b-264a-48b0-b221-f1752f08992a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn\" (UID: \"004b962b-264a-48b0-b221-f1752f08992a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:31.549168 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.549127    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/004b962b-264a-48b0-b221-f1752f08992a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn\" (UID: \"004b962b-264a-48b0-b221-f1752f08992a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:31.550879 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.550857    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/004b962b-264a-48b0-b221-f1752f08992a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn\" (UID: \"004b962b-264a-48b0-b221-f1752f08992a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:31.551071 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.551051    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/004b962b-264a-48b0-b221-f1752f08992a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn\" (UID: \"004b962b-264a-48b0-b221-f1752f08992a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:31.558080 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.558054    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rdh8\" (UniqueName: \"kubernetes.io/projected/004b962b-264a-48b0-b221-f1752f08992a-kube-api-access-7rdh8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn\" (UID: \"004b962b-264a-48b0-b221-f1752f08992a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:31.718231 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.718193    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:31.848716 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:31.848692    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"]
Jul 15 21:08:31.851238 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:08:31.851213    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod004b962b_264a_48b0_b221_f1752f08992a.slice/crio-78488d334e3a7758df74d40c8f7eb8ee6f6c4727fd074207aa1dc97385f2bb53 WatchSource:0}: Error finding container 78488d334e3a7758df74d40c8f7eb8ee6f6c4727fd074207aa1dc97385f2bb53: Status 404 returned error can't find the container with id 78488d334e3a7758df74d40c8f7eb8ee6f6c4727fd074207aa1dc97385f2bb53
Jul 15 21:08:32.699314 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:32.699276    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn" event={"ID":"004b962b-264a-48b0-b221-f1752f08992a","Type":"ContainerStarted","Data":"78488d334e3a7758df74d40c8f7eb8ee6f6c4727fd074207aa1dc97385f2bb53"}
Jul 15 21:08:33.704293 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:33.704258    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn" event={"ID":"004b962b-264a-48b0-b221-f1752f08992a","Type":"ContainerStarted","Data":"443cc3c36b48647d1b87b667ff90fd5a04dec5a9df7b111360af39b7ff00d9f6"}
Jul 15 21:08:33.723593 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:33.723543    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn" podStartSLOduration=1.629774716 podStartE2EDuration="2.723526925s" totalImagesPullingTime="1.093752209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:08:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:08:33.7225549 +0000 UTC m=+560.913234336" watchObservedRunningTime="2026-07-15 21:08:33.723526925 +0000 UTC m=+560.914206353"
Jul 15 21:08:41.279335 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.279301    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"]
Jul 15 21:08:41.281474 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.281454    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:41.283943 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.283924    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 15 21:08:41.292692 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.292670    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"]
Jul 15 21:08:41.323058 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.323034    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b62c8995-e5f2-405d-a6b5-47f1eb77f63e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pknx\" (UID: \"b62c8995-e5f2-405d-a6b5-47f1eb77f63e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:41.323160 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.323072    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b62c8995-e5f2-405d-a6b5-47f1eb77f63e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pknx\" (UID: \"b62c8995-e5f2-405d-a6b5-47f1eb77f63e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:41.323160 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.323099    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b62c8995-e5f2-405d-a6b5-47f1eb77f63e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pknx\" (UID: \"b62c8995-e5f2-405d-a6b5-47f1eb77f63e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:41.323160 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.323128    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b62c8995-e5f2-405d-a6b5-47f1eb77f63e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pknx\" (UID: \"b62c8995-e5f2-405d-a6b5-47f1eb77f63e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:41.323160 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.323148    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b62c8995-e5f2-405d-a6b5-47f1eb77f63e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pknx\" (UID: \"b62c8995-e5f2-405d-a6b5-47f1eb77f63e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:41.323287 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.323173    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtrdc\" (UniqueName: \"kubernetes.io/projected/b62c8995-e5f2-405d-a6b5-47f1eb77f63e-kube-api-access-gtrdc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pknx\" (UID: \"b62c8995-e5f2-405d-a6b5-47f1eb77f63e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:41.424177 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.424142    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b62c8995-e5f2-405d-a6b5-47f1eb77f63e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pknx\" (UID: \"b62c8995-e5f2-405d-a6b5-47f1eb77f63e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:41.424340 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.424195    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b62c8995-e5f2-405d-a6b5-47f1eb77f63e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pknx\" (UID: \"b62c8995-e5f2-405d-a6b5-47f1eb77f63e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:41.424340 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.424222    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b62c8995-e5f2-405d-a6b5-47f1eb77f63e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pknx\" (UID: \"b62c8995-e5f2-405d-a6b5-47f1eb77f63e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:41.424340 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.424241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b62c8995-e5f2-405d-a6b5-47f1eb77f63e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pknx\" (UID: \"b62c8995-e5f2-405d-a6b5-47f1eb77f63e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:41.424340 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.424260    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b62c8995-e5f2-405d-a6b5-47f1eb77f63e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pknx\" (UID: \"b62c8995-e5f2-405d-a6b5-47f1eb77f63e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:41.424340 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.424291    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtrdc\" (UniqueName: \"kubernetes.io/projected/b62c8995-e5f2-405d-a6b5-47f1eb77f63e-kube-api-access-gtrdc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pknx\" (UID: \"b62c8995-e5f2-405d-a6b5-47f1eb77f63e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:41.424715 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.424693    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b62c8995-e5f2-405d-a6b5-47f1eb77f63e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pknx\" (UID: \"b62c8995-e5f2-405d-a6b5-47f1eb77f63e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:41.424807 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.424734    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b62c8995-e5f2-405d-a6b5-47f1eb77f63e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pknx\" (UID: \"b62c8995-e5f2-405d-a6b5-47f1eb77f63e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:41.424870 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.424825    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b62c8995-e5f2-405d-a6b5-47f1eb77f63e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pknx\" (UID: \"b62c8995-e5f2-405d-a6b5-47f1eb77f63e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:41.426652 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.426628    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b62c8995-e5f2-405d-a6b5-47f1eb77f63e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pknx\" (UID: \"b62c8995-e5f2-405d-a6b5-47f1eb77f63e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:41.426735 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.426658    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b62c8995-e5f2-405d-a6b5-47f1eb77f63e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pknx\" (UID: \"b62c8995-e5f2-405d-a6b5-47f1eb77f63e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:41.435423 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.435396    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtrdc\" (UniqueName: \"kubernetes.io/projected/b62c8995-e5f2-405d-a6b5-47f1eb77f63e-kube-api-access-gtrdc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7pknx\" (UID: \"b62c8995-e5f2-405d-a6b5-47f1eb77f63e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:41.590699 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.590622    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:41.716764 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.716613    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"]
Jul 15 21:08:41.719024 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.718987    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:41.719296 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.719275    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:41.719550 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:08:41.719522    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb62c8995_e5f2_405d_a6b5_47f1eb77f63e.slice/crio-bf2a03eee65df7e377a3eb286422a049022035d85b213ac2292b7be2514afd5d WatchSource:0}: Error finding container bf2a03eee65df7e377a3eb286422a049022035d85b213ac2292b7be2514afd5d: Status 404 returned error can't find the container with id bf2a03eee65df7e377a3eb286422a049022035d85b213ac2292b7be2514afd5d
Jul 15 21:08:41.731723 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.731703    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:41.737081 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.737061    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx" event={"ID":"b62c8995-e5f2-405d-a6b5-47f1eb77f63e","Type":"ContainerStarted","Data":"bf2a03eee65df7e377a3eb286422a049022035d85b213ac2292b7be2514afd5d"}
Jul 15 21:08:41.748856 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:41.748838    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn"
Jul 15 21:08:42.743267 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:42.743234    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx" event={"ID":"b62c8995-e5f2-405d-a6b5-47f1eb77f63e","Type":"ContainerStarted","Data":"ddb2b128e4ae66513f9efdb2a5594ee5dba7f638371a659a439af4772e1104fd"}
Jul 15 21:08:42.765588 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:42.765546    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx" podStartSLOduration=1.483838986 podStartE2EDuration="1.765531095s" totalImagesPullingTime="281.692109ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:08:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:08:42.764749137 +0000 UTC m=+569.955428566" watchObservedRunningTime="2026-07-15 21:08:42.765531095 +0000 UTC m=+569.956210524"
Jul 15 21:08:51.591365 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:51.591335    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:51.591822 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:51.591383    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:51.603523 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:51.603503    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:08:51.791688 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:08:51.791659    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7pknx"
Jul 15 21:09:14.104985 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.104953    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"]
Jul 15 21:09:14.107641 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.107620    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:14.110995 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.110973    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 15 21:09:14.120593 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.120573    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"]
Jul 15 21:09:14.188129 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.188102    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24d50da1-ed0c-409b-b261-e07344c04e76-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxh2r\" (UID: \"24d50da1-ed0c-409b-b261-e07344c04e76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:14.188263 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.188139    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24d50da1-ed0c-409b-b261-e07344c04e76-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxh2r\" (UID: \"24d50da1-ed0c-409b-b261-e07344c04e76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:14.188263 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.188191    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmghr\" (UniqueName: \"kubernetes.io/projected/24d50da1-ed0c-409b-b261-e07344c04e76-kube-api-access-cmghr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxh2r\" (UID: \"24d50da1-ed0c-409b-b261-e07344c04e76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:14.188263 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.188237    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24d50da1-ed0c-409b-b261-e07344c04e76-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxh2r\" (UID: \"24d50da1-ed0c-409b-b261-e07344c04e76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:14.188263 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.188259    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24d50da1-ed0c-409b-b261-e07344c04e76-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxh2r\" (UID: \"24d50da1-ed0c-409b-b261-e07344c04e76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:14.188395 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.188276    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24d50da1-ed0c-409b-b261-e07344c04e76-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxh2r\" (UID: \"24d50da1-ed0c-409b-b261-e07344c04e76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:14.289373 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.289339    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24d50da1-ed0c-409b-b261-e07344c04e76-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxh2r\" (UID: \"24d50da1-ed0c-409b-b261-e07344c04e76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:14.289513 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.289458    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24d50da1-ed0c-409b-b261-e07344c04e76-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxh2r\" (UID: \"24d50da1-ed0c-409b-b261-e07344c04e76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:14.289513 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.289502    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmghr\" (UniqueName: \"kubernetes.io/projected/24d50da1-ed0c-409b-b261-e07344c04e76-kube-api-access-cmghr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxh2r\" (UID: \"24d50da1-ed0c-409b-b261-e07344c04e76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:14.289635 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.289529    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24d50da1-ed0c-409b-b261-e07344c04e76-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxh2r\" (UID: \"24d50da1-ed0c-409b-b261-e07344c04e76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:14.289635 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.289557    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24d50da1-ed0c-409b-b261-e07344c04e76-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxh2r\" (UID: \"24d50da1-ed0c-409b-b261-e07344c04e76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:14.289635 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.289583    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24d50da1-ed0c-409b-b261-e07344c04e76-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxh2r\" (UID: \"24d50da1-ed0c-409b-b261-e07344c04e76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:14.289807 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.289758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24d50da1-ed0c-409b-b261-e07344c04e76-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxh2r\" (UID: \"24d50da1-ed0c-409b-b261-e07344c04e76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:14.289860 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.289808    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24d50da1-ed0c-409b-b261-e07344c04e76-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxh2r\" (UID: \"24d50da1-ed0c-409b-b261-e07344c04e76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:14.289910 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.289894    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24d50da1-ed0c-409b-b261-e07344c04e76-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxh2r\" (UID: \"24d50da1-ed0c-409b-b261-e07344c04e76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:14.291783 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.291750    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24d50da1-ed0c-409b-b261-e07344c04e76-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxh2r\" (UID: \"24d50da1-ed0c-409b-b261-e07344c04e76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:14.292092 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.292074    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24d50da1-ed0c-409b-b261-e07344c04e76-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxh2r\" (UID: \"24d50da1-ed0c-409b-b261-e07344c04e76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:14.299573 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.299544    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmghr\" (UniqueName: \"kubernetes.io/projected/24d50da1-ed0c-409b-b261-e07344c04e76-kube-api-access-cmghr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jxh2r\" (UID: \"24d50da1-ed0c-409b-b261-e07344c04e76\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:14.417687 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.417666    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:14.547017 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.546932    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"]
Jul 15 21:09:14.549644 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:09:14.549617    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24d50da1_ed0c_409b_b261_e07344c04e76.slice/crio-e00b028577507fbc61191013e0c9db5571a69a3c58f6950f4959562b87e10e54 WatchSource:0}: Error finding container e00b028577507fbc61191013e0c9db5571a69a3c58f6950f4959562b87e10e54: Status 404 returned error can't find the container with id e00b028577507fbc61191013e0c9db5571a69a3c58f6950f4959562b87e10e54
Jul 15 21:09:14.866246 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.866215    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r" event={"ID":"24d50da1-ed0c-409b-b261-e07344c04e76","Type":"ContainerStarted","Data":"b913db70df9929f24b9e400302175b8931aac440665785d1f46ee7d5d9ef3a14"}
Jul 15 21:09:14.866375 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.866270    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r" event={"ID":"24d50da1-ed0c-409b-b261-e07344c04e76","Type":"ContainerStarted","Data":"e00b028577507fbc61191013e0c9db5571a69a3c58f6950f4959562b87e10e54"}
Jul 15 21:09:14.887560 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:14.887516    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r" podStartSLOduration=0.69189727 podStartE2EDuration="887.504067ms" totalImagesPullingTime="195.606797ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:09:14.88580301 +0000 UTC m=+602.076482433" watchObservedRunningTime="2026-07-15 21:09:14.887504067 +0000 UTC m=+602.078183495"
Jul 15 21:09:24.418381 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:24.418329    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:24.418381 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:24.418400    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:24.430821 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:24.430798    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:24.921836 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:24.921805    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jxh2r"
Jul 15 21:09:32.373923 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.373883    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"]
Jul 15 21:09:32.376845 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.376822    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:32.379440 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.379413    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 15 21:09:32.390073 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.390046    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"]
Jul 15 21:09:32.532015 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.531982    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f62c430f-607b-40df-b554-e90367cfd046-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4\" (UID: \"f62c430f-607b-40df-b554-e90367cfd046\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:32.532015 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.532017    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f62c430f-607b-40df-b554-e90367cfd046-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4\" (UID: \"f62c430f-607b-40df-b554-e90367cfd046\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:32.532206 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.532068    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znbqz\" (UniqueName: \"kubernetes.io/projected/f62c430f-607b-40df-b554-e90367cfd046-kube-api-access-znbqz\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4\" (UID: \"f62c430f-607b-40df-b554-e90367cfd046\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:32.532206 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.532100    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f62c430f-607b-40df-b554-e90367cfd046-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4\" (UID: \"f62c430f-607b-40df-b554-e90367cfd046\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:32.532206 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.532138    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f62c430f-607b-40df-b554-e90367cfd046-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4\" (UID: \"f62c430f-607b-40df-b554-e90367cfd046\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:32.532206 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.532157    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f62c430f-607b-40df-b554-e90367cfd046-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4\" (UID: \"f62c430f-607b-40df-b554-e90367cfd046\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:32.633522 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.633441    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f62c430f-607b-40df-b554-e90367cfd046-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4\" (UID: \"f62c430f-607b-40df-b554-e90367cfd046\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:32.633522 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.633500    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f62c430f-607b-40df-b554-e90367cfd046-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4\" (UID: \"f62c430f-607b-40df-b554-e90367cfd046\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:32.633712 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.633527    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f62c430f-607b-40df-b554-e90367cfd046-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4\" (UID: \"f62c430f-607b-40df-b554-e90367cfd046\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:32.633712 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.633584    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znbqz\" (UniqueName: \"kubernetes.io/projected/f62c430f-607b-40df-b554-e90367cfd046-kube-api-access-znbqz\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4\" (UID: \"f62c430f-607b-40df-b554-e90367cfd046\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:32.633712 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.633616    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f62c430f-607b-40df-b554-e90367cfd046-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4\" (UID: \"f62c430f-607b-40df-b554-e90367cfd046\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:32.633712 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.633690    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f62c430f-607b-40df-b554-e90367cfd046-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4\" (UID: \"f62c430f-607b-40df-b554-e90367cfd046\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:32.633957 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.633907    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f62c430f-607b-40df-b554-e90367cfd046-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4\" (UID: \"f62c430f-607b-40df-b554-e90367cfd046\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:32.634028 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.633983    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f62c430f-607b-40df-b554-e90367cfd046-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4\" (UID: \"f62c430f-607b-40df-b554-e90367cfd046\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:32.634195 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.634173    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f62c430f-607b-40df-b554-e90367cfd046-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4\" (UID: \"f62c430f-607b-40df-b554-e90367cfd046\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:32.635756 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.635734    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f62c430f-607b-40df-b554-e90367cfd046-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4\" (UID: \"f62c430f-607b-40df-b554-e90367cfd046\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:32.636069 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.636053    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f62c430f-607b-40df-b554-e90367cfd046-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4\" (UID: \"f62c430f-607b-40df-b554-e90367cfd046\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:32.643351 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.643328    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znbqz\" (UniqueName: \"kubernetes.io/projected/f62c430f-607b-40df-b554-e90367cfd046-kube-api-access-znbqz\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4\" (UID: \"f62c430f-607b-40df-b554-e90367cfd046\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:32.687067 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.687040    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:32.817458 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.817435    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"]
Jul 15 21:09:32.819015 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:09:32.818983    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf62c430f_607b_40df_b554_e90367cfd046.slice/crio-41cf971e8bdc76a19c52e846f206bfb28d1a9465772e787900f4c6be16a716d5 WatchSource:0}: Error finding container 41cf971e8bdc76a19c52e846f206bfb28d1a9465772e787900f4c6be16a716d5: Status 404 returned error can't find the container with id 41cf971e8bdc76a19c52e846f206bfb28d1a9465772e787900f4c6be16a716d5
Jul 15 21:09:32.820331 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.820313    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 21:09:32.941366 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:32.941334    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4" event={"ID":"f62c430f-607b-40df-b554-e90367cfd046","Type":"ContainerStarted","Data":"41cf971e8bdc76a19c52e846f206bfb28d1a9465772e787900f4c6be16a716d5"}
Jul 15 21:09:33.946527 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:33.946444    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4" event={"ID":"f62c430f-607b-40df-b554-e90367cfd046","Type":"ContainerStarted","Data":"36ae8b102f643b86815b753e83baf73fe78090f45b99c76209e9f8db0f157ab4"}
Jul 15 21:09:33.965444 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:33.965399    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4" podStartSLOduration=1.7752066389999999 podStartE2EDuration="1.965383486s" totalImagesPullingTime="190.176847ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:09:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:09:33.96459114 +0000 UTC m=+621.155270568" watchObservedRunningTime="2026-07-15 21:09:33.965383486 +0000 UTC m=+621.156062915"
Jul 15 21:09:42.687874 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:42.687830    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:42.687874 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:42.687880    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:42.700261 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:42.700233    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:09:42.992657 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:09:42.992585    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4"
Jul 15 21:10:13.910387 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:13.910358    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7db467bbbd-rh56n"]
Jul 15 21:10:13.913434 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:13.913418    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7db467bbbd-rh56n"
Jul 15 21:10:13.922558 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:13.922537    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7db467bbbd-rh56n"]
Jul 15 21:10:14.070701 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:14.070673    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndld6\" (UniqueName: \"kubernetes.io/projected/dd1db2ee-8394-4e5c-a9ce-3d742d9a44fe-kube-api-access-ndld6\") pod \"authorino-7db467bbbd-rh56n\" (UID: \"dd1db2ee-8394-4e5c-a9ce-3d742d9a44fe\") " pod="kuadrant-system/authorino-7db467bbbd-rh56n"
Jul 15 21:10:14.070822 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:14.070707    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd1db2ee-8394-4e5c-a9ce-3d742d9a44fe-tls-cert\") pod \"authorino-7db467bbbd-rh56n\" (UID: \"dd1db2ee-8394-4e5c-a9ce-3d742d9a44fe\") " pod="kuadrant-system/authorino-7db467bbbd-rh56n"
Jul 15 21:10:14.172056 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:14.171993    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndld6\" (UniqueName: \"kubernetes.io/projected/dd1db2ee-8394-4e5c-a9ce-3d742d9a44fe-kube-api-access-ndld6\") pod \"authorino-7db467bbbd-rh56n\" (UID: \"dd1db2ee-8394-4e5c-a9ce-3d742d9a44fe\") " pod="kuadrant-system/authorino-7db467bbbd-rh56n"
Jul 15 21:10:14.172056 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:14.172025    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd1db2ee-8394-4e5c-a9ce-3d742d9a44fe-tls-cert\") pod \"authorino-7db467bbbd-rh56n\" (UID: \"dd1db2ee-8394-4e5c-a9ce-3d742d9a44fe\") " pod="kuadrant-system/authorino-7db467bbbd-rh56n"
Jul 15 21:10:14.174672 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:14.174650    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd1db2ee-8394-4e5c-a9ce-3d742d9a44fe-tls-cert\") pod \"authorino-7db467bbbd-rh56n\" (UID: \"dd1db2ee-8394-4e5c-a9ce-3d742d9a44fe\") " pod="kuadrant-system/authorino-7db467bbbd-rh56n"
Jul 15 21:10:14.181139 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:14.181119    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndld6\" (UniqueName: \"kubernetes.io/projected/dd1db2ee-8394-4e5c-a9ce-3d742d9a44fe-kube-api-access-ndld6\") pod \"authorino-7db467bbbd-rh56n\" (UID: \"dd1db2ee-8394-4e5c-a9ce-3d742d9a44fe\") " pod="kuadrant-system/authorino-7db467bbbd-rh56n"
Jul 15 21:10:14.221614 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:14.221591    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7db467bbbd-rh56n"
Jul 15 21:10:14.371275 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:14.371211    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7db467bbbd-rh56n"]
Jul 15 21:10:14.373704 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:10:14.373672    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd1db2ee_8394_4e5c_a9ce_3d742d9a44fe.slice/crio-ffe70f2f06d1911f0c57062769f4111c14db4c02548fa6970dc38f96109afa37 WatchSource:0}: Error finding container ffe70f2f06d1911f0c57062769f4111c14db4c02548fa6970dc38f96109afa37: Status 404 returned error can't find the container with id ffe70f2f06d1911f0c57062769f4111c14db4c02548fa6970dc38f96109afa37
Jul 15 21:10:15.113064 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:15.113032    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7db467bbbd-rh56n" event={"ID":"dd1db2ee-8394-4e5c-a9ce-3d742d9a44fe","Type":"ContainerStarted","Data":"ffe70f2f06d1911f0c57062769f4111c14db4c02548fa6970dc38f96109afa37"}
Jul 15 21:10:16.122651 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:16.121889    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7db467bbbd-rh56n" event={"ID":"dd1db2ee-8394-4e5c-a9ce-3d742d9a44fe","Type":"ContainerStarted","Data":"3acd650123263fe5638c75a9d3f21e73ce429e2c570c874f7e63681f699f414f"}
Jul 15 21:10:16.195941 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:16.195873    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7db467bbbd-rh56n" podStartSLOduration=2.5323416 podStartE2EDuration="3.195849763s" totalImagesPullingTime="663.508163ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:16.151204675 +0000 UTC m=+663.341884104" watchObservedRunningTime="2026-07-15 21:10:16.195849763 +0000 UTC m=+663.386529190"
Jul 15 21:10:16.196419 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:16.196400    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6fcd5bc95c-gczgr"]
Jul 15 21:10:16.196600 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:16.196573    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6fcd5bc95c-gczgr" podUID="999badb6-cacc-4305-9dbd-f82f59d60335" containerName="authorino" containerID="cri-o://580b74eba052c95a5ed618802f6bc32a492b7c424f333320c4304fdf0563baea" gracePeriod=30
Jul 15 21:10:16.450654 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:16.450630    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fcd5bc95c-gczgr"
Jul 15 21:10:16.599921 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:16.599888    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/999badb6-cacc-4305-9dbd-f82f59d60335-tls-cert\") pod \"999badb6-cacc-4305-9dbd-f82f59d60335\" (UID: \"999badb6-cacc-4305-9dbd-f82f59d60335\") "
Jul 15 21:10:16.600074 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:16.599943    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9mkh\" (UniqueName: \"kubernetes.io/projected/999badb6-cacc-4305-9dbd-f82f59d60335-kube-api-access-j9mkh\") pod \"999badb6-cacc-4305-9dbd-f82f59d60335\" (UID: \"999badb6-cacc-4305-9dbd-f82f59d60335\") "
Jul 15 21:10:16.601910 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:16.601871    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/999badb6-cacc-4305-9dbd-f82f59d60335-kube-api-access-j9mkh" (OuterVolumeSpecName: "kube-api-access-j9mkh") pod "999badb6-cacc-4305-9dbd-f82f59d60335" (UID: "999badb6-cacc-4305-9dbd-f82f59d60335"). InnerVolumeSpecName "kube-api-access-j9mkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:10:16.608886 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:16.608862    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/999badb6-cacc-4305-9dbd-f82f59d60335-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "999badb6-cacc-4305-9dbd-f82f59d60335" (UID: "999badb6-cacc-4305-9dbd-f82f59d60335"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:10:16.701154 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:16.701079    2560 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/999badb6-cacc-4305-9dbd-f82f59d60335-tls-cert\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:10:16.701154 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:16.701108    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9mkh\" (UniqueName: \"kubernetes.io/projected/999badb6-cacc-4305-9dbd-f82f59d60335-kube-api-access-j9mkh\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:10:17.127636 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:17.127554    2560 generic.go:356] "Generic (PLEG): container finished" podID="999badb6-cacc-4305-9dbd-f82f59d60335" containerID="580b74eba052c95a5ed618802f6bc32a492b7c424f333320c4304fdf0563baea" exitCode=0
Jul 15 21:10:17.127636 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:17.127597    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fcd5bc95c-gczgr"
Jul 15 21:10:17.127636 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:17.127628    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fcd5bc95c-gczgr" event={"ID":"999badb6-cacc-4305-9dbd-f82f59d60335","Type":"ContainerDied","Data":"580b74eba052c95a5ed618802f6bc32a492b7c424f333320c4304fdf0563baea"}
Jul 15 21:10:17.128160 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:17.127659    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fcd5bc95c-gczgr" event={"ID":"999badb6-cacc-4305-9dbd-f82f59d60335","Type":"ContainerDied","Data":"ae5ce1d8619132fb7fa416fbf51113bde33912b6f455c46ffb0c03cc7208be22"}
Jul 15 21:10:17.128160 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:17.127680    2560 scope.go:117] "RemoveContainer" containerID="580b74eba052c95a5ed618802f6bc32a492b7c424f333320c4304fdf0563baea"
Jul 15 21:10:17.136925 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:17.136904    2560 scope.go:117] "RemoveContainer" containerID="580b74eba052c95a5ed618802f6bc32a492b7c424f333320c4304fdf0563baea"
Jul 15 21:10:17.137195 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:10:17.137178    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"580b74eba052c95a5ed618802f6bc32a492b7c424f333320c4304fdf0563baea\": container with ID starting with 580b74eba052c95a5ed618802f6bc32a492b7c424f333320c4304fdf0563baea not found: ID does not exist" containerID="580b74eba052c95a5ed618802f6bc32a492b7c424f333320c4304fdf0563baea"
Jul 15 21:10:17.137265 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:17.137203    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"580b74eba052c95a5ed618802f6bc32a492b7c424f333320c4304fdf0563baea"} err="failed to get container status \"580b74eba052c95a5ed618802f6bc32a492b7c424f333320c4304fdf0563baea\": rpc error: code = NotFound desc = could not find container \"580b74eba052c95a5ed618802f6bc32a492b7c424f333320c4304fdf0563baea\": container with ID starting with 580b74eba052c95a5ed618802f6bc32a492b7c424f333320c4304fdf0563baea not found: ID does not exist"
Jul 15 21:10:17.162106 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:17.162082    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6fcd5bc95c-gczgr"]
Jul 15 21:10:17.167758 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:17.167737    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6fcd5bc95c-gczgr"]
Jul 15 21:10:17.573435 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:10:17.573404    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="999badb6-cacc-4305-9dbd-f82f59d60335" path="/var/lib/kubelet/pods/999badb6-cacc-4305-9dbd-f82f59d60335/volumes"
Jul 15 21:11:25.754614 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:11:25.754581    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59d5c68977-f4t9d"]
Jul 15 21:11:25.755143 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:11:25.754789    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-59d5c68977-f4t9d" podUID="2ce5503f-2225-478c-bbf8-7ef36ccfd7f9" containerName="manager" containerID="cri-o://5af04f2c5483c7a7ca440c68a99930f367423984d08d8b9d6009f02248246280" gracePeriod=30
Jul 15 21:11:25.995094 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:11:25.995071    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59d5c68977-f4t9d"
Jul 15 21:11:26.037722 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:11:26.037667    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ce5503f-2225-478c-bbf8-7ef36ccfd7f9-webhook-cert\") pod \"2ce5503f-2225-478c-bbf8-7ef36ccfd7f9\" (UID: \"2ce5503f-2225-478c-bbf8-7ef36ccfd7f9\") "
Jul 15 21:11:26.037722 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:11:26.037712    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhdj2\" (UniqueName: \"kubernetes.io/projected/2ce5503f-2225-478c-bbf8-7ef36ccfd7f9-kube-api-access-fhdj2\") pod \"2ce5503f-2225-478c-bbf8-7ef36ccfd7f9\" (UID: \"2ce5503f-2225-478c-bbf8-7ef36ccfd7f9\") "
Jul 15 21:11:26.039799 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:11:26.039760    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ce5503f-2225-478c-bbf8-7ef36ccfd7f9-kube-api-access-fhdj2" (OuterVolumeSpecName: "kube-api-access-fhdj2") pod "2ce5503f-2225-478c-bbf8-7ef36ccfd7f9" (UID: "2ce5503f-2225-478c-bbf8-7ef36ccfd7f9"). InnerVolumeSpecName "kube-api-access-fhdj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:11:26.039894 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:11:26.039884    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ce5503f-2225-478c-bbf8-7ef36ccfd7f9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2ce5503f-2225-478c-bbf8-7ef36ccfd7f9" (UID: "2ce5503f-2225-478c-bbf8-7ef36ccfd7f9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:11:26.139061 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:11:26.139015    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ce5503f-2225-478c-bbf8-7ef36ccfd7f9-webhook-cert\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:11:26.139061 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:11:26.139054    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhdj2\" (UniqueName: \"kubernetes.io/projected/2ce5503f-2225-478c-bbf8-7ef36ccfd7f9-kube-api-access-fhdj2\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:11:26.429057 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:11:26.429019    2560 generic.go:356] "Generic (PLEG): container finished" podID="2ce5503f-2225-478c-bbf8-7ef36ccfd7f9" containerID="5af04f2c5483c7a7ca440c68a99930f367423984d08d8b9d6009f02248246280" exitCode=0
Jul 15 21:11:26.429209 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:11:26.429066    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59d5c68977-f4t9d"
Jul 15 21:11:26.429209 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:11:26.429106    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59d5c68977-f4t9d" event={"ID":"2ce5503f-2225-478c-bbf8-7ef36ccfd7f9","Type":"ContainerDied","Data":"5af04f2c5483c7a7ca440c68a99930f367423984d08d8b9d6009f02248246280"}
Jul 15 21:11:26.429209 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:11:26.429164    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59d5c68977-f4t9d" event={"ID":"2ce5503f-2225-478c-bbf8-7ef36ccfd7f9","Type":"ContainerDied","Data":"10e3110e59ee91be868c333e94e4eeca39bb4fa03af9117723daf8a9412fdadb"}
Jul 15 21:11:26.429209 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:11:26.429193    2560 scope.go:117] "RemoveContainer" containerID="5af04f2c5483c7a7ca440c68a99930f367423984d08d8b9d6009f02248246280"
Jul 15 21:11:26.437890 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:11:26.437872    2560 scope.go:117] "RemoveContainer" containerID="5af04f2c5483c7a7ca440c68a99930f367423984d08d8b9d6009f02248246280"
Jul 15 21:11:26.438145 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:11:26.438124    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5af04f2c5483c7a7ca440c68a99930f367423984d08d8b9d6009f02248246280\": container with ID starting with 5af04f2c5483c7a7ca440c68a99930f367423984d08d8b9d6009f02248246280 not found: ID does not exist" containerID="5af04f2c5483c7a7ca440c68a99930f367423984d08d8b9d6009f02248246280"
Jul 15 21:11:26.438190 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:11:26.438154    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5af04f2c5483c7a7ca440c68a99930f367423984d08d8b9d6009f02248246280"} err="failed to get container status \"5af04f2c5483c7a7ca440c68a99930f367423984d08d8b9d6009f02248246280\": rpc error: code = NotFound desc = could not find container \"5af04f2c5483c7a7ca440c68a99930f367423984d08d8b9d6009f02248246280\": container with ID starting with 5af04f2c5483c7a7ca440c68a99930f367423984d08d8b9d6009f02248246280 not found: ID does not exist"
Jul 15 21:11:26.450808 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:11:26.450761    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59d5c68977-f4t9d"]
Jul 15 21:11:26.455441 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:11:26.455421    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-59d5c68977-f4t9d"]
Jul 15 21:11:27.574019 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:11:27.573981    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ce5503f-2225-478c-bbf8-7ef36ccfd7f9" path="/var/lib/kubelet/pods/2ce5503f-2225-478c-bbf8-7ef36ccfd7f9/volumes"
Jul 15 21:32:23.884599 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:23.884560    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"]
Jul 15 21:32:23.885160 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:23.885014    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ce5503f-2225-478c-bbf8-7ef36ccfd7f9" containerName="manager"
Jul 15 21:32:23.885160 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:23.885031    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ce5503f-2225-478c-bbf8-7ef36ccfd7f9" containerName="manager"
Jul 15 21:32:23.885160 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:23.885053    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="999badb6-cacc-4305-9dbd-f82f59d60335" containerName="authorino"
Jul 15 21:32:23.885160 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:23.885063    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="999badb6-cacc-4305-9dbd-f82f59d60335" containerName="authorino"
Jul 15 21:32:23.885160 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:23.885151    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="999badb6-cacc-4305-9dbd-f82f59d60335" containerName="authorino"
Jul 15 21:32:23.885160 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:23.885163    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ce5503f-2225-478c-bbf8-7ef36ccfd7f9" containerName="manager"
Jul 15 21:32:23.888363 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:23.888343    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:23.891093 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:23.891069    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-372e1c00\"/\"openshift-service-ca.crt\""
Jul 15 21:32:23.891738 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:23.891705    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-372e1c00\"/\"e2e-lifecycle-model-372e1c00-kserve-self-signed-certs\""
Jul 15 21:32:23.891738 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:23.891736    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-372e1c00\"/\"default-dockercfg-bp4zk\""
Jul 15 21:32:23.892017 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:23.891998    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-372e1c00\"/\"kube-root-ca.crt\""
Jul 15 21:32:23.900038 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:23.900014    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"]
Jul 15 21:32:24.050271 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.050245    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-home\") pod \"e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") " pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:24.050400 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.050280    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-dshm\") pod \"e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") " pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:24.050400 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.050319    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-model-cache\") pod \"e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") " pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:24.050400 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.050371    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98jnd\" (UniqueName: \"kubernetes.io/projected/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-kube-api-access-98jnd\") pod \"e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") " pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:24.050508 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.050431    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-tmp-dir\") pod \"e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") " pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:24.050508 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.050457    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-tls-certs\") pod \"e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") " pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:24.150873 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.150813    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-dshm\") pod \"e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") " pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:24.150873 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.150853    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-model-cache\") pod \"e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") " pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:24.151009 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.150879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98jnd\" (UniqueName: \"kubernetes.io/projected/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-kube-api-access-98jnd\") pod \"e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") " pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:24.151009 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.150922    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-tmp-dir\") pod \"e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") " pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:24.151009 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.150955    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-tls-certs\") pod \"e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") " pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:24.151009 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.150995    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-home\") pod \"e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") " pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:24.151291 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.151268    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-model-cache\") pod \"e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") " pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:24.151343 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.151297    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-tmp-dir\") pod \"e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") " pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:24.151402 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.151352    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-home\") pod \"e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") " pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:24.153250 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.153230    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-dshm\") pod \"e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") " pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:24.153494 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.153477    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-tls-certs\") pod \"e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") " pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:24.159830 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.159811    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98jnd\" (UniqueName: \"kubernetes.io/projected/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-kube-api-access-98jnd\") pod \"e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") " pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:24.200353 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.200327    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:24.326304 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.326275    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"]
Jul 15 21:32:24.329660 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:32:24.329633    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb64b4e06_bfc9_4b3d_9d67_cde5f8a5241f.slice/crio-1a6b6341ffa16c1d711468bc95cf78c2acfc5be7a5dcc27cfb7dbbf370017ff8 WatchSource:0}: Error finding container 1a6b6341ffa16c1d711468bc95cf78c2acfc5be7a5dcc27cfb7dbbf370017ff8: Status 404 returned error can't find the container with id 1a6b6341ffa16c1d711468bc95cf78c2acfc5be7a5dcc27cfb7dbbf370017ff8
Jul 15 21:32:24.486470 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.486435    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr" event={"ID":"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f","Type":"ContainerStarted","Data":"f472b759edef193d7accf6c44e145e3289ac36edf7f98f7db884c0a962db1dc3"}
Jul 15 21:32:24.486470 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.486475    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr" event={"ID":"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f","Type":"ContainerStarted","Data":"1a6b6341ffa16c1d711468bc95cf78c2acfc5be7a5dcc27cfb7dbbf370017ff8"}
Jul 15 21:32:24.507941 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:24.507893    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr" podStartSLOduration=1.5078803060000001 podStartE2EDuration="1.507880306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:32:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:32:24.506631991 +0000 UTC m=+1991.697311419" watchObservedRunningTime="2026-07-15 21:32:24.507880306 +0000 UTC m=+1991.698559777"
Jul 15 21:32:34.200587 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:34.200549    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:34.201037 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:34.200636    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:34.212968 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:34.212945    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:32:34.538024 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:32:34.537935    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:33:16.177278 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:16.177230    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"]
Jul 15 21:33:31.197577 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.197513    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr" podUID="b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f" containerName="main" containerID="cri-o://f472b759edef193d7accf6c44e145e3289ac36edf7f98f7db884c0a962db1dc3" gracePeriod=45
Jul 15 21:33:31.431752 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.431729    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:33:31.540739 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.540669    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-model-cache\") pod \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") "
Jul 15 21:33:31.540739 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.540699    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-tmp-dir\") pod \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") "
Jul 15 21:33:31.540972 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.540786    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-home\") pod \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") "
Jul 15 21:33:31.540972 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.540822    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98jnd\" (UniqueName: \"kubernetes.io/projected/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-kube-api-access-98jnd\") pod \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") "
Jul 15 21:33:31.540972 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.540876    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-dshm\") pod \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") "
Jul 15 21:33:31.540972 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.540908    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-tls-certs\") pod \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\" (UID: \"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f\") "
Jul 15 21:33:31.540972 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.540937    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-model-cache" (OuterVolumeSpecName: "model-cache") pod "b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f" (UID: "b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:33:31.541256 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.541053    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f" (UID: "b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:33:31.541256 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.541066    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-home" (OuterVolumeSpecName: "home") pod "b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f" (UID: "b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:33:31.541256 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.541176    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-model-cache\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:33:31.541256 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.541196    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-tmp-dir\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:33:31.541256 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.541209    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-home\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:33:31.543109 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.543077    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f" (UID: "b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:33:31.543109 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.543093    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-dshm" (OuterVolumeSpecName: "dshm") pod "b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f" (UID: "b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:33:31.543229 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.543135    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-kube-api-access-98jnd" (OuterVolumeSpecName: "kube-api-access-98jnd") pod "b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f" (UID: "b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f"). InnerVolumeSpecName "kube-api-access-98jnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:33:31.642581 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.642554    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98jnd\" (UniqueName: \"kubernetes.io/projected/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-kube-api-access-98jnd\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:33:31.642700 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.642588    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-dshm\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:33:31.642700 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.642597    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f-tls-certs\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:33:31.762086 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.762050    2560 generic.go:356] "Generic (PLEG): container finished" podID="b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f" containerID="f472b759edef193d7accf6c44e145e3289ac36edf7f98f7db884c0a962db1dc3" exitCode=0
Jul 15 21:33:31.762232 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.762092    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"
Jul 15 21:33:31.762232 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.762096    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr" event={"ID":"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f","Type":"ContainerDied","Data":"f472b759edef193d7accf6c44e145e3289ac36edf7f98f7db884c0a962db1dc3"}
Jul 15 21:33:31.762232 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.762189    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr" event={"ID":"b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f","Type":"ContainerDied","Data":"1a6b6341ffa16c1d711468bc95cf78c2acfc5be7a5dcc27cfb7dbbf370017ff8"}
Jul 15 21:33:31.762232 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.762207    2560 scope.go:117] "RemoveContainer" containerID="f472b759edef193d7accf6c44e145e3289ac36edf7f98f7db884c0a962db1dc3"
Jul 15 21:33:31.770539 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.770524    2560 scope.go:117] "RemoveContainer" containerID="f472b759edef193d7accf6c44e145e3289ac36edf7f98f7db884c0a962db1dc3"
Jul 15 21:33:31.770785 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:33:31.770749    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f472b759edef193d7accf6c44e145e3289ac36edf7f98f7db884c0a962db1dc3\": container with ID starting with f472b759edef193d7accf6c44e145e3289ac36edf7f98f7db884c0a962db1dc3 not found: ID does not exist" containerID="f472b759edef193d7accf6c44e145e3289ac36edf7f98f7db884c0a962db1dc3"
Jul 15 21:33:31.770842 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.770792    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f472b759edef193d7accf6c44e145e3289ac36edf7f98f7db884c0a962db1dc3"} err="failed to get container status \"f472b759edef193d7accf6c44e145e3289ac36edf7f98f7db884c0a962db1dc3\": rpc error: code = NotFound desc = could not find container \"f472b759edef193d7accf6c44e145e3289ac36edf7f98f7db884c0a962db1dc3\": container with ID starting with f472b759edef193d7accf6c44e145e3289ac36edf7f98f7db884c0a962db1dc3 not found: ID does not exist"
Jul 15 21:33:31.777811 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.777790    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"]
Jul 15 21:33:31.779925 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:31.779908    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-372e1c00/e2e-lifecycle-model-372e1c00-kserve-5cff746479-nqcmr"]
Jul 15 21:33:33.576381 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:33:33.576344    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f" path="/var/lib/kubelet/pods/b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f/volumes"
Jul 15 21:35:33.983514 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:33.983475    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"]
Jul 15 21:35:33.983972 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:33.983792    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f" containerName="main"
Jul 15 21:35:33.983972 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:33.983804    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f" containerName="main"
Jul 15 21:35:33.983972 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:33.983869    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b64b4e06-bfc9-4b3d-9d67-cde5f8a5241f" containerName="main"
Jul 15 21:35:33.986662 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:33.986646    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:33.989071 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:33.989047    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-945d24\"/\"openshift-service-ca.crt\""
Jul 15 21:35:33.990079 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:33.990058    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-945d24\"/\"kube-root-ca.crt\""
Jul 15 21:35:33.990185 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:33.990064    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-945d24\"/\"test-model-945d24-kserve-self-signed-certs\""
Jul 15 21:35:33.990185 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:33.990092    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-945d24\"/\"default-dockercfg-dgf47\""
Jul 15 21:35:33.998292 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:33.998268    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"]
Jul 15 21:35:34.115369 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:34.115324    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-home\") pod \"test-model-945d24-kserve-c9689f9df-mv2gz\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") " pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:34.115369 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:34.115372    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-model-cache\") pod \"test-model-945d24-kserve-c9689f9df-mv2gz\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") " pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:34.115587 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:34.115441    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xh5c\" (UniqueName: \"kubernetes.io/projected/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-kube-api-access-7xh5c\") pod \"test-model-945d24-kserve-c9689f9df-mv2gz\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") " pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:34.115587 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:34.115504    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-dshm\") pod \"test-model-945d24-kserve-c9689f9df-mv2gz\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") " pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:34.115587 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:34.115544    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-tmp-dir\") pod \"test-model-945d24-kserve-c9689f9df-mv2gz\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") " pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:34.115587 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:34.115566    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-tls-certs\") pod \"test-model-945d24-kserve-c9689f9df-mv2gz\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") " pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:34.216705 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:34.216664    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-dshm\") pod \"test-model-945d24-kserve-c9689f9df-mv2gz\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") " pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:34.216912 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:34.216722    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-tmp-dir\") pod \"test-model-945d24-kserve-c9689f9df-mv2gz\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") " pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:34.216912 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:34.216745    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-tls-certs\") pod \"test-model-945d24-kserve-c9689f9df-mv2gz\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") " pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:34.216912 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:34.216801    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-home\") pod \"test-model-945d24-kserve-c9689f9df-mv2gz\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") " pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:34.216912 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:34.216892    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-model-cache\") pod \"test-model-945d24-kserve-c9689f9df-mv2gz\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") " pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:34.217127 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:34.216953    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xh5c\" (UniqueName: \"kubernetes.io/projected/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-kube-api-access-7xh5c\") pod \"test-model-945d24-kserve-c9689f9df-mv2gz\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") " pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:34.217310 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:34.217285    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-tmp-dir\") pod \"test-model-945d24-kserve-c9689f9df-mv2gz\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") " pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:34.217393 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:34.217319    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-model-cache\") pod \"test-model-945d24-kserve-c9689f9df-mv2gz\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") " pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:34.217393 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:34.217342    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-home\") pod \"test-model-945d24-kserve-c9689f9df-mv2gz\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") " pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:34.219209 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:34.219181    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-dshm\") pod \"test-model-945d24-kserve-c9689f9df-mv2gz\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") " pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:34.219388 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:34.219368    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-tls-certs\") pod \"test-model-945d24-kserve-c9689f9df-mv2gz\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") " pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:34.226815 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:34.226793    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xh5c\" (UniqueName: \"kubernetes.io/projected/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-kube-api-access-7xh5c\") pod \"test-model-945d24-kserve-c9689f9df-mv2gz\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") " pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:34.296200 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:34.296097    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:34.444515 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:34.444480    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"]
Jul 15 21:35:34.447541 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:35:34.447510    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod528ebc9a_bf02_4c84_a567_f7eb29ad8e9d.slice/crio-f0412ca4b49e403ae36b443bbf024a146b4101a79f312e16efc385ddd239fc97 WatchSource:0}: Error finding container f0412ca4b49e403ae36b443bbf024a146b4101a79f312e16efc385ddd239fc97: Status 404 returned error can't find the container with id f0412ca4b49e403ae36b443bbf024a146b4101a79f312e16efc385ddd239fc97
Jul 15 21:35:35.259613 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:35.259566    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz" event={"ID":"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d","Type":"ContainerStarted","Data":"03d523431840ec4e32657d9fe2947c9c75ebf45441073a3e8ff3ba80000f2bd2"}
Jul 15 21:35:35.260053 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:35.259622    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz" event={"ID":"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d","Type":"ContainerStarted","Data":"f0412ca4b49e403ae36b443bbf024a146b4101a79f312e16efc385ddd239fc97"}
Jul 15 21:35:44.296314 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:44.296275    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:44.296821 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:44.296335    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:44.308724 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:44.308699    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:35:44.327951 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:44.327903    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz" podStartSLOduration=11.327886109 podStartE2EDuration="11.327886109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:35:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:35:35.291405042 +0000 UTC m=+2182.482084470" watchObservedRunningTime="2026-07-15 21:35:44.327886109 +0000 UTC m=+2191.518565538"
Jul 15 21:35:45.312497 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:35:45.312462    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:36:09.387705 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.387671    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"]
Jul 15 21:36:09.390502 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.390484    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:09.394084 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.394058    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6874e2\"/\"openshift-service-ca.crt\""
Jul 15 21:36:09.394288 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.394072    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6874e2\"/\"default-dockercfg-t4xjl\""
Jul 15 21:36:09.394616 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.394592    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6874e2\"/\"kube-root-ca.crt\""
Jul 15 21:36:09.394903 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.394634    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6874e2\"/\"test-model-6874e2-kserve-self-signed-certs\""
Jul 15 21:36:09.404495 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.404470    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"]
Jul 15 21:36:09.493818 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.493765    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfstg\" (UniqueName: \"kubernetes.io/projected/b4bba4a0-5c49-4c46-b050-0e269c76395d-kube-api-access-cfstg\") pod \"test-model-6874e2-kserve-7cdccf9bd5-gbdz7\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") " pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:09.493818 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.493818    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-dshm\") pod \"test-model-6874e2-kserve-7cdccf9bd5-gbdz7\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") " pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:09.494074 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.493842    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-home\") pod \"test-model-6874e2-kserve-7cdccf9bd5-gbdz7\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") " pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:09.494074 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.493889    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-model-cache\") pod \"test-model-6874e2-kserve-7cdccf9bd5-gbdz7\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") " pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:09.494074 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.493907    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4bba4a0-5c49-4c46-b050-0e269c76395d-tls-certs\") pod \"test-model-6874e2-kserve-7cdccf9bd5-gbdz7\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") " pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:09.494074 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.494004    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-tmp-dir\") pod \"test-model-6874e2-kserve-7cdccf9bd5-gbdz7\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") " pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:09.594997 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.594958    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfstg\" (UniqueName: \"kubernetes.io/projected/b4bba4a0-5c49-4c46-b050-0e269c76395d-kube-api-access-cfstg\") pod \"test-model-6874e2-kserve-7cdccf9bd5-gbdz7\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") " pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:09.595186 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.595005    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-dshm\") pod \"test-model-6874e2-kserve-7cdccf9bd5-gbdz7\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") " pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:09.595186 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.595033    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-home\") pod \"test-model-6874e2-kserve-7cdccf9bd5-gbdz7\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") " pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:09.595186 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.595085    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-model-cache\") pod \"test-model-6874e2-kserve-7cdccf9bd5-gbdz7\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") " pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:09.595186 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.595111    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4bba4a0-5c49-4c46-b050-0e269c76395d-tls-certs\") pod \"test-model-6874e2-kserve-7cdccf9bd5-gbdz7\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") " pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:09.595186 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.595169    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-tmp-dir\") pod \"test-model-6874e2-kserve-7cdccf9bd5-gbdz7\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") " pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:09.595534 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.595506    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-home\") pod \"test-model-6874e2-kserve-7cdccf9bd5-gbdz7\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") " pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:09.595534 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.595519    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-model-cache\") pod \"test-model-6874e2-kserve-7cdccf9bd5-gbdz7\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") " pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:09.595675 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.595567    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-tmp-dir\") pod \"test-model-6874e2-kserve-7cdccf9bd5-gbdz7\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") " pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:09.597335 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.597317    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-dshm\") pod \"test-model-6874e2-kserve-7cdccf9bd5-gbdz7\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") " pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:09.597424 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.597407    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4bba4a0-5c49-4c46-b050-0e269c76395d-tls-certs\") pod \"test-model-6874e2-kserve-7cdccf9bd5-gbdz7\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") " pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:09.602685 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.602662    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfstg\" (UniqueName: \"kubernetes.io/projected/b4bba4a0-5c49-4c46-b050-0e269c76395d-kube-api-access-cfstg\") pod \"test-model-6874e2-kserve-7cdccf9bd5-gbdz7\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") " pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:09.703781 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.703749    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:09.835303 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:09.835280    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"]
Jul 15 21:36:09.837957 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:36:09.837933    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4bba4a0_5c49_4c46_b050_0e269c76395d.slice/crio-12251ca6d6e8d511507d35176325f08d8fec6fb086c44d0a99703f2e55f75c47 WatchSource:0}: Error finding container 12251ca6d6e8d511507d35176325f08d8fec6fb086c44d0a99703f2e55f75c47: Status 404 returned error can't find the container with id 12251ca6d6e8d511507d35176325f08d8fec6fb086c44d0a99703f2e55f75c47
Jul 15 21:36:10.408686 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:10.408652    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7" event={"ID":"b4bba4a0-5c49-4c46-b050-0e269c76395d","Type":"ContainerStarted","Data":"2e6fda38a4099926cfb292bbec62d53a879e3b2936d0a9e2c56b108b99330b43"}
Jul 15 21:36:10.409132 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:10.408696    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7" event={"ID":"b4bba4a0-5c49-4c46-b050-0e269c76395d","Type":"ContainerStarted","Data":"12251ca6d6e8d511507d35176325f08d8fec6fb086c44d0a99703f2e55f75c47"}
Jul 15 21:36:10.430761 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:10.430712    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7" podStartSLOduration=1.430696916 podStartE2EDuration="1.430696916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:36:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:36:10.429271677 +0000 UTC m=+2217.619951107" watchObservedRunningTime="2026-07-15 21:36:10.430696916 +0000 UTC m=+2217.621376345"
Jul 15 21:36:19.704328 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:19.704297    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:19.704831 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:19.704344    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:19.716461 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:19.716442    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:20.463980 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:20.463952    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:28.425993 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:28.425957    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"]
Jul 15 21:36:29.357073 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:29.357027    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"]
Jul 15 21:36:43.446222 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:43.446127    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz" podUID="528ebc9a-bf02-4c84-a567-f7eb29ad8e9d" containerName="main" containerID="cri-o://03d523431840ec4e32657d9fe2947c9c75ebf45441073a3e8ff3ba80000f2bd2" gracePeriod=45
Jul 15 21:36:43.691467 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:43.691444    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:36:43.745436 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:43.745372    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xh5c\" (UniqueName: \"kubernetes.io/projected/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-kube-api-access-7xh5c\") pod \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") "
Jul 15 21:36:43.745436 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:43.745425    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-dshm\") pod \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") "
Jul 15 21:36:43.745605 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:43.745472    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-tls-certs\") pod \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") "
Jul 15 21:36:43.745605 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:43.745529    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-model-cache\") pod \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") "
Jul 15 21:36:43.745605 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:43.745555    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-home\") pod \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") "
Jul 15 21:36:43.745605 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:43.745593    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-tmp-dir\") pod \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\" (UID: \"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d\") "
Jul 15 21:36:43.745829 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:43.745801    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-model-cache" (OuterVolumeSpecName: "model-cache") pod "528ebc9a-bf02-4c84-a567-f7eb29ad8e9d" (UID: "528ebc9a-bf02-4c84-a567-f7eb29ad8e9d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:36:43.745899 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:43.745820    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-home" (OuterVolumeSpecName: "home") pod "528ebc9a-bf02-4c84-a567-f7eb29ad8e9d" (UID: "528ebc9a-bf02-4c84-a567-f7eb29ad8e9d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:36:43.745956 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:43.745917    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "528ebc9a-bf02-4c84-a567-f7eb29ad8e9d" (UID: "528ebc9a-bf02-4c84-a567-f7eb29ad8e9d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:36:43.747523 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:43.747496    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-dshm" (OuterVolumeSpecName: "dshm") pod "528ebc9a-bf02-4c84-a567-f7eb29ad8e9d" (UID: "528ebc9a-bf02-4c84-a567-f7eb29ad8e9d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:36:43.747624 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:43.747558    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "528ebc9a-bf02-4c84-a567-f7eb29ad8e9d" (UID: "528ebc9a-bf02-4c84-a567-f7eb29ad8e9d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:36:43.747624 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:43.747585    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-kube-api-access-7xh5c" (OuterVolumeSpecName: "kube-api-access-7xh5c") pod "528ebc9a-bf02-4c84-a567-f7eb29ad8e9d" (UID: "528ebc9a-bf02-4c84-a567-f7eb29ad8e9d"). InnerVolumeSpecName "kube-api-access-7xh5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:36:43.846243 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:43.846209    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xh5c\" (UniqueName: \"kubernetes.io/projected/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-kube-api-access-7xh5c\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:36:43.846243 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:43.846240    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-dshm\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:36:43.846243 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:43.846249    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-tls-certs\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:36:43.846400 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:43.846258    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-model-cache\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:36:43.846400 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:43.846267    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-home\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:36:43.846400 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:43.846274    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d-tmp-dir\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:36:44.376747 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.376692    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7" podUID="b4bba4a0-5c49-4c46-b050-0e269c76395d" containerName="main" containerID="cri-o://2e6fda38a4099926cfb292bbec62d53a879e3b2936d0a9e2c56b108b99330b43" gracePeriod=45
Jul 15 21:36:44.557426 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.557396    2560 generic.go:356] "Generic (PLEG): container finished" podID="b4bba4a0-5c49-4c46-b050-0e269c76395d" containerID="2e6fda38a4099926cfb292bbec62d53a879e3b2936d0a9e2c56b108b99330b43" exitCode=0
Jul 15 21:36:44.557757 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.557481    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7" event={"ID":"b4bba4a0-5c49-4c46-b050-0e269c76395d","Type":"ContainerDied","Data":"2e6fda38a4099926cfb292bbec62d53a879e3b2936d0a9e2c56b108b99330b43"}
Jul 15 21:36:44.559005 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.558981    2560 generic.go:356] "Generic (PLEG): container finished" podID="528ebc9a-bf02-4c84-a567-f7eb29ad8e9d" containerID="03d523431840ec4e32657d9fe2947c9c75ebf45441073a3e8ff3ba80000f2bd2" exitCode=0
Jul 15 21:36:44.559125 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.559013    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz" event={"ID":"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d","Type":"ContainerDied","Data":"03d523431840ec4e32657d9fe2947c9c75ebf45441073a3e8ff3ba80000f2bd2"}
Jul 15 21:36:44.559125 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.559028    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"
Jul 15 21:36:44.559125 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.559059    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz" event={"ID":"528ebc9a-bf02-4c84-a567-f7eb29ad8e9d","Type":"ContainerDied","Data":"f0412ca4b49e403ae36b443bbf024a146b4101a79f312e16efc385ddd239fc97"}
Jul 15 21:36:44.559125 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.559083    2560 scope.go:117] "RemoveContainer" containerID="03d523431840ec4e32657d9fe2947c9c75ebf45441073a3e8ff3ba80000f2bd2"
Jul 15 21:36:44.568245 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.568227    2560 scope.go:117] "RemoveContainer" containerID="03d523431840ec4e32657d9fe2947c9c75ebf45441073a3e8ff3ba80000f2bd2"
Jul 15 21:36:44.568501 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:36:44.568483    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03d523431840ec4e32657d9fe2947c9c75ebf45441073a3e8ff3ba80000f2bd2\": container with ID starting with 03d523431840ec4e32657d9fe2947c9c75ebf45441073a3e8ff3ba80000f2bd2 not found: ID does not exist" containerID="03d523431840ec4e32657d9fe2947c9c75ebf45441073a3e8ff3ba80000f2bd2"
Jul 15 21:36:44.568577 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.568508    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03d523431840ec4e32657d9fe2947c9c75ebf45441073a3e8ff3ba80000f2bd2"} err="failed to get container status \"03d523431840ec4e32657d9fe2947c9c75ebf45441073a3e8ff3ba80000f2bd2\": rpc error: code = NotFound desc = could not find container \"03d523431840ec4e32657d9fe2947c9c75ebf45441073a3e8ff3ba80000f2bd2\": container with ID starting with 03d523431840ec4e32657d9fe2947c9c75ebf45441073a3e8ff3ba80000f2bd2 not found: ID does not exist"
Jul 15 21:36:44.582131 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.582113    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"]
Jul 15 21:36:44.589578 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.589559    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-945d24/test-model-945d24-kserve-c9689f9df-mv2gz"]
Jul 15 21:36:44.613986 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.613968    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:44.754267 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.754243    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4bba4a0-5c49-4c46-b050-0e269c76395d-tls-certs\") pod \"b4bba4a0-5c49-4c46-b050-0e269c76395d\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") "
Jul 15 21:36:44.754397 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.754276    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfstg\" (UniqueName: \"kubernetes.io/projected/b4bba4a0-5c49-4c46-b050-0e269c76395d-kube-api-access-cfstg\") pod \"b4bba4a0-5c49-4c46-b050-0e269c76395d\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") "
Jul 15 21:36:44.754397 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.754315    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-dshm\") pod \"b4bba4a0-5c49-4c46-b050-0e269c76395d\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") "
Jul 15 21:36:44.754397 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.754337    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-home\") pod \"b4bba4a0-5c49-4c46-b050-0e269c76395d\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") "
Jul 15 21:36:44.754397 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.754364    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-tmp-dir\") pod \"b4bba4a0-5c49-4c46-b050-0e269c76395d\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") "
Jul 15 21:36:44.754397 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.754391    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-model-cache\") pod \"b4bba4a0-5c49-4c46-b050-0e269c76395d\" (UID: \"b4bba4a0-5c49-4c46-b050-0e269c76395d\") "
Jul 15 21:36:44.754666 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.754612    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-home" (OuterVolumeSpecName: "home") pod "b4bba4a0-5c49-4c46-b050-0e269c76395d" (UID: "b4bba4a0-5c49-4c46-b050-0e269c76395d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:36:44.754804 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.754684    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b4bba4a0-5c49-4c46-b050-0e269c76395d" (UID: "b4bba4a0-5c49-4c46-b050-0e269c76395d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:36:44.754804 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.754725    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-model-cache" (OuterVolumeSpecName: "model-cache") pod "b4bba4a0-5c49-4c46-b050-0e269c76395d" (UID: "b4bba4a0-5c49-4c46-b050-0e269c76395d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:36:44.756580 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.756559    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4bba4a0-5c49-4c46-b050-0e269c76395d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b4bba4a0-5c49-4c46-b050-0e269c76395d" (UID: "b4bba4a0-5c49-4c46-b050-0e269c76395d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:36:44.756874 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.756850    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-dshm" (OuterVolumeSpecName: "dshm") pod "b4bba4a0-5c49-4c46-b050-0e269c76395d" (UID: "b4bba4a0-5c49-4c46-b050-0e269c76395d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:36:44.756874 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.756846    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4bba4a0-5c49-4c46-b050-0e269c76395d-kube-api-access-cfstg" (OuterVolumeSpecName: "kube-api-access-cfstg") pod "b4bba4a0-5c49-4c46-b050-0e269c76395d" (UID: "b4bba4a0-5c49-4c46-b050-0e269c76395d"). InnerVolumeSpecName "kube-api-access-cfstg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:36:44.855054 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.855032    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4bba4a0-5c49-4c46-b050-0e269c76395d-tls-certs\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:36:44.855054 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.855050    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfstg\" (UniqueName: \"kubernetes.io/projected/b4bba4a0-5c49-4c46-b050-0e269c76395d-kube-api-access-cfstg\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:36:44.855164 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.855060    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-dshm\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:36:44.855164 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.855069    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-home\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:36:44.855164 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.855077    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-tmp-dir\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:36:44.855164 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:44.855085    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4bba4a0-5c49-4c46-b050-0e269c76395d-model-cache\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:36:45.565019 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:45.564978    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7" event={"ID":"b4bba4a0-5c49-4c46-b050-0e269c76395d","Type":"ContainerDied","Data":"12251ca6d6e8d511507d35176325f08d8fec6fb086c44d0a99703f2e55f75c47"}
Jul 15 21:36:45.565019 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:45.565004    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"
Jul 15 21:36:45.565538 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:45.565041    2560 scope.go:117] "RemoveContainer" containerID="2e6fda38a4099926cfb292bbec62d53a879e3b2936d0a9e2c56b108b99330b43"
Jul 15 21:36:45.573717 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:45.573687    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="528ebc9a-bf02-4c84-a567-f7eb29ad8e9d" path="/var/lib/kubelet/pods/528ebc9a-bf02-4c84-a567-f7eb29ad8e9d/volumes"
Jul 15 21:36:45.591575 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:45.590132    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"]
Jul 15 21:36:45.594813 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:45.594762    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-6874e2/test-model-6874e2-kserve-7cdccf9bd5-gbdz7"]
Jul 15 21:36:47.573042 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:36:47.572988    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4bba4a0-5c49-4c46-b050-0e269c76395d" path="/var/lib/kubelet/pods/b4bba4a0-5c49-4c46-b050-0e269c76395d/volumes"
Jul 15 21:39:10.481303 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.481267    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"]
Jul 15 21:39:10.481746 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.481530    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4bba4a0-5c49-4c46-b050-0e269c76395d" containerName="main"
Jul 15 21:39:10.481746 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.481540    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4bba4a0-5c49-4c46-b050-0e269c76395d" containerName="main"
Jul 15 21:39:10.481746 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.481550    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="528ebc9a-bf02-4c84-a567-f7eb29ad8e9d" containerName="main"
Jul 15 21:39:10.481746 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.481555    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="528ebc9a-bf02-4c84-a567-f7eb29ad8e9d" containerName="main"
Jul 15 21:39:10.481746 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.481611    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="528ebc9a-bf02-4c84-a567-f7eb29ad8e9d" containerName="main"
Jul 15 21:39:10.481746 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.481617    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4bba4a0-5c49-4c46-b050-0e269c76395d" containerName="main"
Jul 15 21:39:10.484165 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.484150    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:10.487723 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.487672    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-39670c\"/\"default-dockercfg-hz6lp\""
Jul 15 21:39:10.487723 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.487709    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-39670c\"/\"auth-test-model-39670c-kserve-self-signed-certs\""
Jul 15 21:39:10.487723 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.487712    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-39670c\"/\"openshift-service-ca.crt\""
Jul 15 21:39:10.488036 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.487749    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-39670c\"/\"kube-root-ca.crt\""
Jul 15 21:39:10.497212 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.497194    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"]
Jul 15 21:39:10.560981 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.560955    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-model-cache\") pod \"auth-test-model-39670c-kserve-c84889547-ghlt5\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") " pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:10.561074 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.560993    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-tls-certs\") pod \"auth-test-model-39670c-kserve-c84889547-ghlt5\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") " pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:10.561074 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.561021    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fr5m\" (UniqueName: \"kubernetes.io/projected/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-kube-api-access-8fr5m\") pod \"auth-test-model-39670c-kserve-c84889547-ghlt5\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") " pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:10.561147 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.561085    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-home\") pod \"auth-test-model-39670c-kserve-c84889547-ghlt5\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") " pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:10.561147 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.561116    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-dshm\") pod \"auth-test-model-39670c-kserve-c84889547-ghlt5\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") " pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:10.561147 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.561134    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-tmp-dir\") pod \"auth-test-model-39670c-kserve-c84889547-ghlt5\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") " pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:10.661807 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.661765    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-model-cache\") pod \"auth-test-model-39670c-kserve-c84889547-ghlt5\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") " pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:10.661969 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.661817    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-tls-certs\") pod \"auth-test-model-39670c-kserve-c84889547-ghlt5\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") " pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:10.661969 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.661839    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fr5m\" (UniqueName: \"kubernetes.io/projected/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-kube-api-access-8fr5m\") pod \"auth-test-model-39670c-kserve-c84889547-ghlt5\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") " pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:10.661969 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.661871    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-home\") pod \"auth-test-model-39670c-kserve-c84889547-ghlt5\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") " pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:10.661969 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.661894    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-dshm\") pod \"auth-test-model-39670c-kserve-c84889547-ghlt5\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") " pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:10.661969 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.661908    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-tmp-dir\") pod \"auth-test-model-39670c-kserve-c84889547-ghlt5\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") " pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:10.662281 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.662141    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-model-cache\") pod \"auth-test-model-39670c-kserve-c84889547-ghlt5\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") " pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:10.662281 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.662167    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-tmp-dir\") pod \"auth-test-model-39670c-kserve-c84889547-ghlt5\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") " pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:10.662281 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.662257    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-home\") pod \"auth-test-model-39670c-kserve-c84889547-ghlt5\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") " pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:10.664044 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.664020    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-dshm\") pod \"auth-test-model-39670c-kserve-c84889547-ghlt5\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") " pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:10.664243 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.664225    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-tls-certs\") pod \"auth-test-model-39670c-kserve-c84889547-ghlt5\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") " pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:10.670166 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.670147    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fr5m\" (UniqueName: \"kubernetes.io/projected/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-kube-api-access-8fr5m\") pod \"auth-test-model-39670c-kserve-c84889547-ghlt5\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") " pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:10.792693 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.792633    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:10.928956 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:10.928929    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"]
Jul 15 21:39:10.930742 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:39:10.930717    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25e0f5ca_c2a4_4136_b0ae_75fb1c90f343.slice/crio-6efb499ea02a247137d660f0e4951f547b1374cf02840f3f372518f010700883 WatchSource:0}: Error finding container 6efb499ea02a247137d660f0e4951f547b1374cf02840f3f372518f010700883: Status 404 returned error can't find the container with id 6efb499ea02a247137d660f0e4951f547b1374cf02840f3f372518f010700883
Jul 15 21:39:11.152924 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:11.152842    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5" event={"ID":"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343","Type":"ContainerStarted","Data":"0176e20caffb3fe28d21baaafce73133cb5abe30d22c49730fd10775fa6cf12f"}
Jul 15 21:39:11.152924 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:11.152881    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5" event={"ID":"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343","Type":"ContainerStarted","Data":"6efb499ea02a247137d660f0e4951f547b1374cf02840f3f372518f010700883"}
Jul 15 21:39:11.174514 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:11.174461    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5" podStartSLOduration=1.174446503 podStartE2EDuration="1.174446503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:39:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:39:11.173997725 +0000 UTC m=+2398.364677147" watchObservedRunningTime="2026-07-15 21:39:11.174446503 +0000 UTC m=+2398.365125932"
Jul 15 21:39:20.793662 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:20.793628    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:20.794102 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:20.793676    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:20.806652 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:20.806629    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:21.208377 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:21.208352    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:39:46.594196 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.594110    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"]
Jul 15 21:39:46.597477 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.597459    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:46.600701 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.600674    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-feaa76\"/\"auth-test-model-feaa76-kserve-self-signed-certs\""
Jul 15 21:39:46.600842 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.600681    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-feaa76\"/\"kube-root-ca.crt\""
Jul 15 21:39:46.600984 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.600966    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-feaa76\"/\"default-dockercfg-svl8b\""
Jul 15 21:39:46.601032 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.600980    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-feaa76\"/\"openshift-service-ca.crt\""
Jul 15 21:39:46.611356 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.611335    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"]
Jul 15 21:39:46.745197 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.745170    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-tmp-dir\") pod \"auth-test-model-feaa76-kserve-5f99c7955f-6h9rm\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") " pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:46.745341 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.745210    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-dshm\") pod \"auth-test-model-feaa76-kserve-5f99c7955f-6h9rm\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") " pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:46.745341 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.745275    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29a5934c-f2f0-480e-900e-5d4878bbde11-tls-certs\") pod \"auth-test-model-feaa76-kserve-5f99c7955f-6h9rm\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") " pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:46.745341 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.745330    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhbb9\" (UniqueName: \"kubernetes.io/projected/29a5934c-f2f0-480e-900e-5d4878bbde11-kube-api-access-xhbb9\") pod \"auth-test-model-feaa76-kserve-5f99c7955f-6h9rm\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") " pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:46.745447 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.745383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-model-cache\") pod \"auth-test-model-feaa76-kserve-5f99c7955f-6h9rm\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") " pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:46.745447 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.745404    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-home\") pod \"auth-test-model-feaa76-kserve-5f99c7955f-6h9rm\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") " pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:46.846175 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.846107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-home\") pod \"auth-test-model-feaa76-kserve-5f99c7955f-6h9rm\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") " pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:46.846175 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.846141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-tmp-dir\") pod \"auth-test-model-feaa76-kserve-5f99c7955f-6h9rm\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") " pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:46.846175 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.846169    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-dshm\") pod \"auth-test-model-feaa76-kserve-5f99c7955f-6h9rm\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") " pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:46.846440 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.846212    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29a5934c-f2f0-480e-900e-5d4878bbde11-tls-certs\") pod \"auth-test-model-feaa76-kserve-5f99c7955f-6h9rm\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") " pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:46.846440 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.846248    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhbb9\" (UniqueName: \"kubernetes.io/projected/29a5934c-f2f0-480e-900e-5d4878bbde11-kube-api-access-xhbb9\") pod \"auth-test-model-feaa76-kserve-5f99c7955f-6h9rm\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") " pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:46.846440 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.846298    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-model-cache\") pod \"auth-test-model-feaa76-kserve-5f99c7955f-6h9rm\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") " pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:46.846598 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.846539    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-home\") pod \"auth-test-model-feaa76-kserve-5f99c7955f-6h9rm\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") " pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:46.846598 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.846577    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-tmp-dir\") pod \"auth-test-model-feaa76-kserve-5f99c7955f-6h9rm\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") " pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:46.846707 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.846655    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-model-cache\") pod \"auth-test-model-feaa76-kserve-5f99c7955f-6h9rm\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") " pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:46.848486 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.848463    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-dshm\") pod \"auth-test-model-feaa76-kserve-5f99c7955f-6h9rm\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") " pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:46.848669 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.848648    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29a5934c-f2f0-480e-900e-5d4878bbde11-tls-certs\") pod \"auth-test-model-feaa76-kserve-5f99c7955f-6h9rm\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") " pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:46.854923 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.854900    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhbb9\" (UniqueName: \"kubernetes.io/projected/29a5934c-f2f0-480e-900e-5d4878bbde11-kube-api-access-xhbb9\") pod \"auth-test-model-feaa76-kserve-5f99c7955f-6h9rm\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") " pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:46.906673 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:46.906649    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:47.045474 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:47.045452    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"]
Jul 15 21:39:47.047403 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:39:47.047370    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29a5934c_f2f0_480e_900e_5d4878bbde11.slice/crio-05b0712e9784d8e17c3a4c5576051ec181f4f6c8479d758107c3f80f7a90cf73 WatchSource:0}: Error finding container 05b0712e9784d8e17c3a4c5576051ec181f4f6c8479d758107c3f80f7a90cf73: Status 404 returned error can't find the container with id 05b0712e9784d8e17c3a4c5576051ec181f4f6c8479d758107c3f80f7a90cf73
Jul 15 21:39:47.303529 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:47.303495    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm" event={"ID":"29a5934c-f2f0-480e-900e-5d4878bbde11","Type":"ContainerStarted","Data":"ac310627b569b648ec27e46e37ffaaa20fc3e54e791d6faa179744698651adc7"}
Jul 15 21:39:47.303698 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:47.303539    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm" event={"ID":"29a5934c-f2f0-480e-900e-5d4878bbde11","Type":"ContainerStarted","Data":"05b0712e9784d8e17c3a4c5576051ec181f4f6c8479d758107c3f80f7a90cf73"}
Jul 15 21:39:47.323693 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:47.323645    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm" podStartSLOduration=1.323632205 podStartE2EDuration="1.323632205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:39:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:39:47.321836153 +0000 UTC m=+2434.512515594" watchObservedRunningTime="2026-07-15 21:39:47.323632205 +0000 UTC m=+2434.514311634"
Jul 15 21:39:56.907195 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:56.907161    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:56.907568 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:56.907236    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:56.919136 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:56.919111    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:39:57.354368 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:39:57.354294    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:41:57.951245 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:41:57.951211    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"]
Jul 15 21:41:58.766200 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:41:58.766167    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"]
Jul 15 21:42:04.076319 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.076276    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"]
Jul 15 21:42:04.079545 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.079522    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:04.082200 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.082179    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-39670c\"/\"sub-test-model-39670c-kserve-self-signed-certs\""
Jul 15 21:42:04.090228 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.090190    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"]
Jul 15 21:42:04.211156 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.211117    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-dshm\") pod \"sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") " pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:04.211332 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.211167    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-tls-certs\") pod \"sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") " pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:04.211332 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.211194    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz6jb\" (UniqueName: \"kubernetes.io/projected/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-kube-api-access-wz6jb\") pod \"sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") " pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:04.211332 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.211267    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-home\") pod \"sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") " pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:04.211332 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.211311    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-model-cache\") pod \"sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") " pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:04.211484 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.211336    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-tmp-dir\") pod \"sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") " pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:04.312314 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.312270    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-tls-certs\") pod \"sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") " pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:04.312492 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.312322    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz6jb\" (UniqueName: \"kubernetes.io/projected/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-kube-api-access-wz6jb\") pod \"sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") " pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:04.312492 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.312366    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-home\") pod \"sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") " pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:04.312492 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.312394    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-model-cache\") pod \"sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") " pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:04.312492 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.312419    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-tmp-dir\") pod \"sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") " pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:04.312492 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.312457    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-dshm\") pod \"sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") " pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:04.312916 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.312885    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-home\") pod \"sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") " pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:04.313033 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.312945    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-model-cache\") pod \"sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") " pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:04.313033 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.312983    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-tmp-dir\") pod \"sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") " pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:04.314695 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.314674    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-dshm\") pod \"sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") " pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:04.314891 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.314875    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-tls-certs\") pod \"sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") " pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:04.321648 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.321625    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz6jb\" (UniqueName: \"kubernetes.io/projected/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-kube-api-access-wz6jb\") pod \"sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") " pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:04.389264 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.389170    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:04.523563 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.523379    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"]
Jul 15 21:42:04.526331 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:42:04.526297    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88c78162_a1ba_4bec_9b19_9c2e7ff6d15f.slice/crio-6219134f80f36e1876eab9588e8b2f0fcbc84a5c423cef35ecdba01512a9d39a WatchSource:0}: Error finding container 6219134f80f36e1876eab9588e8b2f0fcbc84a5c423cef35ecdba01512a9d39a: Status 404 returned error can't find the container with id 6219134f80f36e1876eab9588e8b2f0fcbc84a5c423cef35ecdba01512a9d39a
Jul 15 21:42:04.875789 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.875733    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j" event={"ID":"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f","Type":"ContainerStarted","Data":"43ed98d35fc44391d28113c4128fd0481a693acf160b5b02722872d082d15494"}
Jul 15 21:42:04.875961 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.875798    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j" event={"ID":"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f","Type":"ContainerStarted","Data":"6219134f80f36e1876eab9588e8b2f0fcbc84a5c423cef35ecdba01512a9d39a"}
Jul 15 21:42:04.894050 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:04.893996    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j" podStartSLOduration=0.893979829 podStartE2EDuration="893.979829ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:42:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:42:04.893379032 +0000 UTC m=+2572.084058467" watchObservedRunningTime="2026-07-15 21:42:04.893979829 +0000 UTC m=+2572.084659258"
Jul 15 21:42:12.970985 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:12.970920    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5" podUID="25e0f5ca-c2a4-4136-b0ae-75fb1c90f343" containerName="main" containerID="cri-o://0176e20caffb3fe28d21baaafce73133cb5abe30d22c49730fd10775fa6cf12f" gracePeriod=45
Jul 15 21:42:13.214494 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.214468    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:42:13.291961 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.291873    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-home\") pod \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") "
Jul 15 21:42:13.291961 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.291965    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-tmp-dir\") pod \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") "
Jul 15 21:42:13.292201 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.291981    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-dshm\") pod \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") "
Jul 15 21:42:13.292201 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.292007    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-model-cache\") pod \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") "
Jul 15 21:42:13.292201 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.292046    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-tls-certs\") pod \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") "
Jul 15 21:42:13.292201 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.292082    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fr5m\" (UniqueName: \"kubernetes.io/projected/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-kube-api-access-8fr5m\") pod \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\" (UID: \"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343\") "
Jul 15 21:42:13.292368 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.292181    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-home" (OuterVolumeSpecName: "home") pod "25e0f5ca-c2a4-4136-b0ae-75fb1c90f343" (UID: "25e0f5ca-c2a4-4136-b0ae-75fb1c90f343"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:42:13.292368 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.292261    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-model-cache" (OuterVolumeSpecName: "model-cache") pod "25e0f5ca-c2a4-4136-b0ae-75fb1c90f343" (UID: "25e0f5ca-c2a4-4136-b0ae-75fb1c90f343"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:42:13.292857 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.292280    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "25e0f5ca-c2a4-4136-b0ae-75fb1c90f343" (UID: "25e0f5ca-c2a4-4136-b0ae-75fb1c90f343"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:42:13.293003 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.292981    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-model-cache\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:42:13.293003 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.293004    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-home\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:42:13.300001 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.299944    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-dshm" (OuterVolumeSpecName: "dshm") pod "25e0f5ca-c2a4-4136-b0ae-75fb1c90f343" (UID: "25e0f5ca-c2a4-4136-b0ae-75fb1c90f343"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:42:13.300218 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.300198    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "25e0f5ca-c2a4-4136-b0ae-75fb1c90f343" (UID: "25e0f5ca-c2a4-4136-b0ae-75fb1c90f343"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:42:13.300301 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.300213    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-kube-api-access-8fr5m" (OuterVolumeSpecName: "kube-api-access-8fr5m") pod "25e0f5ca-c2a4-4136-b0ae-75fb1c90f343" (UID: "25e0f5ca-c2a4-4136-b0ae-75fb1c90f343"). InnerVolumeSpecName "kube-api-access-8fr5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:42:13.394107 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.394066    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-tmp-dir\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:42:13.394107 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.394097    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-dshm\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:42:13.394107 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.394106    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-tls-certs\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:42:13.394107 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.394115    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fr5m\" (UniqueName: \"kubernetes.io/projected/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343-kube-api-access-8fr5m\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:42:13.786070 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.786008    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm" podUID="29a5934c-f2f0-480e-900e-5d4878bbde11" containerName="main" containerID="cri-o://ac310627b569b648ec27e46e37ffaaa20fc3e54e791d6faa179744698651adc7" gracePeriod=45
Jul 15 21:42:13.913927 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.913888    2560 generic.go:356] "Generic (PLEG): container finished" podID="25e0f5ca-c2a4-4136-b0ae-75fb1c90f343" containerID="0176e20caffb3fe28d21baaafce73133cb5abe30d22c49730fd10775fa6cf12f" exitCode=0
Jul 15 21:42:13.914090 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.913958    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"
Jul 15 21:42:13.914090 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.913984    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5" event={"ID":"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343","Type":"ContainerDied","Data":"0176e20caffb3fe28d21baaafce73133cb5abe30d22c49730fd10775fa6cf12f"}
Jul 15 21:42:13.914090 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.914026    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5" event={"ID":"25e0f5ca-c2a4-4136-b0ae-75fb1c90f343","Type":"ContainerDied","Data":"6efb499ea02a247137d660f0e4951f547b1374cf02840f3f372518f010700883"}
Jul 15 21:42:13.914090 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.914047    2560 scope.go:117] "RemoveContainer" containerID="0176e20caffb3fe28d21baaafce73133cb5abe30d22c49730fd10775fa6cf12f"
Jul 15 21:42:13.919258 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.919232    2560 generic.go:356] "Generic (PLEG): container finished" podID="29a5934c-f2f0-480e-900e-5d4878bbde11" containerID="ac310627b569b648ec27e46e37ffaaa20fc3e54e791d6faa179744698651adc7" exitCode=0
Jul 15 21:42:13.919371 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.919306    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm" event={"ID":"29a5934c-f2f0-480e-900e-5d4878bbde11","Type":"ContainerDied","Data":"ac310627b569b648ec27e46e37ffaaa20fc3e54e791d6faa179744698651adc7"}
Jul 15 21:42:13.925896 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.925877    2560 scope.go:117] "RemoveContainer" containerID="0176e20caffb3fe28d21baaafce73133cb5abe30d22c49730fd10775fa6cf12f"
Jul 15 21:42:13.926289 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:42:13.926259    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0176e20caffb3fe28d21baaafce73133cb5abe30d22c49730fd10775fa6cf12f\": container with ID starting with 0176e20caffb3fe28d21baaafce73133cb5abe30d22c49730fd10775fa6cf12f not found: ID does not exist" containerID="0176e20caffb3fe28d21baaafce73133cb5abe30d22c49730fd10775fa6cf12f"
Jul 15 21:42:13.926364 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.926304    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0176e20caffb3fe28d21baaafce73133cb5abe30d22c49730fd10775fa6cf12f"} err="failed to get container status \"0176e20caffb3fe28d21baaafce73133cb5abe30d22c49730fd10775fa6cf12f\": rpc error: code = NotFound desc = could not find container \"0176e20caffb3fe28d21baaafce73133cb5abe30d22c49730fd10775fa6cf12f\": container with ID starting with 0176e20caffb3fe28d21baaafce73133cb5abe30d22c49730fd10775fa6cf12f not found: ID does not exist"
Jul 15 21:42:13.933622 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.933587    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"]
Jul 15 21:42:13.937427 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:13.937402    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-39670c/auth-test-model-39670c-kserve-c84889547-ghlt5"]
Jul 15 21:42:14.037478 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.037454    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:42:14.201188 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.201160    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-home\") pod \"29a5934c-f2f0-480e-900e-5d4878bbde11\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") "
Jul 15 21:42:14.201358 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.201204    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhbb9\" (UniqueName: \"kubernetes.io/projected/29a5934c-f2f0-480e-900e-5d4878bbde11-kube-api-access-xhbb9\") pod \"29a5934c-f2f0-480e-900e-5d4878bbde11\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") "
Jul 15 21:42:14.201358 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.201232    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-tmp-dir\") pod \"29a5934c-f2f0-480e-900e-5d4878bbde11\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") "
Jul 15 21:42:14.201358 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.201287    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-model-cache\") pod \"29a5934c-f2f0-480e-900e-5d4878bbde11\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") "
Jul 15 21:42:14.201358 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.201346    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29a5934c-f2f0-480e-900e-5d4878bbde11-tls-certs\") pod \"29a5934c-f2f0-480e-900e-5d4878bbde11\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") "
Jul 15 21:42:14.201567 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.201374    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-dshm\") pod \"29a5934c-f2f0-480e-900e-5d4878bbde11\" (UID: \"29a5934c-f2f0-480e-900e-5d4878bbde11\") "
Jul 15 21:42:14.201567 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.201492    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-home" (OuterVolumeSpecName: "home") pod "29a5934c-f2f0-480e-900e-5d4878bbde11" (UID: "29a5934c-f2f0-480e-900e-5d4878bbde11"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:42:14.201567 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.201508    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "29a5934c-f2f0-480e-900e-5d4878bbde11" (UID: "29a5934c-f2f0-480e-900e-5d4878bbde11"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:42:14.201705 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.201601    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-model-cache" (OuterVolumeSpecName: "model-cache") pod "29a5934c-f2f0-480e-900e-5d4878bbde11" (UID: "29a5934c-f2f0-480e-900e-5d4878bbde11"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:42:14.201705 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.201683    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-home\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:42:14.201705 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.201698    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-tmp-dir\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:42:14.201838 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.201708    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-model-cache\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:42:14.203546 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.203516    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-dshm" (OuterVolumeSpecName: "dshm") pod "29a5934c-f2f0-480e-900e-5d4878bbde11" (UID: "29a5934c-f2f0-480e-900e-5d4878bbde11"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:42:14.203661 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.203551    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29a5934c-f2f0-480e-900e-5d4878bbde11-kube-api-access-xhbb9" (OuterVolumeSpecName: "kube-api-access-xhbb9") pod "29a5934c-f2f0-480e-900e-5d4878bbde11" (UID: "29a5934c-f2f0-480e-900e-5d4878bbde11"). InnerVolumeSpecName "kube-api-access-xhbb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:42:14.203661 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.203570    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29a5934c-f2f0-480e-900e-5d4878bbde11-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "29a5934c-f2f0-480e-900e-5d4878bbde11" (UID: "29a5934c-f2f0-480e-900e-5d4878bbde11"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:42:14.302251 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.302216    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29a5934c-f2f0-480e-900e-5d4878bbde11-tls-certs\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:42:14.302251 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.302243    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29a5934c-f2f0-480e-900e-5d4878bbde11-dshm\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:42:14.302251 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.302253    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhbb9\" (UniqueName: \"kubernetes.io/projected/29a5934c-f2f0-480e-900e-5d4878bbde11-kube-api-access-xhbb9\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:42:14.389501 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.389459    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:14.389647 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.389519    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:14.401918 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.401892    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:14.926242 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.926212    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"
Jul 15 21:42:14.926242 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.926240    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm" event={"ID":"29a5934c-f2f0-480e-900e-5d4878bbde11","Type":"ContainerDied","Data":"05b0712e9784d8e17c3a4c5576051ec181f4f6c8479d758107c3f80f7a90cf73"}
Jul 15 21:42:14.926480 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.926284    2560 scope.go:117] "RemoveContainer" containerID="ac310627b569b648ec27e46e37ffaaa20fc3e54e791d6faa179744698651adc7"
Jul 15 21:42:14.938317 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.938295    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:42:14.949334 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.949306    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"]
Jul 15 21:42:14.955700 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:14.955677    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-feaa76/auth-test-model-feaa76-kserve-5f99c7955f-6h9rm"]
Jul 15 21:42:15.573675 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:15.573637    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25e0f5ca-c2a4-4136-b0ae-75fb1c90f343" path="/var/lib/kubelet/pods/25e0f5ca-c2a4-4136-b0ae-75fb1c90f343/volumes"
Jul 15 21:42:15.574232 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:15.574209    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29a5934c-f2f0-480e-900e-5d4878bbde11" path="/var/lib/kubelet/pods/29a5934c-f2f0-480e-900e-5d4878bbde11/volumes"
Jul 15 21:42:23.089694 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.089658    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"]
Jul 15 21:42:23.090110 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.089968    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29a5934c-f2f0-480e-900e-5d4878bbde11" containerName="main"
Jul 15 21:42:23.090110 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.089979    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="29a5934c-f2f0-480e-900e-5d4878bbde11" containerName="main"
Jul 15 21:42:23.090110 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.089999    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25e0f5ca-c2a4-4136-b0ae-75fb1c90f343" containerName="main"
Jul 15 21:42:23.090110 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.090004    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="25e0f5ca-c2a4-4136-b0ae-75fb1c90f343" containerName="main"
Jul 15 21:42:23.090110 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.090051    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="29a5934c-f2f0-480e-900e-5d4878bbde11" containerName="main"
Jul 15 21:42:23.090110 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.090060    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="25e0f5ca-c2a4-4136-b0ae-75fb1c90f343" containerName="main"
Jul 15 21:42:23.092287 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.092264    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:23.095740 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.095711    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-feaa76\"/\"default-dockercfg-svl8b\""
Jul 15 21:42:23.095919 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.095748    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-feaa76\"/\"sub-test-model-feaa76-kserve-self-signed-certs\""
Jul 15 21:42:23.095919 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.095711    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-feaa76\"/\"kube-root-ca.crt\""
Jul 15 21:42:23.095919 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.095756    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-feaa76\"/\"openshift-service-ca.crt\""
Jul 15 21:42:23.104499 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.104475    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"]
Jul 15 21:42:23.282585 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.282545    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-tmp-dir\") pod \"sub-test-model-feaa76-kserve-86d45ffc79-w58qg\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") " pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:23.282585 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.282582    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-tls-certs\") pod \"sub-test-model-feaa76-kserve-86d45ffc79-w58qg\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") " pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:23.282761 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.282612    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-home\") pod \"sub-test-model-feaa76-kserve-86d45ffc79-w58qg\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") " pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:23.282761 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.282726    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-dshm\") pod \"sub-test-model-feaa76-kserve-86d45ffc79-w58qg\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") " pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:23.282761 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.282752    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-model-cache\") pod \"sub-test-model-feaa76-kserve-86d45ffc79-w58qg\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") " pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:23.282905 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.282824    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46ss9\" (UniqueName: \"kubernetes.io/projected/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-kube-api-access-46ss9\") pod \"sub-test-model-feaa76-kserve-86d45ffc79-w58qg\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") " pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:23.383532 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.383435    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46ss9\" (UniqueName: \"kubernetes.io/projected/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-kube-api-access-46ss9\") pod \"sub-test-model-feaa76-kserve-86d45ffc79-w58qg\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") " pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:23.383532 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.383518    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-tmp-dir\") pod \"sub-test-model-feaa76-kserve-86d45ffc79-w58qg\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") " pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:23.383753 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.383546    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-tls-certs\") pod \"sub-test-model-feaa76-kserve-86d45ffc79-w58qg\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") " pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:23.383753 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.383571    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-home\") pod \"sub-test-model-feaa76-kserve-86d45ffc79-w58qg\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") " pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:23.383753 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.383634    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-dshm\") pod \"sub-test-model-feaa76-kserve-86d45ffc79-w58qg\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") " pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:23.383753 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.383657    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-model-cache\") pod \"sub-test-model-feaa76-kserve-86d45ffc79-w58qg\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") " pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:23.384048 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.384012    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-home\") pod \"sub-test-model-feaa76-kserve-86d45ffc79-w58qg\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") " pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:23.384180 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.384019    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-tmp-dir\") pod \"sub-test-model-feaa76-kserve-86d45ffc79-w58qg\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") " pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:23.384180 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.384081    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-model-cache\") pod \"sub-test-model-feaa76-kserve-86d45ffc79-w58qg\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") " pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:23.385905 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.385885    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-dshm\") pod \"sub-test-model-feaa76-kserve-86d45ffc79-w58qg\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") " pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:23.386238 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.386219    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-tls-certs\") pod \"sub-test-model-feaa76-kserve-86d45ffc79-w58qg\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") " pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:23.392088 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.392065    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46ss9\" (UniqueName: \"kubernetes.io/projected/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-kube-api-access-46ss9\") pod \"sub-test-model-feaa76-kserve-86d45ffc79-w58qg\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") " pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:23.400908 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.400885    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:23.530576 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.530478    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"]
Jul 15 21:42:23.532921 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:42:23.532892    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9686d656_e97c_4a4f_ae5e_9b2fc0908be1.slice/crio-53ea7937eed37f5de7b1f2e9595adc5c8e501428feecbec87fe9e32ab40f29f1 WatchSource:0}: Error finding container 53ea7937eed37f5de7b1f2e9595adc5c8e501428feecbec87fe9e32ab40f29f1: Status 404 returned error can't find the container with id 53ea7937eed37f5de7b1f2e9595adc5c8e501428feecbec87fe9e32ab40f29f1
Jul 15 21:42:23.969319 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.969277    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg" event={"ID":"9686d656-e97c-4a4f-ae5e-9b2fc0908be1","Type":"ContainerStarted","Data":"cc06684bdf45583897425914e974da3a631e922c51999f68bc560a4d4133b9fd"}
Jul 15 21:42:23.969499 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.969328    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg" event={"ID":"9686d656-e97c-4a4f-ae5e-9b2fc0908be1","Type":"ContainerStarted","Data":"53ea7937eed37f5de7b1f2e9595adc5c8e501428feecbec87fe9e32ab40f29f1"}
Jul 15 21:42:23.988835 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:23.988763    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg" podStartSLOduration=0.988744646 podStartE2EDuration="988.744646ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:42:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:42:23.987324712 +0000 UTC m=+2591.178004142" watchObservedRunningTime="2026-07-15 21:42:23.988744646 +0000 UTC m=+2591.179424081"
Jul 15 21:42:33.402078 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:33.402035    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:33.402585 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:33.402104    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:33.414636 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:33.414609    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:42:34.024489 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:42:34.024406    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:43:08.039749 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:08.039708    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"]
Jul 15 21:43:08.817035 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:08.817002    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"]
Jul 15 21:43:19.997642 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:19.997607    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"]
Jul 15 21:43:20.001606 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.001587    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:20.004085 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.004060    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-39670c\"/\"rate-test-model-39670c-kserve-self-signed-certs\""
Jul 15 21:43:20.010675 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.010651    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"]
Jul 15 21:43:20.172902 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.172864    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjvsg\" (UniqueName: \"kubernetes.io/projected/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-kube-api-access-mjvsg\") pod \"rate-test-model-39670c-kserve-5d877bc8b7-8mh84\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") " pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:20.172902 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.172905    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-tls-certs\") pod \"rate-test-model-39670c-kserve-5d877bc8b7-8mh84\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") " pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:20.173165 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.172925    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-dshm\") pod \"rate-test-model-39670c-kserve-5d877bc8b7-8mh84\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") " pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:20.173165 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.173034    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-tmp-dir\") pod \"rate-test-model-39670c-kserve-5d877bc8b7-8mh84\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") " pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:20.173165 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.173098    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-model-cache\") pod \"rate-test-model-39670c-kserve-5d877bc8b7-8mh84\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") " pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:20.173165 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.173161    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-home\") pod \"rate-test-model-39670c-kserve-5d877bc8b7-8mh84\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") " pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:20.274490 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.274406    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-tmp-dir\") pod \"rate-test-model-39670c-kserve-5d877bc8b7-8mh84\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") " pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:20.274490 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.274459    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-model-cache\") pod \"rate-test-model-39670c-kserve-5d877bc8b7-8mh84\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") " pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:20.274710 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.274499    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-home\") pod \"rate-test-model-39670c-kserve-5d877bc8b7-8mh84\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") " pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:20.274710 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.274542    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjvsg\" (UniqueName: \"kubernetes.io/projected/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-kube-api-access-mjvsg\") pod \"rate-test-model-39670c-kserve-5d877bc8b7-8mh84\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") " pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:20.274710 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.274566    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-tls-certs\") pod \"rate-test-model-39670c-kserve-5d877bc8b7-8mh84\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") " pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:20.274710 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.274596    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-dshm\") pod \"rate-test-model-39670c-kserve-5d877bc8b7-8mh84\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") " pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:20.274922 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.274896    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-home\") pod \"rate-test-model-39670c-kserve-5d877bc8b7-8mh84\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") " pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:20.274970 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.274925    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-tmp-dir\") pod \"rate-test-model-39670c-kserve-5d877bc8b7-8mh84\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") " pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:20.274970 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.274964    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-model-cache\") pod \"rate-test-model-39670c-kserve-5d877bc8b7-8mh84\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") " pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:20.276765 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.276741    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-dshm\") pod \"rate-test-model-39670c-kserve-5d877bc8b7-8mh84\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") " pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:20.277093 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.277071    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-tls-certs\") pod \"rate-test-model-39670c-kserve-5d877bc8b7-8mh84\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") " pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:20.283252 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.283228    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjvsg\" (UniqueName: \"kubernetes.io/projected/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-kube-api-access-mjvsg\") pod \"rate-test-model-39670c-kserve-5d877bc8b7-8mh84\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") " pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:20.312187 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.312149    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:20.445385 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:20.445347    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"]
Jul 15 21:43:20.448215 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:43:20.448188    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod394e90c0_4552_40c6_a9b0_4cd6ad4ef5c0.slice/crio-44feddbeb09658b691b078e10e3fa93a1beec82a970c57d48785f340bbcb66a5 WatchSource:0}: Error finding container 44feddbeb09658b691b078e10e3fa93a1beec82a970c57d48785f340bbcb66a5: Status 404 returned error can't find the container with id 44feddbeb09658b691b078e10e3fa93a1beec82a970c57d48785f340bbcb66a5
Jul 15 21:43:21.216145 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:21.216106    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84" event={"ID":"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0","Type":"ContainerStarted","Data":"704c062776256db4e330e14f2d1b7bfc0091449606a47e568f1a9786bec2d638"}
Jul 15 21:43:21.216145 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:21.216149    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84" event={"ID":"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0","Type":"ContainerStarted","Data":"44feddbeb09658b691b078e10e3fa93a1beec82a970c57d48785f340bbcb66a5"}
Jul 15 21:43:21.248066 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:21.248006    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84" podStartSLOduration=2.247989164 podStartE2EDuration="2.247989164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:43:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:43:21.24656974 +0000 UTC m=+2648.437249171" watchObservedRunningTime="2026-07-15 21:43:21.247989164 +0000 UTC m=+2648.438668592"
Jul 15 21:43:23.059346 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.059298    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j" podUID="88c78162-a1ba-4bec-9b19-9c2e7ff6d15f" containerName="main" containerID="cri-o://43ed98d35fc44391d28113c4128fd0481a693acf160b5b02722872d082d15494" gracePeriod=45
Jul 15 21:43:23.225461 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.225426    2560 generic.go:356] "Generic (PLEG): container finished" podID="88c78162-a1ba-4bec-9b19-9c2e7ff6d15f" containerID="43ed98d35fc44391d28113c4128fd0481a693acf160b5b02722872d082d15494" exitCode=0
Jul 15 21:43:23.225621 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.225497    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j" event={"ID":"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f","Type":"ContainerDied","Data":"43ed98d35fc44391d28113c4128fd0481a693acf160b5b02722872d082d15494"}
Jul 15 21:43:23.316028 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.315967    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:43:23.397650 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.397615    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-dshm\") pod \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") "
Jul 15 21:43:23.397856 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.397679    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-tmp-dir\") pod \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") "
Jul 15 21:43:23.397856 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.397711    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wz6jb\" (UniqueName: \"kubernetes.io/projected/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-kube-api-access-wz6jb\") pod \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") "
Jul 15 21:43:23.397856 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.397738    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-tls-certs\") pod \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") "
Jul 15 21:43:23.397856 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.397760    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-home\") pod \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") "
Jul 15 21:43:23.397856 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.397798    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-model-cache\") pod \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\" (UID: \"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f\") "
Jul 15 21:43:23.398110 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.398004    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "88c78162-a1ba-4bec-9b19-9c2e7ff6d15f" (UID: "88c78162-a1ba-4bec-9b19-9c2e7ff6d15f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:43:23.398232 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.398091    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-home" (OuterVolumeSpecName: "home") pod "88c78162-a1ba-4bec-9b19-9c2e7ff6d15f" (UID: "88c78162-a1ba-4bec-9b19-9c2e7ff6d15f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:43:23.398232 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.398163    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-model-cache" (OuterVolumeSpecName: "model-cache") pod "88c78162-a1ba-4bec-9b19-9c2e7ff6d15f" (UID: "88c78162-a1ba-4bec-9b19-9c2e7ff6d15f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:43:23.399912 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.399884    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-kube-api-access-wz6jb" (OuterVolumeSpecName: "kube-api-access-wz6jb") pod "88c78162-a1ba-4bec-9b19-9c2e7ff6d15f" (UID: "88c78162-a1ba-4bec-9b19-9c2e7ff6d15f"). InnerVolumeSpecName "kube-api-access-wz6jb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:43:23.400013 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.399908    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-dshm" (OuterVolumeSpecName: "dshm") pod "88c78162-a1ba-4bec-9b19-9c2e7ff6d15f" (UID: "88c78162-a1ba-4bec-9b19-9c2e7ff6d15f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:43:23.400013 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.399969    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "88c78162-a1ba-4bec-9b19-9c2e7ff6d15f" (UID: "88c78162-a1ba-4bec-9b19-9c2e7ff6d15f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:43:23.498735 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.498697    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-dshm\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:43:23.498735 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.498727    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-tmp-dir\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:43:23.498735 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.498738    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wz6jb\" (UniqueName: \"kubernetes.io/projected/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-kube-api-access-wz6jb\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:43:23.498735 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.498747    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-tls-certs\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:43:23.499027 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.498756    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-home\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:43:23.499027 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.498765    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f-model-cache\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:43:23.836788 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:23.836674    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg" podUID="9686d656-e97c-4a4f-ae5e-9b2fc0908be1" containerName="main" containerID="cri-o://cc06684bdf45583897425914e974da3a631e922c51999f68bc560a4d4133b9fd" gracePeriod=45
Jul 15 21:43:24.087321 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.087264    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:43:24.102156 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.102134    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-model-cache\") pod \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") "
Jul 15 21:43:24.102304 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.102162    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-tmp-dir\") pod \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") "
Jul 15 21:43:24.102304 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.102179    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-home\") pod \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") "
Jul 15 21:43:24.102304 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.102235    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-dshm\") pod \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") "
Jul 15 21:43:24.102304 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.102255    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-tls-certs\") pod \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") "
Jul 15 21:43:24.102304 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.102292    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46ss9\" (UniqueName: \"kubernetes.io/projected/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-kube-api-access-46ss9\") pod \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\" (UID: \"9686d656-e97c-4a4f-ae5e-9b2fc0908be1\") "
Jul 15 21:43:24.102567 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.102430    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9686d656-e97c-4a4f-ae5e-9b2fc0908be1" (UID: "9686d656-e97c-4a4f-ae5e-9b2fc0908be1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:43:24.102567 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.102449    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-model-cache" (OuterVolumeSpecName: "model-cache") pod "9686d656-e97c-4a4f-ae5e-9b2fc0908be1" (UID: "9686d656-e97c-4a4f-ae5e-9b2fc0908be1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:43:24.102567 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.102515    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-home" (OuterVolumeSpecName: "home") pod "9686d656-e97c-4a4f-ae5e-9b2fc0908be1" (UID: "9686d656-e97c-4a4f-ae5e-9b2fc0908be1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:43:24.102673 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.102600    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-model-cache\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:43:24.102673 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.102615    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-tmp-dir\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:43:24.102673 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.102623    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-home\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:43:24.104398 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.104375    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-dshm" (OuterVolumeSpecName: "dshm") pod "9686d656-e97c-4a4f-ae5e-9b2fc0908be1" (UID: "9686d656-e97c-4a4f-ae5e-9b2fc0908be1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:43:24.104524 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.104501    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9686d656-e97c-4a4f-ae5e-9b2fc0908be1" (UID: "9686d656-e97c-4a4f-ae5e-9b2fc0908be1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:43:24.104567 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.104522    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-kube-api-access-46ss9" (OuterVolumeSpecName: "kube-api-access-46ss9") pod "9686d656-e97c-4a4f-ae5e-9b2fc0908be1" (UID: "9686d656-e97c-4a4f-ae5e-9b2fc0908be1"). InnerVolumeSpecName "kube-api-access-46ss9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:43:24.203924 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.203872    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46ss9\" (UniqueName: \"kubernetes.io/projected/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-kube-api-access-46ss9\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:43:24.203924 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.203915    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-dshm\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:43:24.203924 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.203927    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9686d656-e97c-4a4f-ae5e-9b2fc0908be1-tls-certs\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:43:24.230477 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.230438    2560 generic.go:356] "Generic (PLEG): container finished" podID="9686d656-e97c-4a4f-ae5e-9b2fc0908be1" containerID="cc06684bdf45583897425914e974da3a631e922c51999f68bc560a4d4133b9fd" exitCode=0
Jul 15 21:43:24.230658 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.230487    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"
Jul 15 21:43:24.230658 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.230529    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg" event={"ID":"9686d656-e97c-4a4f-ae5e-9b2fc0908be1","Type":"ContainerDied","Data":"cc06684bdf45583897425914e974da3a631e922c51999f68bc560a4d4133b9fd"}
Jul 15 21:43:24.230658 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.230571    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg" event={"ID":"9686d656-e97c-4a4f-ae5e-9b2fc0908be1","Type":"ContainerDied","Data":"53ea7937eed37f5de7b1f2e9595adc5c8e501428feecbec87fe9e32ab40f29f1"}
Jul 15 21:43:24.230658 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.230587    2560 scope.go:117] "RemoveContainer" containerID="cc06684bdf45583897425914e974da3a631e922c51999f68bc560a4d4133b9fd"
Jul 15 21:43:24.231886 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.231863    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j" event={"ID":"88c78162-a1ba-4bec-9b19-9c2e7ff6d15f","Type":"ContainerDied","Data":"6219134f80f36e1876eab9588e8b2f0fcbc84a5c423cef35ecdba01512a9d39a"}
Jul 15 21:43:24.231886 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.231879    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"
Jul 15 21:43:24.239685 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.239668    2560 scope.go:117] "RemoveContainer" containerID="cc06684bdf45583897425914e974da3a631e922c51999f68bc560a4d4133b9fd"
Jul 15 21:43:24.239962 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:43:24.239944    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc06684bdf45583897425914e974da3a631e922c51999f68bc560a4d4133b9fd\": container with ID starting with cc06684bdf45583897425914e974da3a631e922c51999f68bc560a4d4133b9fd not found: ID does not exist" containerID="cc06684bdf45583897425914e974da3a631e922c51999f68bc560a4d4133b9fd"
Jul 15 21:43:24.240019 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.239968    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc06684bdf45583897425914e974da3a631e922c51999f68bc560a4d4133b9fd"} err="failed to get container status \"cc06684bdf45583897425914e974da3a631e922c51999f68bc560a4d4133b9fd\": rpc error: code = NotFound desc = could not find container \"cc06684bdf45583897425914e974da3a631e922c51999f68bc560a4d4133b9fd\": container with ID starting with cc06684bdf45583897425914e974da3a631e922c51999f68bc560a4d4133b9fd not found: ID does not exist"
Jul 15 21:43:24.240019 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.239985    2560 scope.go:117] "RemoveContainer" containerID="43ed98d35fc44391d28113c4128fd0481a693acf160b5b02722872d082d15494"
Jul 15 21:43:24.248473 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.248451    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"]
Jul 15 21:43:24.252097 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.252076    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-39670c/sub-test-model-39670c-kserve-76ffdc4bb7-mfh5j"]
Jul 15 21:43:24.262341 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.262316    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"]
Jul 15 21:43:24.266608 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:24.266585    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg"]
Jul 15 21:43:25.573199 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:25.573168    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88c78162-a1ba-4bec-9b19-9c2e7ff6d15f" path="/var/lib/kubelet/pods/88c78162-a1ba-4bec-9b19-9c2e7ff6d15f/volumes"
Jul 15 21:43:25.573586 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:25.573546    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9686d656-e97c-4a4f-ae5e-9b2fc0908be1" path="/var/lib/kubelet/pods/9686d656-e97c-4a4f-ae5e-9b2fc0908be1/volumes"
Jul 15 21:43:29.015088 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:29.015029    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-feaa76/sub-test-model-feaa76-kserve-86d45ffc79-w58qg" podUID="9686d656-e97c-4a4f-ae5e-9b2fc0908be1" containerName="main" probeResult="failure" output="Get \"https://10.134.0.35:8000/ready\": context deadline exceeded"
Jul 15 21:43:30.313366 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:30.313320    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:30.313802 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:30.313390    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:30.325869 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:30.325844    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:31.273301 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:31.273272    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:43:43.906420 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:43.906383    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"]
Jul 15 21:43:43.906959 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:43.906671    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9686d656-e97c-4a4f-ae5e-9b2fc0908be1" containerName="main"
Jul 15 21:43:43.906959 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:43.906683    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9686d656-e97c-4a4f-ae5e-9b2fc0908be1" containerName="main"
Jul 15 21:43:43.906959 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:43.906696    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88c78162-a1ba-4bec-9b19-9c2e7ff6d15f" containerName="main"
Jul 15 21:43:43.906959 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:43.906703    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="88c78162-a1ba-4bec-9b19-9c2e7ff6d15f" containerName="main"
Jul 15 21:43:43.906959 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:43.906760    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="88c78162-a1ba-4bec-9b19-9c2e7ff6d15f" containerName="main"
Jul 15 21:43:43.906959 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:43.906782    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9686d656-e97c-4a4f-ae5e-9b2fc0908be1" containerName="main"
Jul 15 21:43:43.910937 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:43.910920    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:43.914222 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:43.914200    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-feaa76\"/\"kube-root-ca.crt\""
Jul 15 21:43:43.914222 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:43.914200    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-feaa76\"/\"openshift-service-ca.crt\""
Jul 15 21:43:43.914397 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:43.914230    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-feaa76\"/\"rate-test-model-feaa76-kserve-self-signed-certs\""
Jul 15 21:43:43.914397 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:43.914207    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-feaa76\"/\"default-dockercfg-svl8b\""
Jul 15 21:43:43.920923 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:43.920901    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"]
Jul 15 21:43:43.948641 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:43.948613    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-dshm\") pod \"rate-test-model-feaa76-kserve-fccd667c9-2ldql\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") " pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:43.948798 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:43.948659    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-tmp-dir\") pod \"rate-test-model-feaa76-kserve-fccd667c9-2ldql\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") " pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:43.948798 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:43.948696    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-home\") pod \"rate-test-model-feaa76-kserve-fccd667c9-2ldql\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") " pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:43.948920 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:43.948813    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-model-cache\") pod \"rate-test-model-feaa76-kserve-fccd667c9-2ldql\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") " pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:43.948920 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:43.948848    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15cedb83-d001-4185-a9c5-6c532a76e906-tls-certs\") pod \"rate-test-model-feaa76-kserve-fccd667c9-2ldql\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") " pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:43.948920 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:43.948866    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxkdr\" (UniqueName: \"kubernetes.io/projected/15cedb83-d001-4185-a9c5-6c532a76e906-kube-api-access-rxkdr\") pod \"rate-test-model-feaa76-kserve-fccd667c9-2ldql\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") " pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:44.049264 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:44.049241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-tmp-dir\") pod \"rate-test-model-feaa76-kserve-fccd667c9-2ldql\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") " pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:44.049380 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:44.049272    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-home\") pod \"rate-test-model-feaa76-kserve-fccd667c9-2ldql\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") " pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:44.049380 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:44.049307    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-model-cache\") pod \"rate-test-model-feaa76-kserve-fccd667c9-2ldql\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") " pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:44.049380 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:44.049328    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15cedb83-d001-4185-a9c5-6c532a76e906-tls-certs\") pod \"rate-test-model-feaa76-kserve-fccd667c9-2ldql\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") " pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:44.049380 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:44.049345    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxkdr\" (UniqueName: \"kubernetes.io/projected/15cedb83-d001-4185-a9c5-6c532a76e906-kube-api-access-rxkdr\") pod \"rate-test-model-feaa76-kserve-fccd667c9-2ldql\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") " pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:44.049521 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:44.049399    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-dshm\") pod \"rate-test-model-feaa76-kserve-fccd667c9-2ldql\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") " pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:44.049683 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:44.049664    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-tmp-dir\") pod \"rate-test-model-feaa76-kserve-fccd667c9-2ldql\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") " pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:44.049755 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:44.049726    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-home\") pod \"rate-test-model-feaa76-kserve-fccd667c9-2ldql\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") " pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:44.049832 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:44.049733    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-model-cache\") pod \"rate-test-model-feaa76-kserve-fccd667c9-2ldql\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") " pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:44.051535 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:44.051518    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-dshm\") pod \"rate-test-model-feaa76-kserve-fccd667c9-2ldql\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") " pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:44.051863 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:44.051848    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15cedb83-d001-4185-a9c5-6c532a76e906-tls-certs\") pod \"rate-test-model-feaa76-kserve-fccd667c9-2ldql\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") " pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:44.061921 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:44.061901    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxkdr\" (UniqueName: \"kubernetes.io/projected/15cedb83-d001-4185-a9c5-6c532a76e906-kube-api-access-rxkdr\") pod \"rate-test-model-feaa76-kserve-fccd667c9-2ldql\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") " pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:44.220634 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:44.220556    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:44.349386 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:44.349346    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"]
Jul 15 21:43:44.352394 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:43:44.352370    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15cedb83_d001_4185_a9c5_6c532a76e906.slice/crio-5d706c246b1a48b271fc65b2370a5394d47c267c21cdb44cd74acf455ef89d8e WatchSource:0}: Error finding container 5d706c246b1a48b271fc65b2370a5394d47c267c21cdb44cd74acf455ef89d8e: Status 404 returned error can't find the container with id 5d706c246b1a48b271fc65b2370a5394d47c267c21cdb44cd74acf455ef89d8e
Jul 15 21:43:45.326092 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:45.326058    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql" event={"ID":"15cedb83-d001-4185-a9c5-6c532a76e906","Type":"ContainerStarted","Data":"cb9bb861ac2e679d45864586e33ca15cfa4c8478ede62f535d286ba3bfc18b6e"}
Jul 15 21:43:45.326548 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:45.326099    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql" event={"ID":"15cedb83-d001-4185-a9c5-6c532a76e906","Type":"ContainerStarted","Data":"5d706c246b1a48b271fc65b2370a5394d47c267c21cdb44cd74acf455ef89d8e"}
Jul 15 21:43:45.348326 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:45.348268    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql" podStartSLOduration=2.34824804 podStartE2EDuration="2.34824804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:43:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:43:45.348138079 +0000 UTC m=+2672.538817508" watchObservedRunningTime="2026-07-15 21:43:45.34824804 +0000 UTC m=+2672.538927469"
Jul 15 21:43:54.221089 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:54.221051    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:54.221483 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:54.221106    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:54.233614 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:54.233589    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:43:54.372871 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:43:54.372842    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:44:32.393575 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:32.393541    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"]
Jul 15 21:44:33.198595 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:33.198561    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"]
Jul 15 21:44:47.413098 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:47.413044    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84" podUID="394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0" containerName="main" containerID="cri-o://704c062776256db4e330e14f2d1b7bfc0091449606a47e568f1a9786bec2d638" gracePeriod=45
Jul 15 21:44:47.587230 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:47.587197    2560 generic.go:356] "Generic (PLEG): container finished" podID="394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0" containerID="704c062776256db4e330e14f2d1b7bfc0091449606a47e568f1a9786bec2d638" exitCode=0
Jul 15 21:44:47.587369 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:47.587244    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84" event={"ID":"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0","Type":"ContainerDied","Data":"704c062776256db4e330e14f2d1b7bfc0091449606a47e568f1a9786bec2d638"}
Jul 15 21:44:47.664530 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:47.664466    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:44:47.814535 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:47.814489    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-home\") pod \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") "
Jul 15 21:44:47.814535 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:47.814545    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-tls-certs\") pod \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") "
Jul 15 21:44:47.814805 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:47.814561    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-dshm\") pod \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") "
Jul 15 21:44:47.814805 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:47.814594    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-tmp-dir\") pod \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") "
Jul 15 21:44:47.814805 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:47.814638    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-model-cache\") pod \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") "
Jul 15 21:44:47.814805 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:47.814668    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjvsg\" (UniqueName: \"kubernetes.io/projected/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-kube-api-access-mjvsg\") pod \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\" (UID: \"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0\") "
Jul 15 21:44:47.815021 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:47.814920    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-home" (OuterVolumeSpecName: "home") pod "394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0" (UID: "394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:44:47.815021 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:47.814954    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0" (UID: "394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:44:47.815021 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:47.814982    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-model-cache" (OuterVolumeSpecName: "model-cache") pod "394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0" (UID: "394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:44:47.816735 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:47.816709    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-dshm" (OuterVolumeSpecName: "dshm") pod "394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0" (UID: "394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:44:47.816862 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:47.816795    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-kube-api-access-mjvsg" (OuterVolumeSpecName: "kube-api-access-mjvsg") pod "394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0" (UID: "394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0"). InnerVolumeSpecName "kube-api-access-mjvsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:44:47.816862 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:47.816858    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0" (UID: "394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:44:47.915635 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:47.915538    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-tmp-dir\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:44:47.915635 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:47.915571    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-model-cache\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:44:47.915635 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:47.915581    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjvsg\" (UniqueName: \"kubernetes.io/projected/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-kube-api-access-mjvsg\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:44:47.915635 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:47.915590    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-home\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:44:47.915635 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:47.915600    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-tls-certs\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:44:47.915635 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:47.915607    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0-dshm\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:44:48.218166 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.218049    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql" podUID="15cedb83-d001-4185-a9c5-6c532a76e906" containerName="main" containerID="cri-o://cb9bb861ac2e679d45864586e33ca15cfa4c8478ede62f535d286ba3bfc18b6e" gracePeriod=45
Jul 15 21:44:48.470896 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.470834    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:44:48.592371 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.592342    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"
Jul 15 21:44:48.592371 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.592355    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84" event={"ID":"394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0","Type":"ContainerDied","Data":"44feddbeb09658b691b078e10e3fa93a1beec82a970c57d48785f340bbcb66a5"}
Jul 15 21:44:48.592618 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.592408    2560 scope.go:117] "RemoveContainer" containerID="704c062776256db4e330e14f2d1b7bfc0091449606a47e568f1a9786bec2d638"
Jul 15 21:44:48.593858 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.593836    2560 generic.go:356] "Generic (PLEG): container finished" podID="15cedb83-d001-4185-a9c5-6c532a76e906" containerID="cb9bb861ac2e679d45864586e33ca15cfa4c8478ede62f535d286ba3bfc18b6e" exitCode=0
Jul 15 21:44:48.593985 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.593874    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"
Jul 15 21:44:48.593985 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.593909    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql" event={"ID":"15cedb83-d001-4185-a9c5-6c532a76e906","Type":"ContainerDied","Data":"cb9bb861ac2e679d45864586e33ca15cfa4c8478ede62f535d286ba3bfc18b6e"}
Jul 15 21:44:48.593985 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.593936    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql" event={"ID":"15cedb83-d001-4185-a9c5-6c532a76e906","Type":"ContainerDied","Data":"5d706c246b1a48b271fc65b2370a5394d47c267c21cdb44cd74acf455ef89d8e"}
Jul 15 21:44:48.601535 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.601514    2560 scope.go:117] "RemoveContainer" containerID="cb9bb861ac2e679d45864586e33ca15cfa4c8478ede62f535d286ba3bfc18b6e"
Jul 15 21:44:48.609010 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.608992    2560 scope.go:117] "RemoveContainer" containerID="cb9bb861ac2e679d45864586e33ca15cfa4c8478ede62f535d286ba3bfc18b6e"
Jul 15 21:44:48.609278 ip-10-0-130-134 kubenswrapper[2560]: E0715 21:44:48.609257    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb9bb861ac2e679d45864586e33ca15cfa4c8478ede62f535d286ba3bfc18b6e\": container with ID starting with cb9bb861ac2e679d45864586e33ca15cfa4c8478ede62f535d286ba3bfc18b6e not found: ID does not exist" containerID="cb9bb861ac2e679d45864586e33ca15cfa4c8478ede62f535d286ba3bfc18b6e"
Jul 15 21:44:48.609324 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.609286    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb9bb861ac2e679d45864586e33ca15cfa4c8478ede62f535d286ba3bfc18b6e"} err="failed to get container status \"cb9bb861ac2e679d45864586e33ca15cfa4c8478ede62f535d286ba3bfc18b6e\": rpc error: code = NotFound desc = could not find container \"cb9bb861ac2e679d45864586e33ca15cfa4c8478ede62f535d286ba3bfc18b6e\": container with ID starting with cb9bb861ac2e679d45864586e33ca15cfa4c8478ede62f535d286ba3bfc18b6e not found: ID does not exist"
Jul 15 21:44:48.615571 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.615545    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"]
Jul 15 21:44:48.620004 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.619983    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-39670c/rate-test-model-39670c-kserve-5d877bc8b7-8mh84"]
Jul 15 21:44:48.622678 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.622660    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-home\") pod \"15cedb83-d001-4185-a9c5-6c532a76e906\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") "
Jul 15 21:44:48.622738 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.622688    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15cedb83-d001-4185-a9c5-6c532a76e906-tls-certs\") pod \"15cedb83-d001-4185-a9c5-6c532a76e906\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") "
Jul 15 21:44:48.622738 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.622716    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxkdr\" (UniqueName: \"kubernetes.io/projected/15cedb83-d001-4185-a9c5-6c532a76e906-kube-api-access-rxkdr\") pod \"15cedb83-d001-4185-a9c5-6c532a76e906\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") "
Jul 15 21:44:48.622843 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.622742    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-tmp-dir\") pod \"15cedb83-d001-4185-a9c5-6c532a76e906\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") "
Jul 15 21:44:48.622843 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.622815    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-dshm\") pod \"15cedb83-d001-4185-a9c5-6c532a76e906\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") "
Jul 15 21:44:48.622949 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.622845    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-model-cache\") pod \"15cedb83-d001-4185-a9c5-6c532a76e906\" (UID: \"15cedb83-d001-4185-a9c5-6c532a76e906\") "
Jul 15 21:44:48.623003 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.622953    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-home" (OuterVolumeSpecName: "home") pod "15cedb83-d001-4185-a9c5-6c532a76e906" (UID: "15cedb83-d001-4185-a9c5-6c532a76e906"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:44:48.623144 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.623122    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-home\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:44:48.623211 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.623148    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-model-cache" (OuterVolumeSpecName: "model-cache") pod "15cedb83-d001-4185-a9c5-6c532a76e906" (UID: "15cedb83-d001-4185-a9c5-6c532a76e906"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:44:48.623211 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.623103    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "15cedb83-d001-4185-a9c5-6c532a76e906" (UID: "15cedb83-d001-4185-a9c5-6c532a76e906"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:44:48.624873 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.624853    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-dshm" (OuterVolumeSpecName: "dshm") pod "15cedb83-d001-4185-a9c5-6c532a76e906" (UID: "15cedb83-d001-4185-a9c5-6c532a76e906"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:44:48.624960 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.624909    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15cedb83-d001-4185-a9c5-6c532a76e906-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "15cedb83-d001-4185-a9c5-6c532a76e906" (UID: "15cedb83-d001-4185-a9c5-6c532a76e906"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:44:48.624960 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.624921    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15cedb83-d001-4185-a9c5-6c532a76e906-kube-api-access-rxkdr" (OuterVolumeSpecName: "kube-api-access-rxkdr") pod "15cedb83-d001-4185-a9c5-6c532a76e906" (UID: "15cedb83-d001-4185-a9c5-6c532a76e906"). InnerVolumeSpecName "kube-api-access-rxkdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:44:48.723836 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.723723    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-tmp-dir\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:44:48.723836 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.723761    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-dshm\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:44:48.723836 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.723799    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15cedb83-d001-4185-a9c5-6c532a76e906-model-cache\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:44:48.723836 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.723811    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15cedb83-d001-4185-a9c5-6c532a76e906-tls-certs\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:44:48.723836 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.723824    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxkdr\" (UniqueName: \"kubernetes.io/projected/15cedb83-d001-4185-a9c5-6c532a76e906-kube-api-access-rxkdr\") on node \"ip-10-0-130-134.ec2.internal\" DevicePath \"\""
Jul 15 21:44:48.915102 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.915069    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"]
Jul 15 21:44:48.918844 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:48.918819    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-feaa76/rate-test-model-feaa76-kserve-fccd667c9-2ldql"]
Jul 15 21:44:49.573236 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:49.573205    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15cedb83-d001-4185-a9c5-6c532a76e906" path="/var/lib/kubelet/pods/15cedb83-d001-4185-a9c5-6c532a76e906/volumes"
Jul 15 21:44:49.573606 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:44:49.573593    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0" path="/var/lib/kubelet/pods/394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0/volumes"
Jul 15 21:45:38.188240 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:45:38.188151    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7db467bbbd-rh56n_dd1db2ee-8394-4e5c-a9ce-3d742d9a44fe/authorino/0.log"
Jul 15 21:45:44.638109 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:45:44.638074    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74776f8bd9-f79jw_183d73c0-9a39-4c66-af0c-c600e103a479/copy-manifests/0.log"
Jul 15 21:45:44.656542 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:45:44.656513    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74776f8bd9-f79jw_183d73c0-9a39-4c66-af0c-c600e103a479/manager/0.log"
Jul 15 21:45:48.233613 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:45:48.233581    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7db467bbbd-rh56n_dd1db2ee-8394-4e5c-a9ce-3d742d9a44fe/authorino/0.log"
Jul 15 21:45:48.577110 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:45:48.577031    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pp5jb_92cc0df2-954f-4f58-a9f4-f5c69ffd5213/kuadrant-console-plugin/0.log"
Jul 15 21:45:49.751089 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:45:49.751056    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55c97b5545-qc5nw_c03bff64-521d-4569-88a5-533fc52fb746/kube-auth-proxy/0.log"
Jul 15 21:45:49.990075 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:45:49.990033    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-jhqbb_bb571233-f893-4484-897d-74c294f8d514/payload-pre-processing/0.log"
Jul 15 21:45:50.551721 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:45:50.551690    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-j2pwn_004b962b-264a-48b0-b221-f1752f08992a/main/0.log"
Jul 15 21:45:50.663200 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:45:50.663168    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-7pknx_b62c8995-e5f2-405d-a6b5-47f1eb77f63e/main/0.log"
Jul 15 21:45:50.992071 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:45:50.992028    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-jxh2r_24d50da1-ed0c-409b-b261-e07344c04e76/main/0.log"
Jul 15 21:45:51.105954 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:45:51.105907    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-29dl4_f62c430f-607b-40df-b554-e90367cfd046/main/0.log"
Jul 15 21:46:00.519163 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:00.519127    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zqlwf_714b4c14-6a46-4bb6-8fa4-cb4b18bb6b91/global-pull-secret-syncer/0.log"
Jul 15 21:46:00.626634 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:00.626604    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lbrvc_63c63623-9437-4680-88c3-1495e3b67d8e/konnectivity-agent/0.log"
Jul 15 21:46:00.683435 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:00.683405    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-134.ec2.internal_d096c15409b94daf881a74897409f344/haproxy/0.log"
Jul 15 21:46:06.024261 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:06.024203    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7db467bbbd-rh56n_dd1db2ee-8394-4e5c-a9ce-3d742d9a44fe/authorino/0.log"
Jul 15 21:46:06.148426 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:06.148395    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pp5jb_92cc0df2-954f-4f58-a9f4-f5c69ffd5213/kuadrant-console-plugin/0.log"
Jul 15 21:46:08.933083 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:08.933052    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ftmvg_aa20c6ec-b8d5-4564-91d7-ab88dc623f69/node-exporter/0.log"
Jul 15 21:46:08.973341 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:08.973309    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ftmvg_aa20c6ec-b8d5-4564-91d7-ab88dc623f69/kube-rbac-proxy/0.log"
Jul 15 21:46:08.995493 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:08.995465    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ftmvg_aa20c6ec-b8d5-4564-91d7-ab88dc623f69/init-textfile/0.log"
Jul 15 21:46:10.248151 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.248113    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6"]
Jul 15 21:46:10.248620 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.248447    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0" containerName="main"
Jul 15 21:46:10.248620 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.248461    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0" containerName="main"
Jul 15 21:46:10.248620 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.248477    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15cedb83-d001-4185-a9c5-6c532a76e906" containerName="main"
Jul 15 21:46:10.248620 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.248482    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="15cedb83-d001-4185-a9c5-6c532a76e906" containerName="main"
Jul 15 21:46:10.248620 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.248525    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="15cedb83-d001-4185-a9c5-6c532a76e906" containerName="main"
Jul 15 21:46:10.248620 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.248534    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="394e90c0-4552-40c6-a9b0-4cd6ad4ef5c0" containerName="main"
Jul 15 21:46:10.251448 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.251424    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6"
Jul 15 21:46:10.253926 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.253905    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dprpk\"/\"openshift-service-ca.crt\""
Jul 15 21:46:10.254636 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.254620    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dprpk\"/\"default-dockercfg-tsvf8\""
Jul 15 21:46:10.254680 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.254648    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dprpk\"/\"kube-root-ca.crt\""
Jul 15 21:46:10.266425 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.266398    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6"]
Jul 15 21:46:10.315005 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.314972    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc-sys\") pod \"perf-node-gather-daemonset-h5sg6\" (UID: \"aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6"
Jul 15 21:46:10.315170 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.315017    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc-lib-modules\") pod \"perf-node-gather-daemonset-h5sg6\" (UID: \"aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6"
Jul 15 21:46:10.315170 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.315038    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc-proc\") pod \"perf-node-gather-daemonset-h5sg6\" (UID: \"aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6"
Jul 15 21:46:10.315170 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.315115    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc-podres\") pod \"perf-node-gather-daemonset-h5sg6\" (UID: \"aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6"
Jul 15 21:46:10.315170 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.315140    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltgsz\" (UniqueName: \"kubernetes.io/projected/aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc-kube-api-access-ltgsz\") pod \"perf-node-gather-daemonset-h5sg6\" (UID: \"aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6"
Jul 15 21:46:10.415690 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.415652    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc-lib-modules\") pod \"perf-node-gather-daemonset-h5sg6\" (UID: \"aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6"
Jul 15 21:46:10.415690 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.415690    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc-proc\") pod \"perf-node-gather-daemonset-h5sg6\" (UID: \"aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6"
Jul 15 21:46:10.415962 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.415744    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc-podres\") pod \"perf-node-gather-daemonset-h5sg6\" (UID: \"aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6"
Jul 15 21:46:10.415962 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.415765    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltgsz\" (UniqueName: \"kubernetes.io/projected/aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc-kube-api-access-ltgsz\") pod \"perf-node-gather-daemonset-h5sg6\" (UID: \"aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6"
Jul 15 21:46:10.415962 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.415819    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc-sys\") pod \"perf-node-gather-daemonset-h5sg6\" (UID: \"aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6"
Jul 15 21:46:10.415962 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.415862    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc-proc\") pod \"perf-node-gather-daemonset-h5sg6\" (UID: \"aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6"
Jul 15 21:46:10.415962 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.415873    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc-lib-modules\") pod \"perf-node-gather-daemonset-h5sg6\" (UID: \"aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6"
Jul 15 21:46:10.415962 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.415884    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc-podres\") pod \"perf-node-gather-daemonset-h5sg6\" (UID: \"aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6"
Jul 15 21:46:10.415962 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.415908    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc-sys\") pod \"perf-node-gather-daemonset-h5sg6\" (UID: \"aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6"
Jul 15 21:46:10.424657 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.424630    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltgsz\" (UniqueName: \"kubernetes.io/projected/aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc-kube-api-access-ltgsz\") pod \"perf-node-gather-daemonset-h5sg6\" (UID: \"aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc\") " pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6"
Jul 15 21:46:10.561962 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.561859    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6"
Jul 15 21:46:10.698592 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.698524    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6"]
Jul 15 21:46:10.701287 ip-10-0-130-134 kubenswrapper[2560]: W0715 21:46:10.701253    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaaf7ae44_85d7_4fd0_8ae0_4d09ee7ec6dc.slice/crio-cdaf25e885c6598cd01cde418219ee56c610a184e0f4c76ab791d14c7fff2bbf WatchSource:0}: Error finding container cdaf25e885c6598cd01cde418219ee56c610a184e0f4c76ab791d14c7fff2bbf: Status 404 returned error can't find the container with id cdaf25e885c6598cd01cde418219ee56c610a184e0f4c76ab791d14c7fff2bbf
Jul 15 21:46:10.947059 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.947017    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6" event={"ID":"aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc","Type":"ContainerStarted","Data":"cb0e3db436cef74307fddde2fba11a9220a9bab8c67e6713cf20a795c3da2a17"}
Jul 15 21:46:10.947289 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.947085    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6" event={"ID":"aaf7ae44-85d7-4fd0-8ae0-4d09ee7ec6dc","Type":"ContainerStarted","Data":"cdaf25e885c6598cd01cde418219ee56c610a184e0f4c76ab791d14c7fff2bbf"}
Jul 15 21:46:10.947289 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.947124    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6"
Jul 15 21:46:10.964021 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:10.963970    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6" podStartSLOduration=0.963955394 podStartE2EDuration="963.955394ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:46:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:46:10.962747368 +0000 UTC m=+2818.153426797" watchObservedRunningTime="2026-07-15 21:46:10.963955394 +0000 UTC m=+2818.154634824"
Jul 15 21:46:13.703124 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:13.703094    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wlr98_075f5125-e010-4d9c-833a-d2602c7594e8/dns/0.log"
Jul 15 21:46:13.724624 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:13.724593    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wlr98_075f5125-e010-4d9c-833a-d2602c7594e8/kube-rbac-proxy/0.log"
Jul 15 21:46:13.773876 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:13.773846    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ndnjh_936b35e9-8251-4100-b335-c91679e0c998/dns-node-resolver/0.log"
Jul 15 21:46:14.441294 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:14.441247    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vntdq_a0b4d72f-b8a2-465f-a92d-2201d824ff19/node-ca/0.log"
Jul 15 21:46:15.661704 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:15.661676    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55c97b5545-qc5nw_c03bff64-521d-4569-88a5-533fc52fb746/kube-auth-proxy/0.log"
Jul 15 21:46:15.773279 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:15.773243    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-jhqbb_bb571233-f893-4484-897d-74c294f8d514/payload-pre-processing/0.log"
Jul 15 21:46:16.583571 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:16.583537    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8gbcf_0c36943f-6089-442b-a6f1-1d5a2e666a0e/serve-healthcheck-canary/0.log"
Jul 15 21:46:16.962174 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:16.962142    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dprpk/perf-node-gather-daemonset-h5sg6"
Jul 15 21:46:17.304998 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:17.304915    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stl92_2cceb473-9450-4dde-a82c-b92e94c92cf3/kube-rbac-proxy/0.log"
Jul 15 21:46:17.330916 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:17.330886    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stl92_2cceb473-9450-4dde-a82c-b92e94c92cf3/exporter/0.log"
Jul 15 21:46:17.355056 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:17.355025    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stl92_2cceb473-9450-4dde-a82c-b92e94c92cf3/extractor/0.log"
Jul 15 21:46:20.544956 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:20.544917    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74776f8bd9-f79jw_183d73c0-9a39-4c66-af0c-c600e103a479/manager/0.log"
Jul 15 21:46:20.583173 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:20.583092    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74776f8bd9-f79jw_183d73c0-9a39-4c66-af0c-c600e103a479/copy-manifests/0.log"
Jul 15 21:46:20.790650 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:20.790619    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55c97b5545-qc5nw_c03bff64-521d-4569-88a5-533fc52fb746/kube-auth-proxy/0.log"
Jul 15 21:46:20.888696 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:20.888592    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-jhqbb_bb571233-f893-4484-897d-74c294f8d514/payload-pre-processing/0.log"
Jul 15 21:46:21.887179 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:21.887147    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-649f4f97b8-6pdmt_c81a6b6a-9715-4a56-852a-9d952d35ba51/manager/0.log"
Jul 15 21:46:22.429015 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:22.428985    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55c97b5545-qc5nw_c03bff64-521d-4569-88a5-533fc52fb746/kube-auth-proxy/0.log"
Jul 15 21:46:22.530657 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:22.530604    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-jhqbb_bb571233-f893-4484-897d-74c294f8d514/payload-pre-processing/0.log"
Jul 15 21:46:26.861346 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:26.861313    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-2qnmm_6bfb7f51-82da-4cf2-a660-717189d0ab29/migrator/0.log"
Jul 15 21:46:26.883582 ip-10-0-130-134 kubenswrapper[2560]: I0715 21:46:26.883552    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-2qnmm_6bfb7f51-82da-4cf2-a660-717189d0ab29/graceful-termination/0.log"