Jul 22 12:52:00.538326 ip-10-0-141-162 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 22 12:52:00.538338 ip-10-0-141-162 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 22 12:52:00.538348 ip-10-0-141-162 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 22 12:52:00.538728 ip-10-0-141-162 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 22 12:52:10.574302 ip-10-0-141-162 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 22 12:52:10.574318 ip-10-0-141-162 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 0e9057a8973d40a88f194595d9642263 --
Jul 22 12:54:10.477785 ip-10-0-141-162 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 12:54:12.528160 ip-10-0-141-162 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 12:54:12.528160 ip-10-0-141-162 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 12:54:12.528160 ip-10-0-141-162 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 12:54:12.528160 ip-10-0-141-162 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 12:54:12.528160 ip-10-0-141-162 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 12:54:12.529242 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.529155    2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 12:54:12.534319 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534297    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 12:54:12.534319 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534318    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 12:54:12.534319 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534321    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 12:54:12.534416 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534324    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 12:54:12.534416 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534328    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 12:54:12.534416 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534331    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 12:54:12.534416 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534334    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 12:54:12.534416 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534337    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 12:54:12.534416 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534340    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 12:54:12.534416 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534343    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 12:54:12.534416 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534346    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 12:54:12.534416 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534351    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 12:54:12.534416 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534354    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 12:54:12.534416 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534357    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 12:54:12.534416 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534361    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 12:54:12.534416 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534366    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 12:54:12.534416 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534369    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 12:54:12.534416 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534379    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 12:54:12.534416 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534382    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 12:54:12.534416 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534385    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 12:54:12.534416 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534388    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 12:54:12.534416 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534391    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 12:54:12.534884 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534393    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 12:54:12.534884 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534396    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 12:54:12.534884 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534398    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 12:54:12.534884 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534401    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 12:54:12.534884 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534405    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 12:54:12.534884 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534408    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 12:54:12.534884 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534411    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 12:54:12.534884 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534414    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 12:54:12.534884 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534417    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 12:54:12.534884 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534420    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 12:54:12.534884 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534423    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 12:54:12.534884 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534426    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 12:54:12.534884 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534429    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 12:54:12.534884 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534432    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 12:54:12.534884 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534435    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 12:54:12.534884 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534438    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 12:54:12.534884 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534441    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 12:54:12.534884 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534444    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 12:54:12.534884 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534446    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 12:54:12.535310 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534449    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 12:54:12.535310 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534452    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 12:54:12.535310 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534454    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 12:54:12.535310 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534457    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 12:54:12.535310 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534459    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 12:54:12.535310 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534462    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 12:54:12.535310 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534465    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 12:54:12.535310 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534469    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 12:54:12.535310 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534472    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 12:54:12.535310 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534475    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 12:54:12.535310 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534478    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 12:54:12.535310 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534481    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 12:54:12.535310 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534484    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 12:54:12.535310 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534487    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 12:54:12.535310 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534491    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 12:54:12.535310 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534494    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 12:54:12.535310 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534497    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 12:54:12.535310 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534500    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 12:54:12.535310 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534502    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 12:54:12.535800 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534505    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 12:54:12.535800 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534508    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 12:54:12.535800 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534510    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 12:54:12.535800 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534513    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 12:54:12.535800 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534516    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 12:54:12.535800 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534520    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 12:54:12.535800 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534522    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 12:54:12.535800 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534525    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 12:54:12.535800 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534527    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 12:54:12.535800 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534530    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 12:54:12.535800 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534532    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 12:54:12.535800 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534535    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 12:54:12.535800 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534537    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 12:54:12.535800 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534540    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 12:54:12.535800 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534543    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 12:54:12.535800 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534546    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 12:54:12.535800 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534549    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 12:54:12.535800 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534551    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 12:54:12.535800 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534554    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 12:54:12.535800 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534557    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 12:54:12.535800 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534560    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 12:54:12.536280 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534562    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 12:54:12.536280 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534565    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 12:54:12.536280 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534568    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 12:54:12.536280 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534570    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 12:54:12.536280 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534578    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 12:54:12.536280 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534580    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 12:54:12.536280 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534583    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 12:54:12.536280 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534586    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 12:54:12.536280 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534589    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 12:54:12.536280 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534591    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 12:54:12.536280 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534594    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 12:54:12.536280 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534596    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 12:54:12.536280 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534599    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 12:54:12.536280 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534601    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 12:54:12.536280 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534604    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 12:54:12.536280 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534606    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 12:54:12.536280 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534609    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 12:54:12.536280 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.534612    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 12:54:12.536280 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535370    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 12:54:12.536773 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535377    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 12:54:12.536773 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535380    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 12:54:12.536773 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535383    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 12:54:12.536773 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535386    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 12:54:12.536773 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535388    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 12:54:12.536773 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535391    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 12:54:12.536773 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535394    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 12:54:12.536773 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535396    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 12:54:12.536773 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535399    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 12:54:12.536773 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535402    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 12:54:12.536773 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535404    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 12:54:12.536773 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535407    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 12:54:12.536773 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535409    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 12:54:12.536773 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535412    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 12:54:12.536773 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535414    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 12:54:12.536773 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535417    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 12:54:12.536773 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535420    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 12:54:12.536773 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535425    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 12:54:12.536773 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535428    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 12:54:12.536773 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535431    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 12:54:12.537348 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535434    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 12:54:12.537348 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535437    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 12:54:12.537348 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535439    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 12:54:12.537348 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535442    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 12:54:12.537348 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535444    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 12:54:12.537348 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535447    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 12:54:12.537348 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535450    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 12:54:12.537348 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535452    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 12:54:12.537348 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535454    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 12:54:12.537348 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535457    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 12:54:12.537348 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535459    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 12:54:12.537348 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535462    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 12:54:12.537348 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535465    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 12:54:12.537348 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535468    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 12:54:12.537348 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535470    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 12:54:12.537348 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535475    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 12:54:12.537348 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535478    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 12:54:12.537348 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535481    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 12:54:12.537348 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535484    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 12:54:12.538145 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535487    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 12:54:12.538145 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535490    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 12:54:12.538145 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535492    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 12:54:12.538145 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535496    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 12:54:12.538145 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535498    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 12:54:12.538145 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535501    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 12:54:12.538145 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535504    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 12:54:12.538145 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535507    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 12:54:12.538145 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535509    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 12:54:12.538145 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535511    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 12:54:12.538145 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535516    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 12:54:12.538145 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535518    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 12:54:12.538145 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535521    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 12:54:12.538145 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535525    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 12:54:12.538145 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535527    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 12:54:12.538145 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535530    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 12:54:12.538145 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535532    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 12:54:12.538145 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535535    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 12:54:12.538145 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535538    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 12:54:12.538145 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535541    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 12:54:12.538824 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535543    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 12:54:12.538824 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535545    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 12:54:12.538824 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535548    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 12:54:12.538824 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535550    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 12:54:12.538824 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535554    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 12:54:12.538824 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535557    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 12:54:12.538824 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535560    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 12:54:12.538824 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535563    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 12:54:12.538824 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535566    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 12:54:12.538824 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535568    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 12:54:12.538824 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535570    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 12:54:12.538824 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535573    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 12:54:12.538824 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535578    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 12:54:12.538824 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535582    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 12:54:12.538824 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535584    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 12:54:12.538824 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535587    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 12:54:12.538824 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535590    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 12:54:12.538824 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535592    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 12:54:12.538824 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535595    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 12:54:12.538824 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535598    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 12:54:12.539410 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535601    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 12:54:12.539410 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535604    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 12:54:12.539410 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535609    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 12:54:12.539410 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535612    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 12:54:12.539410 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535614    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 12:54:12.539410 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535617    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 12:54:12.539410 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535620    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 12:54:12.539410 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535622    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 12:54:12.539410 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535625    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 12:54:12.539410 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535627    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 12:54:12.539410 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535630    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 12:54:12.539410 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535632    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 12:54:12.539410 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535635    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 12:54:12.539410 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535637    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 12:54:12.539410 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535640    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 12:54:12.539410 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535642    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 12:54:12.539410 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535649    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 12:54:12.539410 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535652    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 12:54:12.539410 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.535654    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 12:54:12.540069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536078    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 12:54:12.540069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536084    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 12:54:12.540069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536088    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 12:54:12.540069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536091    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 12:54:12.540069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536093    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 12:54:12.540069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536096    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 12:54:12.540069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536099    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 12:54:12.540069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536102    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 12:54:12.540069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536104    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 12:54:12.540069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536107    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 12:54:12.540069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536109    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 12:54:12.540069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536112    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 12:54:12.540069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536115    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 12:54:12.540069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536117    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 12:54:12.540069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536120    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 12:54:12.540069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536124    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 12:54:12.540069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536127    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 12:54:12.540069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536130    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 12:54:12.540069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536133    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 12:54:12.540069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536136    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 12:54:12.540797 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536138    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 12:54:12.540797 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536141    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 12:54:12.540797 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536143    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 12:54:12.540797 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536147    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 12:54:12.540797 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536151    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 12:54:12.540797 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536153    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 12:54:12.540797 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536156    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 12:54:12.540797 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536159    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 12:54:12.540797 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536161    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 12:54:12.540797 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536165    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 12:54:12.540797 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536167    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 12:54:12.540797 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536170    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 12:54:12.540797 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536172    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 12:54:12.540797 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536175    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 12:54:12.540797 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536177    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 12:54:12.540797 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536179    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 12:54:12.540797 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536182    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 12:54:12.540797 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536185    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 12:54:12.540797 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536188    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 12:54:12.541337 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536191    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 12:54:12.541337 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536193    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 12:54:12.541337 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536195    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 12:54:12.541337 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536198    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 12:54:12.541337 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536200    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 12:54:12.541337 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536203    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 12:54:12.541337 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536206    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 12:54:12.541337 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536208    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 12:54:12.541337 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536212    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 12:54:12.541337 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536215    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 12:54:12.541337 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536218    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 12:54:12.541337 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536221    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 12:54:12.541337 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536223    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 12:54:12.541337 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536226    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 12:54:12.541337 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536229    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 12:54:12.541337 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536231    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 12:54:12.541337 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536234    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 12:54:12.541337 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536236    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 12:54:12.541337 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536239    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 12:54:12.541337 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536242    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 12:54:12.541831 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536244    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 12:54:12.541831 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536247    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 12:54:12.541831 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536249    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 12:54:12.541831 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536252    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 12:54:12.541831 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536254    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 12:54:12.541831 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536257    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 12:54:12.541831 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536260    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 12:54:12.541831 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536262    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 12:54:12.541831 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536265    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 12:54:12.541831 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536267    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 12:54:12.541831 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536270    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 12:54:12.541831 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536272    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 12:54:12.541831 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536276    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 12:54:12.541831 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536278    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 12:54:12.541831 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536281    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 12:54:12.541831 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536283    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 12:54:12.541831 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536286    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 12:54:12.541831 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536288    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 12:54:12.541831 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536291    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 12:54:12.541831 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536293    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 12:54:12.542402 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536298    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 12:54:12.542402 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536300    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 12:54:12.542402 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536303    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 12:54:12.542402 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536306    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 12:54:12.542402 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536309    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 12:54:12.542402 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536312    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 12:54:12.542402 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536314    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 12:54:12.542402 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536317    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 12:54:12.542402 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536319    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 12:54:12.542402 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536322    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 12:54:12.542402 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536324    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 12:54:12.542402 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536327    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 12:54:12.542402 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536331    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 12:54:12.542402 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536334    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 12:54:12.542402 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536337    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 12:54:12.542402 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536340    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 12:54:12.542402 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536343    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 12:54:12.542402 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536345    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 12:54:12.542402 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536348    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.536351    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536425    2557 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536432    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536440    2557 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536447    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536453    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536458    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536465    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536469    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536472    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536475    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536479    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536482    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536487    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536490    2557 flags.go:64] FLAG: --cgroup-root=""
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536493    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536496    2557 flags.go:64] FLAG: --client-ca-file=""
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536500    2557 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536503    2557 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536508    2557 flags.go:64] FLAG: --cluster-domain=""
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536510    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536513    2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536516    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 12:54:12.542882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536520    2557 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536523    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536526    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536529    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536533    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536536    2557 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536539    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536542    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536545    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536548    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536552    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536555    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536558    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536561    2557 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536564    2557 flags.go:64] FLAG: --enable-server="true"
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536567    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536572    2557 flags.go:64] FLAG: --event-burst="100"
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536575    2557 flags.go:64] FLAG: --event-qps="50"
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536578    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536581    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536584    2557 flags.go:64] FLAG: --eviction-hard=""
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536587    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536592    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536595    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536598    2557 flags.go:64] FLAG: --eviction-soft=""
Jul 22 12:54:12.543472 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536602    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536606    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536610    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536613    2557 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536616    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536619    2557 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536622    2557 flags.go:64] FLAG: --feature-gates=""
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536626    2557 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536629    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536631    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536635    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536638    2557 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536641    2557 flags.go:64] FLAG: --help="false"
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536644    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-141-162.ec2.internal"
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536647    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536650    2557 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536653    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536656    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536660    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536663    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536665    2557 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536668    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536671    2557 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 12:54:12.544132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536674    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536677    2557 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536680    2557 flags.go:64] FLAG: --kube-reserved=""
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536683    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536686    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536689    2557 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536693    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536696    2557 flags.go:64] FLAG: --lock-file=""
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536699    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536703    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536720    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536727    2557 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536731    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536734    2557 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536737    2557 flags.go:64] FLAG: --logging-format="text"
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536740    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536743    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536746    2557 flags.go:64] FLAG: --manifest-url=""
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536749    2557 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536753    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536756    2557 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536761    2557 flags.go:64] FLAG: --max-pods="110"
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536764    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536767    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536770    2557 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 12:54:12.544691 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536773    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536776    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536779    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536782    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536791    2557 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536794    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536797    2557 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536800    2557 flags.go:64] FLAG: --pod-cidr=""
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536802    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536808    2557 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536811    2557 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536814    2557 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536817    2557 flags.go:64] FLAG: --port="10250"
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536820    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536824    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f79b5d6e29c9a108"
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536827    2557 flags.go:64] FLAG: --qos-reserved=""
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536832    2557 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536835    2557 flags.go:64] FLAG: --register-node="true"
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536838    2557 flags.go:64] FLAG: --register-with-taints=""
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536842    2557 flags.go:64] FLAG: --registry-burst="10"
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536845    2557 flags.go:64] FLAG: --registry-qps="5"
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536848    2557 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536851    2557 flags.go:64] FLAG: --reserved-memory=""
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536855    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536858    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 12:54:12.545321 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536861    2557 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536864    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536866    2557 flags.go:64] FLAG: --runonce="false"
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536869    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536872    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536876    2557 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536879    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536881    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536884    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536887    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536890    2557 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536893    2557 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536896    2557 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536899    2557 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536902    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536905    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536908    2557 flags.go:64] FLAG: --system-cgroups=""
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536911    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536916    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536918    2557 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536921    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536926    2557 flags.go:64] FLAG: --tls-min-version=""
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536929    2557 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536932    2557 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536935    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 12:54:12.546008 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536938    2557 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 12:54:12.546635 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536941    2557 flags.go:64] FLAG: --v="2"
Jul 22 12:54:12.546635 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536945    2557 flags.go:64] FLAG: --version="false"
Jul 22 12:54:12.546635 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536950    2557 flags.go:64] FLAG: --vmodule=""
Jul 22 12:54:12.546635 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536953    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 12:54:12.546635 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.536957    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 12:54:12.546635 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538020    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 12:54:12.546635 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538039    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 12:54:12.546635 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538045    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 12:54:12.546635 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538049    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 12:54:12.546635 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538053    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 12:54:12.546635 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538058    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 12:54:12.546635 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538063    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 12:54:12.546635 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538067    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 12:54:12.546635 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538071    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 12:54:12.546635 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538076    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 12:54:12.546635 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538086    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 12:54:12.546635 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538090    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 12:54:12.546635 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538095    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 12:54:12.546635 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538100    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 12:54:12.546635 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538104    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 12:54:12.546635 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538108    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 12:54:12.546635 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538112    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 12:54:12.547201 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538116    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 12:54:12.547201 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538120    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 12:54:12.547201 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538125    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 12:54:12.547201 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538129    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 12:54:12.547201 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538133    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 12:54:12.547201 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538145    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 12:54:12.547201 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538151    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 12:54:12.547201 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538156    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 12:54:12.547201 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538161    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 12:54:12.547201 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538168    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 12:54:12.547201 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538175    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 12:54:12.547201 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538180    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 12:54:12.547201 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538186    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 12:54:12.547201 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538193    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 12:54:12.547201 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538198    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 12:54:12.547201 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538203    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 12:54:12.547201 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538210    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 12:54:12.547201 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538219    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 12:54:12.547201 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538224    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 12:54:12.547680 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538228    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 12:54:12.547680 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538232    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 12:54:12.547680 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538237    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 12:54:12.547680 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538241    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 12:54:12.547680 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538246    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 12:54:12.547680 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538250    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 12:54:12.547680 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538255    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 12:54:12.547680 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538259    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 12:54:12.547680 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538263    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 12:54:12.547680 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538268    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 12:54:12.547680 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538272    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 12:54:12.547680 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538282    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 12:54:12.547680 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538286    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 12:54:12.547680 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538290    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 12:54:12.547680 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538294    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 12:54:12.547680 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538298    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 12:54:12.547680 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538303    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 12:54:12.547680 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538307    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 12:54:12.547680 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538312    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 12:54:12.547680 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538316    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 12:54:12.548179 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538320    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 12:54:12.548179 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538324    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 12:54:12.548179 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538329    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 12:54:12.548179 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538337    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 12:54:12.548179 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538341    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 12:54:12.548179 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538345    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 12:54:12.548179 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538349    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 12:54:12.548179 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538353    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 12:54:12.548179 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538358    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 12:54:12.548179 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538363    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 12:54:12.548179 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538369    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 12:54:12.548179 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538373    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 12:54:12.548179 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538377    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 12:54:12.548179 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538382    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 12:54:12.548179 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538386    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 12:54:12.548179 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538390    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 12:54:12.548179 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538399    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 12:54:12.548179 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538404    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 12:54:12.548179 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538408    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 12:54:12.548627 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538412    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 12:54:12.548627 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538416    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 12:54:12.548627 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538421    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 12:54:12.548627 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538425    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 12:54:12.548627 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538429    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 12:54:12.548627 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538433    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 12:54:12.548627 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538437    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 12:54:12.548627 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538441    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 12:54:12.548627 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538446    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 12:54:12.548627 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538450    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 12:54:12.548627 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538459    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 12:54:12.548627 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538463    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 12:54:12.548627 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538467    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 12:54:12.548627 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538472    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 12:54:12.548627 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538476    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 12:54:12.548627 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538480    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 12:54:12.548627 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538484    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 12:54:12.548627 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538489    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 12:54:12.548627 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538493    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 12:54:12.549104 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538497    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 12:54:12.549104 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538502    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 12:54:12.549104 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538506    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 12:54:12.549104 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538520    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 12:54:12.549104 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.538525    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 12:54:12.549104 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.539092    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 12:54:12.549104 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.547293    2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 12:54:12.549104 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.547311    2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 12:54:12.549104 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.547950    2557 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 12:54:12.549104 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.547958    2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 12:54:12.549104 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548019    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 12:54:12.549104 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548025    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 12:54:12.549104 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548029    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 12:54:12.549104 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548032    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 12:54:12.549104 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548035    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 12:54:12.549477 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548038    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 12:54:12.549477 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548042    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 12:54:12.549477 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548044    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 12:54:12.549477 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548047    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 12:54:12.549477 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548051    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 12:54:12.549477 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548054    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 12:54:12.549477 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548056    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 12:54:12.549477 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548059    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 12:54:12.549477 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548062    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 12:54:12.549477 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548064    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 12:54:12.549477 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548067    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 12:54:12.549477 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548070    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 12:54:12.549477 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548072    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 12:54:12.549477 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548075    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 12:54:12.549477 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548078    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 12:54:12.549477 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548082    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 12:54:12.549477 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548085    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 12:54:12.549477 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548087    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 12:54:12.549477 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548090    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 12:54:12.549477 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548092    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 12:54:12.549976 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548095    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 12:54:12.549976 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548098    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 12:54:12.549976 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548101    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 12:54:12.549976 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548103    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 12:54:12.549976 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548106    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 12:54:12.549976 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548110    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 12:54:12.549976 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548113    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 12:54:12.549976 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548115    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 12:54:12.549976 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548119    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 12:54:12.549976 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548121    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 12:54:12.549976 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548126    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 12:54:12.549976 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548130    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 12:54:12.549976 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548133    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 12:54:12.549976 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548137    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 12:54:12.549976 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548140    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 12:54:12.549976 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548144    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 12:54:12.549976 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548148    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 12:54:12.549976 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548151    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 12:54:12.550399 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548154    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 12:54:12.550399 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548156    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 12:54:12.550399 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548159    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 12:54:12.550399 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548162    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 12:54:12.550399 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548164    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 12:54:12.550399 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548167    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 12:54:12.550399 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548170    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 12:54:12.550399 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548173    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 12:54:12.550399 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548175    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 12:54:12.550399 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548179    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 12:54:12.550399 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548182    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 12:54:12.550399 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548184    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 12:54:12.550399 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548187    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 12:54:12.550399 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548190    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 12:54:12.550399 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548192    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 12:54:12.550399 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548195    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 12:54:12.550399 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548198    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 12:54:12.550399 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548200    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 12:54:12.550399 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548203    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 12:54:12.550399 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548206    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 12:54:12.550898 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548208    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 12:54:12.550898 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548211    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 12:54:12.550898 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548214    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 12:54:12.550898 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548216    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 12:54:12.550898 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548219    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 12:54:12.550898 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548222    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 12:54:12.550898 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548225    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 12:54:12.550898 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548227    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 12:54:12.550898 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548230    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 12:54:12.550898 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548233    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 12:54:12.550898 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548236    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 12:54:12.550898 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548239    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 12:54:12.550898 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548241    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 12:54:12.550898 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548244    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 12:54:12.550898 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548247    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 12:54:12.550898 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548249    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 12:54:12.550898 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548252    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 12:54:12.550898 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548254    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 12:54:12.550898 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548258    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 12:54:12.550898 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548260    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 12:54:12.551370 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548263    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 12:54:12.551370 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548265    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 12:54:12.551370 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548268    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 12:54:12.551370 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548271    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 12:54:12.551370 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548274    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 12:54:12.551370 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548276    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 12:54:12.551370 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548279    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 12:54:12.551370 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548281    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 12:54:12.551370 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548284    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 12:54:12.551370 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548287    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 12:54:12.551370 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548289    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 12:54:12.551370 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548292    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 12:54:12.551370 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548295    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 12:54:12.551370 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548297    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 12:54:12.551370 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548300    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 12:54:12.551370 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548302    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 12:54:12.551771 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.548308    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 12:54:12.551771 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548430    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 12:54:12.551771 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548435    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 12:54:12.551771 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548438    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 12:54:12.551771 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548441    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 12:54:12.551771 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548444    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 12:54:12.551771 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548447    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 12:54:12.551771 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548449    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 12:54:12.551771 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548452    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 12:54:12.551771 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548454    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 12:54:12.551771 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548457    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 12:54:12.551771 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548460    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 12:54:12.551771 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548463    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 12:54:12.551771 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548466    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 12:54:12.551771 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548468    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 12:54:12.552131 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548471    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 12:54:12.552131 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548473    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 12:54:12.552131 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548476    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 12:54:12.552131 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548479    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 12:54:12.552131 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548481    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 12:54:12.552131 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548484    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 12:54:12.552131 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548486    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 12:54:12.552131 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548489    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 12:54:12.552131 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548492    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 12:54:12.552131 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548495    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 12:54:12.552131 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548498    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 12:54:12.552131 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548501    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 12:54:12.552131 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548503    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 12:54:12.552131 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548506    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 12:54:12.552131 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548509    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 12:54:12.552131 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548511    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 12:54:12.552131 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548514    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 12:54:12.552131 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548516    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 12:54:12.552131 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548519    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 12:54:12.552131 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548522    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 12:54:12.552608 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548524    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 12:54:12.552608 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548527    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 12:54:12.552608 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548529    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 12:54:12.552608 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548532    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 12:54:12.552608 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548535    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 12:54:12.552608 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548537    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 12:54:12.552608 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548540    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 12:54:12.552608 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548543    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 12:54:12.552608 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548545    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 12:54:12.552608 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548549    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 12:54:12.552608 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548553    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 12:54:12.552608 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548556    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 12:54:12.552608 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548559    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 12:54:12.552608 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548562    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 12:54:12.552608 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548565    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 12:54:12.552608 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548568    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 12:54:12.552608 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548571    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 12:54:12.552608 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548574    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 12:54:12.552608 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548576    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 12:54:12.553069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548579    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 12:54:12.553069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548582    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 12:54:12.553069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548585    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 12:54:12.553069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548588    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 12:54:12.553069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548591    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 12:54:12.553069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548594    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 12:54:12.553069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548596    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 12:54:12.553069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548600    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 12:54:12.553069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548603    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 12:54:12.553069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548606    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 12:54:12.553069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548608    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 12:54:12.553069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548611    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 12:54:12.553069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548614    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 12:54:12.553069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548616    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 12:54:12.553069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548619    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 12:54:12.553069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548621    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 12:54:12.553069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548624    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 12:54:12.553069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548627    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 12:54:12.553069 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548629    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 12:54:12.553507 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548632    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 12:54:12.553507 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548635    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 12:54:12.553507 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548639    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 12:54:12.553507 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548642    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 12:54:12.553507 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548646    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 12:54:12.553507 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548649    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 12:54:12.553507 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548652    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 12:54:12.553507 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548655    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 12:54:12.553507 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548657    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 12:54:12.553507 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548660    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 12:54:12.553507 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548663    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 12:54:12.553507 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548665    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 12:54:12.553507 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548668    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 12:54:12.553507 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548670    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 12:54:12.553507 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548673    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 12:54:12.553507 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548676    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 12:54:12.553507 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548678    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 12:54:12.553507 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548681    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 12:54:12.553507 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548684    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 12:54:12.553969 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548686    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 12:54:12.553969 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548688    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 12:54:12.553969 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548691    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 12:54:12.553969 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548694    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 12:54:12.553969 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548696    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 12:54:12.553969 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548699    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 12:54:12.553969 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548701    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 12:54:12.553969 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:12.548704    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 12:54:12.553969 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.548721    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 12:54:12.553969 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.548860    2557 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 12:54:12.553969 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.552463    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 12:54:12.553969 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.553875    2557 server.go:1019] "Starting client certificate rotation"
Jul 22 12:54:12.554267 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.553980    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 12:54:12.554267 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.554011    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 12:54:12.556502 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.556487    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 12:54:12.561194 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.561172    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 12:54:12.572400 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.572379    2557 log.go:25] "Validated CRI v1 runtime API"
Jul 22 12:54:12.574628 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.574611    2557 log.go:25] "Validated CRI v1 image API"
Jul 22 12:54:12.575496 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.575477    2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 12:54:12.580264 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.580239    2557 fs.go:135] Filesystem UUIDs: map[6feb2c10-e9ea-458c-bc42-f55a3061aca0:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e2ffa363-8b4d-42e4-88e5-8c7cb5f2507a:/dev/nvme0n1p3]
Jul 22 12:54:12.580343 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.580263    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 12:54:12.582294 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.582275    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 12:54:12.585406 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.585272    2557 manager.go:216] Machine: {Timestamp:2026-07-22 12:54:12.583993524 +0000 UTC m=+0.348645141 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100881 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2008c1eb2f0b9fc1425762d05dfad4 SystemUUID:ec2008c1-eb2f-0b9f-c142-5762d05dfad4 BootID:0e9057a8-973d-40a8-8f19-4595d9642263 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:64:1d:7f:92:19 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:64:1d:7f:92:19 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:19:e8:3e:30:03 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 12:54:12.585406 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.585401    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 12:54:12.585526 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.585480    2557 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 12:54:12.588753 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.588726    2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 12:54:12.588885 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.588756    2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-162.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 12:54:12.589553 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.589544    2557 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 12:54:12.589583 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.589555    2557 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 12:54:12.589583 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.589562    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 12:54:12.590116 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.590106    2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 12:54:12.591740 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.591730    2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 12:54:12.595058 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.595045    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 12:54:12.595184 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.595174    2557 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 12:54:12.595227 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.595204    2557 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 12:54:12.595227 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.595214    2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 12:54:12.595227 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.595225    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 12:54:12.595328 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.595235    2557 kubelet.go:398] "Adding apiserver pod source"
Jul 22 12:54:12.595328 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.595245    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 12:54:12.595601 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.595590    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 12:54:12.595633 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.595610    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 12:54:12.598697 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.598679    2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 12:54:12.600759 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.600744    2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 12:54:12.600838 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.600775    2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 12:54:12.601639 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.601623    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lltms"
Jul 22 12:54:12.601997 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.601985    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 12:54:12.602030 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.602002    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 12:54:12.602030 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.602009    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 12:54:12.602030 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.602014    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 12:54:12.602030 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.602023    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 12:54:12.602030 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.602029    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 12:54:12.602162 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.602039    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 12:54:12.602162 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.602047    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 12:54:12.602162 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.602057    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 12:54:12.602162 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.602065    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 12:54:12.602162 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.602079    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 12:54:12.602162 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.602085    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 12:54:12.602868 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.602857    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 12:54:12.602938 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.602875    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 12:54:12.606135 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.606116    2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-162.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 12:54:12.606231 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:12.606150    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 12:54:12.606297 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.606258    2557 server.go:1268] "Started kubelet"
Jul 22 12:54:12.606344 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.606298    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 12:54:12.606483 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.606389    2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 12:54:12.606521 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:12.606249    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 12:54:12.606737 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.606691    2557 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 12:54:12.607233 ip-10-0-141-162 systemd[1]: Started Kubernetes Kubelet.
Jul 22 12:54:12.608556 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.608542    2557 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 12:54:12.609183 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.609147    2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 12:54:12.609259 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.609171    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lltms"
Jul 22 12:54:12.614378 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:12.614359    2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 12:54:12.615334 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:12.611123    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-162.ec2.internal.18c49dcc2d67af49  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-162.ec2.internal,UID:ip-10-0-141-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-162.ec2.internal,},FirstTimestamp:2026-07-22 12:54:12.606218057 +0000 UTC m=+0.370869676,LastTimestamp:2026-07-22 12:54:12.606218057 +0000 UTC m=+0.370869676,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-162.ec2.internal,}"
Jul 22 12:54:12.618003 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.617981    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 12:54:12.618003 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.618000    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 12:54:12.618153 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:12.618085    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found"
Jul 22 12:54:12.618682 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.618657    2557 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 12:54:12.618793 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.618702    2557 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 12:54:12.618793 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.618658    2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 12:54:12.618895 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.618834    2557 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 12:54:12.618895 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.618842    2557 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 12:54:12.618982 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.618928    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 12:54:12.618982 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.618941    2557 factory.go:55] Registering systemd factory
Jul 22 12:54:12.618982 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.618950    2557 factory.go:223] Registration of the systemd container factory successfully
Jul 22 12:54:12.619210 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.619191    2557 factory.go:153] Registering CRI-O factory
Jul 22 12:54:12.619210 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.619210    2557 factory.go:223] Registration of the crio container factory successfully
Jul 22 12:54:12.619346 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.619231    2557 factory.go:103] Registering Raw factory
Jul 22 12:54:12.619346 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.619244    2557 manager.go:1196] Started watching for new ooms in manager
Jul 22 12:54:12.619567 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:12.619542    2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 22 12:54:12.619674 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.619663    2557 manager.go:349] Starting recovery of all containers
Jul 22 12:54:12.619786 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:12.619761    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 22 12:54:12.629783 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.629720    2557 manager.go:354] Recovery completed
Jul 22 12:54:12.631137 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:12.631115    2557 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 22 12:54:12.634130 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.634117    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 12:54:12.636335 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.636319    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 12:54:12.636409 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.636352    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 12:54:12.636409 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.636372    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientPID"
Jul 22 12:54:12.636951 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.636937    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 12:54:12.636951 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.636949    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 12:54:12.637064 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.636966    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 12:54:12.637064 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.636978    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 12:54:12.637904 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.637889    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 12:54:12.637959 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.637916    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 12:54:12.637959 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.637926    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientPID"
Jul 22 12:54:12.638323 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.638312    2557 policy_none.go:49] "None policy: Start"
Jul 22 12:54:12.638353 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.638330    2557 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 12:54:12.638353 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.638342    2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 12:54:12.639590 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.639580    2557 policy_none.go:47] "Start"
Jul 22 12:54:12.672464 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.672293    2557 manager.go:337] "Starting Device Plugin manager"
Jul 22 12:54:12.672583 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:12.672493    2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 12:54:12.672583 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.672509    2557 server.go:87] "Starting device plugin registration server"
Jul 22 12:54:12.672779 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.672767    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 12:54:12.672837 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.672781    2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 12:54:12.672887 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.672860    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 12:54:12.672952 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.672934    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 12:54:12.672952 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.672949    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 12:54:12.673524 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:12.673491    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 12:54:12.673598 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:12.673553    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-162.ec2.internal\" not found"
Jul 22 12:54:12.773122 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.773084    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 12:54:12.774357 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.774150    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 12:54:12.774357 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.774201    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 12:54:12.774357 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.774217    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientPID"
Jul 22 12:54:12.774357 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.774251    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-162.ec2.internal"
Jul 22 12:54:12.789385 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.789355    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-162.ec2.internal"
Jul 22 12:54:12.789385 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:12.789385    2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-162.ec2.internal\": node \"ip-10-0-141-162.ec2.internal\" not found"
Jul 22 12:54:12.800856 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.800824    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 12:54:12.802132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.802114    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 12:54:12.802262 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.802152    2557 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 12:54:12.802262 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.802176    2557 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 12:54:12.802262 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:12.802210    2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 12:54:12.810722 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.810693    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 12:54:12.840942 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:12.840910    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found"
Jul 22 12:54:12.903180 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.903115    2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal"]
Jul 22 12:54:12.903264 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.903189    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 12:54:12.905183 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.905156    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 12:54:12.905303 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.905193    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 12:54:12.905303 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.905209    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientPID"
Jul 22 12:54:12.906817 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.906801    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 12:54:12.906945 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.906930    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal"
Jul 22 12:54:12.906992 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.906966    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 12:54:12.907576 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.907560    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 12:54:12.907637 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.907560    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 12:54:12.907637 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.907593    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 12:54:12.907637 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.907605    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientPID"
Jul 22 12:54:12.907637 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.907613    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 12:54:12.907637 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.907625    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientPID"
Jul 22 12:54:12.908947 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.908933    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal"
Jul 22 12:54:12.909001 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.908958    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 12:54:12.909981 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.909965    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 12:54:12.910073 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.910024    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 12:54:12.910073 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.910041    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeHasSufficientPID"
Jul 22 12:54:12.920546 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.920529    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c8c76d9b2e66e247a9ed607844729dc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal\" (UID: \"6c8c76d9b2e66e247a9ed607844729dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal"
Jul 22 12:54:12.920627 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.920551    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a6e375ecd0701850088a8ac8d4843555-config\") pod \"kube-apiserver-proxy-ip-10-0-141-162.ec2.internal\" (UID: \"a6e375ecd0701850088a8ac8d4843555\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal"
Jul 22 12:54:12.920627 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:12.920576    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6c8c76d9b2e66e247a9ed607844729dc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal\" (UID: \"6c8c76d9b2e66e247a9ed607844729dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal"
Jul 22 12:54:12.934348 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:12.934326    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-162.ec2.internal\" not found" node="ip-10-0-141-162.ec2.internal"
Jul 22 12:54:12.937850 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:12.937829    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-162.ec2.internal\" not found" node="ip-10-0-141-162.ec2.internal"
Jul 22 12:54:12.941818 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:12.941803    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found"
Jul 22 12:54:13.021130 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:13.021101    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6c8c76d9b2e66e247a9ed607844729dc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal\" (UID: \"6c8c76d9b2e66e247a9ed607844729dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal"
Jul 22 12:54:13.021130 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:13.021131    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c8c76d9b2e66e247a9ed607844729dc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal\" (UID: \"6c8c76d9b2e66e247a9ed607844729dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal"
Jul 22 12:54:13.021322 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:13.021151    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a6e375ecd0701850088a8ac8d4843555-config\") pod \"kube-apiserver-proxy-ip-10-0-141-162.ec2.internal\" (UID: \"a6e375ecd0701850088a8ac8d4843555\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal"
Jul 22 12:54:13.021322 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:13.021194    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a6e375ecd0701850088a8ac8d4843555-config\") pod \"kube-apiserver-proxy-ip-10-0-141-162.ec2.internal\" (UID: \"a6e375ecd0701850088a8ac8d4843555\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal"
Jul 22 12:54:13.021322 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:13.021215    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6c8c76d9b2e66e247a9ed607844729dc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal\" (UID: \"6c8c76d9b2e66e247a9ed607844729dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal"
Jul 22 12:54:13.021322 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:13.021218    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c8c76d9b2e66e247a9ed607844729dc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal\" (UID: \"6c8c76d9b2e66e247a9ed607844729dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal"
Jul 22 12:54:13.042114 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:13.042080    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found"
Jul 22 12:54:13.142222 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:13.142177    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found"
Jul 22 12:54:13.238807 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:13.238728    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal"
Jul 22 12:54:13.241124 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:13.241109    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal"
Jul 22 12:54:13.242849 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:13.242735    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found"
Jul 22 12:54:13.343183 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:13.343140    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found"
Jul 22 12:54:13.443719 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:13.443684    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found"
Jul 22 12:54:13.544227 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:13.544147    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found"
Jul 22 12:54:13.553333 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:13.553305    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 12:54:13.553474 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:13.553455    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 12:54:13.616627 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:13.616595    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 12:49:12 +0000 UTC" deadline="2028-03-29 05:44:33.540039328 +0000 UTC"
Jul 22 12:54:13.616627 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:13.616621    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14776h50m19.923421135s"
Jul 22 12:54:13.644898 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:13.644875    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found"
Jul 22 12:54:13.745551 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:13.745519    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found"
Jul 22 12:54:13.762651 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:13.762624    2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 12:54:13.846240 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:13.846175    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found"
Jul 22 12:54:13.865264 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:13.865242    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 12:54:13.870849 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:13.870822    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6e375ecd0701850088a8ac8d4843555.slice/crio-47521d7fefd6a2b0d5671c931bebb79ac343fc128852f80c5e9ef5509e64d744 WatchSource:0}: Error finding container 47521d7fefd6a2b0d5671c931bebb79ac343fc128852f80c5e9ef5509e64d744: Status 404 returned error can't find the container with id 47521d7fefd6a2b0d5671c931bebb79ac343fc128852f80c5e9ef5509e64d744
Jul 22 12:54:13.871279 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:13.871264    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c8c76d9b2e66e247a9ed607844729dc.slice/crio-ef1d1de88ac2b867ffd5ff3893514a4ead1492ee851db321c1a8f804405f0a49 WatchSource:0}: Error finding container ef1d1de88ac2b867ffd5ff3893514a4ead1492ee851db321c1a8f804405f0a49: Status 404 returned error can't find the container with id ef1d1de88ac2b867ffd5ff3893514a4ead1492ee851db321c1a8f804405f0a49
Jul 22 12:54:13.876089 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:13.876075    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 12:54:13.947201 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:13.947157    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found"
Jul 22 12:54:14.047684 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:14.047663    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found"
Jul 22 12:54:14.148422 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:14.148402    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-162.ec2.internal\" not found"
Jul 22 12:54:14.188487 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.188457    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 12:54:14.219014 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.218987    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal"
Jul 22 12:54:14.229805 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.229783    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 12:54:14.230727 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.230699    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal"
Jul 22 12:54:14.239566 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.239547    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 12:54:14.596347 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.596260    2557 apiserver.go:52] "Watching apiserver"
Jul 22 12:54:14.604175 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.604151    2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 12:54:14.605508 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.605482    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-flrmb","openshift-dns/node-resolver-bhhst","openshift-multus/multus-tmmtf","openshift-network-operator/iptables-alerter-snfzs","openshift-ovn-kubernetes/ovnkube-node-crfsb","kube-system/global-pull-secret-syncer-2hjdp","kube-system/konnectivity-agent-lsw8h","kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal","openshift-image-registry/node-ca-wzfng","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal","openshift-multus/multus-additional-cni-plugins-kkn5g","openshift-multus/network-metrics-daemon-k7tvv","openshift-network-diagnostics/network-check-target-m4kh6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"]
Jul 22 12:54:14.607127 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.607106    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lsw8h"
Jul 22 12:54:14.608543 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.608517    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:14.608671 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:14.608597    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4kh6" podUID="c1cf4f26-18a3-4496-8637-9e255bc1540e"
Jul 22 12:54:14.610155 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.609743    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.611260 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.610851    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-snfzs"
Jul 22 12:54:14.612042 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.611815    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 12:54:14.612938 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.612408    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-h29fb\""
Jul 22 12:54:14.612938 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.612554    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 12:54:14.612938 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.612414    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 12:54:14.614673 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.613581    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 12:54:14.614673 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.613653    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 12:54:14.614673 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.614014    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4gk7r\""
Jul 22 12:54:14.614673 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.614020    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qjg7b\""
Jul 22 12:54:14.614673 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.614070    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 12:54:14.615030 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.614890    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 12:54:14.615194 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.615176    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 12:54:14.615256 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.615225    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 12:54:14.616324 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.615937    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.617732 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.617700    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k8f69\""
Jul 22 12:54:14.618337 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.618320    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:14.618521 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:14.618497    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjdp" podUID="8acd9f4a-3905-4940-9304-9709d2917fcf"
Jul 22 12:54:14.618623 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.618332    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 12:54:14.618842 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.618823    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 12:54:14.619960 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.619939    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 12:54:14.619960 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.619959    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 12:54:14.620109 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.620000    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 12:54:14.620109 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.619941    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 12:54:14.620258 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.620241    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 12:54:14.620349 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.620330    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wzfng"
Jul 22 12:54:14.621952 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.621933    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 12:54:14.622621 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.622602    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.623188 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.623168    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 12:54:14.623620 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.623602    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 12:54:14.623856 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.623831    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9tcrr\""
Jul 22 12:54:14.624105 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.624092    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bhhst"
Jul 22 12:54:14.624556 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.624541    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 12:54:14.624634 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.624620    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 12:54:14.624836 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.624819    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gb9p5\""
Jul 22 12:54:14.625759 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.625743    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.626076 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.626032    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 12:54:14.626347 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.626312    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 12:54:14.626423 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.626411    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-68tlv\""
Jul 22 12:54:14.627542 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.627521    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 12:54:14.627764 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.627746    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.628590 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.628569    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:14.628667 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:14.628634    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7tvv" podUID="de51b06a-8a46-462a-8e91-e96529e7d461"
Jul 22 12:54:14.630951 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.630937    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 12:54:14.631670 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.631343    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 12:54:14.631670 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.631397    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5bjlv\""
Jul 22 12:54:14.631670 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.631482    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 12:54:14.631670 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.631541    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 12:54:14.631670 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.631549    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-htm7z\""
Jul 22 12:54:14.633285 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.633259    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-host-var-lib-kubelet\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.633371 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.633309    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f7c11e2c-eacc-4764-9ab9-3de705c894ee-multus-daemon-config\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.633371 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.633334    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-host-run-multus-certs\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.633371 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.633357    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-etc-openvswitch\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.633523 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.633381    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hckbg\" (UniqueName: \"kubernetes.io/projected/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-kube-api-access-hckbg\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.633523 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.633404    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8acd9f4a-3905-4940-9304-9709d2917fcf-dbus\") pod \"global-pull-secret-syncer-2hjdp\" (UID: \"8acd9f4a-3905-4940-9304-9709d2917fcf\") " pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:14.633523 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.633425    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b7614f14-9ad0-46fa-83a9-2fa3293b9a37-host\") pod \"node-ca-wzfng\" (UID: \"b7614f14-9ad0-46fa-83a9-2fa3293b9a37\") " pod="openshift-image-registry/node-ca-wzfng"
Jul 22 12:54:14.633666 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.633447    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-os-release\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.633731 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.633666    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2t5b\" (UniqueName: \"kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b\") pod \"network-check-target-m4kh6\" (UID: \"c1cf4f26-18a3-4496-8637-9e255bc1540e\") " pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:14.633731 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.633721    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-host-kubelet\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.633836 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.633732    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 12:54:14.633836 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.633748    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-run-systemd\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.633836 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.633775    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-host-run-ovn-kubernetes\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.633836 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.633798    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-host-cni-bin\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.633836 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.633834    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-ovnkube-config\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.634065 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.633849    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret\") pod \"global-pull-secret-syncer-2hjdp\" (UID: \"8acd9f4a-3905-4940-9304-9709d2917fcf\") " pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:14.634065 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.633863    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cdb9822-8e98-4721-8771-20772d77220c-host-slash\") pod \"iptables-alerter-snfzs\" (UID: \"8cdb9822-8e98-4721-8771-20772d77220c\") " pod="openshift-network-operator/iptables-alerter-snfzs"
Jul 22 12:54:14.634065 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.633878    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd75730f-ceb2-4726-9562-d25606150f76-konnectivity-ca\") pod \"konnectivity-agent-lsw8h\" (UID: \"fd75730f-ceb2-4726-9562-d25606150f76\") " pod="kube-system/konnectivity-agent-lsw8h"
Jul 22 12:54:14.634065 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.633900    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-var-lib-openvswitch\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.634065 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.633939    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-log-socket\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.634065 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.633982    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8acd9f4a-3905-4940-9304-9709d2917fcf-kubelet-config\") pod \"global-pull-secret-syncer-2hjdp\" (UID: \"8acd9f4a-3905-4940-9304-9709d2917fcf\") " pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:14.634065 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634033    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-multus-socket-dir-parent\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.634383 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634065    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-hostroot\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.634383 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634106    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-etc-kubernetes\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.634383 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634129    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8cdb9822-8e98-4721-8771-20772d77220c-iptables-alerter-script\") pod \"iptables-alerter-snfzs\" (UID: \"8cdb9822-8e98-4721-8771-20772d77220c\") " pod="openshift-network-operator/iptables-alerter-snfzs"
Jul 22 12:54:14.634383 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634153    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-systemd-units\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.634383 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634175    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-run-openvswitch\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.634383 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634197    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-ovnkube-script-lib\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.634383 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634225    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-host-var-lib-cni-multus\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.634383 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634247    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjvcz\" (UniqueName: \"kubernetes.io/projected/f7c11e2c-eacc-4764-9ab9-3de705c894ee-kube-api-access-mjvcz\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.634383 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634282    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf7vk\" (UniqueName: \"kubernetes.io/projected/8cdb9822-8e98-4721-8771-20772d77220c-kube-api-access-xf7vk\") pod \"iptables-alerter-snfzs\" (UID: \"8cdb9822-8e98-4721-8771-20772d77220c\") " pod="openshift-network-operator/iptables-alerter-snfzs"
Jul 22 12:54:14.634383 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634309    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-host-run-netns\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.634383 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634329    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-node-log\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.634383 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634360    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b7614f14-9ad0-46fa-83a9-2fa3293b9a37-serviceca\") pod \"node-ca-wzfng\" (UID: \"b7614f14-9ad0-46fa-83a9-2fa3293b9a37\") " pod="openshift-image-registry/node-ca-wzfng"
Jul 22 12:54:14.634383 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634382    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-host-run-k8s-cni-cncf-io\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.634993 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634412    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-host-var-lib-cni-bin\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.634993 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634443    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-multus-conf-dir\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.634993 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634472    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-ovn-node-metrics-cert\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.634993 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634502    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-host-run-netns\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.634993 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634546    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd75730f-ceb2-4726-9562-d25606150f76-agent-certs\") pod \"konnectivity-agent-lsw8h\" (UID: \"fd75730f-ceb2-4726-9562-d25606150f76\") " pod="kube-system/konnectivity-agent-lsw8h"
Jul 22 12:54:14.634993 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634568    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-host-slash\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.634993 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634593    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-run-ovn\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.634993 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634620    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-host-cni-netd\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.634993 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634644    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.634993 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634669    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg7fm\" (UniqueName: \"kubernetes.io/projected/b7614f14-9ad0-46fa-83a9-2fa3293b9a37-kube-api-access-sg7fm\") pod \"node-ca-wzfng\" (UID: \"b7614f14-9ad0-46fa-83a9-2fa3293b9a37\") " pod="openshift-image-registry/node-ca-wzfng"
Jul 22 12:54:14.634993 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634690    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-system-cni-dir\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.634993 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634738    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-env-overrides\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.634993 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634814    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-multus-cni-dir\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.634993 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634835    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-cnibin\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.634993 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.634860    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7c11e2c-eacc-4764-9ab9-3de705c894ee-cni-binary-copy\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.652823 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.652802    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-prrcd"
Jul 22 12:54:14.663853 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.663836    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-prrcd"
Jul 22 12:54:14.720429 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.720393    2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 12:54:14.735157 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735120    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd75730f-ceb2-4726-9562-d25606150f76-agent-certs\") pod \"konnectivity-agent-lsw8h\" (UID: \"fd75730f-ceb2-4726-9562-d25606150f76\") " pod="kube-system/konnectivity-agent-lsw8h"
Jul 22 12:54:14.735303 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735165    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-host-slash\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.735303 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735193    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.735303 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735218    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg7fm\" (UniqueName: \"kubernetes.io/projected/b7614f14-9ad0-46fa-83a9-2fa3293b9a37-kube-api-access-sg7fm\") pod \"node-ca-wzfng\" (UID: \"b7614f14-9ad0-46fa-83a9-2fa3293b9a37\") " pod="openshift-image-registry/node-ca-wzfng"
Jul 22 12:54:14.735303 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735241    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-system-cni-dir\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.735303 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735260    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7c11e2c-eacc-4764-9ab9-3de705c894ee-cni-binary-copy\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.735303 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735274    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f7c11e2c-eacc-4764-9ab9-3de705c894ee-multus-daemon-config\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.735303 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735292    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7be0f0fb-738c-4431-a268-fb2944dfafd8-device-dir\") pod \"aws-ebs-csi-driver-node-x8vpv\" (UID: \"7be0f0fb-738c-4431-a268-fb2944dfafd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.735692 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735310    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7be0f0fb-738c-4431-a268-fb2944dfafd8-etc-selinux\") pod \"aws-ebs-csi-driver-node-x8vpv\" (UID: \"7be0f0fb-738c-4431-a268-fb2944dfafd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.735692 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735329    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hckbg\" (UniqueName: \"kubernetes.io/projected/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-kube-api-access-hckbg\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.735692 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735345    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8acd9f4a-3905-4940-9304-9709d2917fcf-dbus\") pod \"global-pull-secret-syncer-2hjdp\" (UID: \"8acd9f4a-3905-4940-9304-9709d2917fcf\") " pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:14.735692 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735361    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b7614f14-9ad0-46fa-83a9-2fa3293b9a37-host\") pod \"node-ca-wzfng\" (UID: \"b7614f14-9ad0-46fa-83a9-2fa3293b9a37\") " pod="openshift-image-registry/node-ca-wzfng"
Jul 22 12:54:14.735692 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735374    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-sys\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.735692 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735393    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7be0f0fb-738c-4431-a268-fb2944dfafd8-socket-dir\") pod \"aws-ebs-csi-driver-node-x8vpv\" (UID: \"7be0f0fb-738c-4431-a268-fb2944dfafd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.735692 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735418    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-cnibin\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.735692 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735444    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2t5b\" (UniqueName: \"kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b\") pod \"network-check-target-m4kh6\" (UID: \"c1cf4f26-18a3-4496-8637-9e255bc1540e\") " pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:14.735692 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735467    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-host-kubelet\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.735692 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735489    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-run-systemd\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.735692 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735514    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-host-cni-bin\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.735692 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735552    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7be0f0fb-738c-4431-a268-fb2944dfafd8-sys-fs\") pod \"aws-ebs-csi-driver-node-x8vpv\" (UID: \"7be0f0fb-738c-4431-a268-fb2944dfafd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.735692 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735574    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-os-release\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.735692 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735605    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-multus-socket-dir-parent\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.735692 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735640    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-etc-kubernetes\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.735692 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735668    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8cdb9822-8e98-4721-8771-20772d77220c-iptables-alerter-script\") pod \"iptables-alerter-snfzs\" (UID: \"8cdb9822-8e98-4721-8771-20772d77220c\") " pod="openshift-network-operator/iptables-alerter-snfzs"
Jul 22 12:54:14.735692 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735691    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-etc-sysctl-d\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.736502 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735731    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-system-cni-dir\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.736502 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735756    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv7pq\" (UniqueName: \"kubernetes.io/projected/de51b06a-8a46-462a-8e91-e96529e7d461-kube-api-access-dv7pq\") pod \"network-metrics-daemon-k7tvv\" (UID: \"de51b06a-8a46-462a-8e91-e96529e7d461\") " pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:14.736502 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735784    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-systemd-units\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.736502 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735807    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-ovnkube-script-lib\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.736502 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735831    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjvcz\" (UniqueName: \"kubernetes.io/projected/f7c11e2c-eacc-4764-9ab9-3de705c894ee-kube-api-access-mjvcz\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.736502 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735850    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 12:54:14.736502 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736030    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-host-slash\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.736502 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736050    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-host-cni-bin\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.736502 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736047    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7c11e2c-eacc-4764-9ab9-3de705c894ee-cni-binary-copy\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.736502 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736110    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.736502 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736139    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b7614f14-9ad0-46fa-83a9-2fa3293b9a37-host\") pod \"node-ca-wzfng\" (UID: \"b7614f14-9ad0-46fa-83a9-2fa3293b9a37\") " pod="openshift-image-registry/node-ca-wzfng"
Jul 22 12:54:14.736502 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736165    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-host-kubelet\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.736502 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736197    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f7c11e2c-eacc-4764-9ab9-3de705c894ee-multus-daemon-config\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.736502 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736213    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-system-cni-dir\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.736502 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736317    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-systemd-units\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.736502 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736331    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-multus-socket-dir-parent\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.736502 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736333    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8acd9f4a-3905-4940-9304-9709d2917fcf-dbus\") pod \"global-pull-secret-syncer-2hjdp\" (UID: \"8acd9f4a-3905-4940-9304-9709d2917fcf\") " pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:14.736502 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736369    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-etc-kubernetes\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.737369 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.735855    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf7vk\" (UniqueName: \"kubernetes.io/projected/8cdb9822-8e98-4721-8771-20772d77220c-kube-api-access-xf7vk\") pod \"iptables-alerter-snfzs\" (UID: \"8cdb9822-8e98-4721-8771-20772d77220c\") " pod="openshift-network-operator/iptables-alerter-snfzs"
Jul 22 12:54:14.737369 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736423    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-run-systemd\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.737369 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736477    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-host-run-netns\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.737369 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736609    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-node-log\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.737369 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736632    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-host-run-netns\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.737369 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736640    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-host-run-k8s-cni-cncf-io\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.737369 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736678    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-host-run-k8s-cni-cncf-io\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.737369 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736687    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-multus-conf-dir\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.737369 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736696    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-node-log\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.737369 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736703    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8cdb9822-8e98-4721-8771-20772d77220c-iptables-alerter-script\") pod \"iptables-alerter-snfzs\" (UID: \"8cdb9822-8e98-4721-8771-20772d77220c\") " pod="openshift-network-operator/iptables-alerter-snfzs"
Jul 22 12:54:14.737369 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736737    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-multus-conf-dir\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.737369 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736733    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whxxf\" (UniqueName: \"kubernetes.io/projected/7be0f0fb-738c-4431-a268-fb2944dfafd8-kube-api-access-whxxf\") pod \"aws-ebs-csi-driver-node-x8vpv\" (UID: \"7be0f0fb-738c-4431-a268-fb2944dfafd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.737369 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736777    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-ovn-node-metrics-cert\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.737369 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736806    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-etc-sysctl-conf\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.737369 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736831    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cdb9822-8e98-4721-8771-20772d77220c-host-slash\") pod \"iptables-alerter-snfzs\" (UID: \"8cdb9822-8e98-4721-8771-20772d77220c\") " pod="openshift-network-operator/iptables-alerter-snfzs"
Jul 22 12:54:14.737369 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736854    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-run-ovn\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.737369 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736876    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-host-cni-netd\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.738212 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736900    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-host-run-multus-certs\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.738212 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736920    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cdb9822-8e98-4721-8771-20772d77220c-host-slash\") pod \"iptables-alerter-snfzs\" (UID: \"8cdb9822-8e98-4721-8771-20772d77220c\") " pod="openshift-network-operator/iptables-alerter-snfzs"
Jul 22 12:54:14.738212 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736922    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-run\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.738212 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736974    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-run-ovn\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.738212 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.736984    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-env-overrides\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.738212 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737011    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-host-cni-netd\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.738212 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737046    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-multus-cni-dir\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.738212 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737073    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-cnibin\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.738212 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737095    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-host-var-lib-kubelet\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.738212 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737119    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/307ac7cd-170c-4090-9cda-7be00b22dccc-etc-tuned\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.738212 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737146    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-ovnkube-script-lib\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.738212 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737163    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-host-run-multus-certs\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.738212 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737178    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-cnibin\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.738212 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737198    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-host-var-lib-kubelet\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.738212 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737221    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7be0f0fb-738c-4431-a268-fb2944dfafd8-registration-dir\") pod \"aws-ebs-csi-driver-node-x8vpv\" (UID: \"7be0f0fb-738c-4431-a268-fb2944dfafd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.738212 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737220    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-multus-cni-dir\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.738212 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737250    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nkzt\" (UniqueName: \"kubernetes.io/projected/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-kube-api-access-2nkzt\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.738212 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737280    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-etc-openvswitch\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.739130 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737313    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-os-release\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.739130 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737344    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-etc-openvswitch\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.739130 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737347    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-etc-modprobe-d\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.739130 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737372    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-os-release\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.739130 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737384    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-host-run-ovn-kubernetes\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.739130 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737407    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-ovnkube-config\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.739130 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737432    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret\") pod \"global-pull-secret-syncer-2hjdp\" (UID: \"8acd9f4a-3905-4940-9304-9709d2917fcf\") " pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:14.739130 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737458    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5t8p\" (UniqueName: \"kubernetes.io/projected/18f03b5d-d4a0-4198-8775-4eecf35d1ffc-kube-api-access-l5t8p\") pod \"node-resolver-bhhst\" (UID: \"18f03b5d-d4a0-4198-8775-4eecf35d1ffc\") " pod="openshift-dns/node-resolver-bhhst"
Jul 22 12:54:14.739130 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737473    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-host-run-ovn-kubernetes\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.739130 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737483    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-host\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.739130 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737503    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-env-overrides\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.739130 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737516    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdkdt\" (UniqueName: \"kubernetes.io/projected/307ac7cd-170c-4090-9cda-7be00b22dccc-kube-api-access-hdkdt\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.739130 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737543    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.739130 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:14.737614    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 12:54:14.739130 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737652    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.739130 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737722    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd75730f-ceb2-4726-9562-d25606150f76-konnectivity-ca\") pod \"konnectivity-agent-lsw8h\" (UID: \"fd75730f-ceb2-4726-9562-d25606150f76\") " pod="kube-system/konnectivity-agent-lsw8h"
Jul 22 12:54:14.739130 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737756    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-var-lib-openvswitch\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.739899 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:14.737803    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret podName:8acd9f4a-3905-4940-9304-9709d2917fcf nodeName:}" failed. No retries permitted until 2026-07-22 12:54:15.237767198 +0000 UTC m=+3.002418830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret") pod "global-pull-secret-syncer-2hjdp" (UID: "8acd9f4a-3905-4940-9304-9709d2917fcf") : object "kube-system"/"original-pull-secret" not registered
Jul 22 12:54:14.739899 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737868    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-log-socket\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.739899 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737896    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8acd9f4a-3905-4940-9304-9709d2917fcf-kubelet-config\") pod \"global-pull-secret-syncer-2hjdp\" (UID: \"8acd9f4a-3905-4940-9304-9709d2917fcf\") " pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:14.739899 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737939    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-hostroot\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.739899 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737965    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-etc-kubernetes\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.739899 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737969    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-var-lib-openvswitch\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.739899 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737974    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-ovnkube-config\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.739899 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.737995    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-etc-systemd\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.739899 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738019    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/307ac7cd-170c-4090-9cda-7be00b22dccc-tmp\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.739899 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738029    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8acd9f4a-3905-4940-9304-9709d2917fcf-kubelet-config\") pod \"global-pull-secret-syncer-2hjdp\" (UID: \"8acd9f4a-3905-4940-9304-9709d2917fcf\") " pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:14.739899 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738027    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-hostroot\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.739899 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738045    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-run-openvswitch\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.739899 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738073    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-log-socket\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.739899 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738105    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-host-var-lib-cni-multus\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.739899 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738131    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-etc-sysconfig\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.739899 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738147    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-var-lib-kubelet\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.740659 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738161    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7be0f0fb-738c-4431-a268-fb2944dfafd8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x8vpv\" (UID: \"7be0f0fb-738c-4431-a268-fb2944dfafd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.740659 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738166    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-run-openvswitch\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.740659 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738199    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.740659 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738204    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-host-var-lib-cni-multus\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.740659 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738230    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b7614f14-9ad0-46fa-83a9-2fa3293b9a37-serviceca\") pod \"node-ca-wzfng\" (UID: \"b7614f14-9ad0-46fa-83a9-2fa3293b9a37\") " pod="openshift-image-registry/node-ca-wzfng"
Jul 22 12:54:14.740659 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738242    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd75730f-ceb2-4726-9562-d25606150f76-konnectivity-ca\") pod \"konnectivity-agent-lsw8h\" (UID: \"fd75730f-ceb2-4726-9562-d25606150f76\") " pod="kube-system/konnectivity-agent-lsw8h"
Jul 22 12:54:14.740659 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738276    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-host-var-lib-cni-bin\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.740659 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738368    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/18f03b5d-d4a0-4198-8775-4eecf35d1ffc-hosts-file\") pod \"node-resolver-bhhst\" (UID: \"18f03b5d-d4a0-4198-8775-4eecf35d1ffc\") " pod="openshift-dns/node-resolver-bhhst"
Jul 22 12:54:14.740659 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738378    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-host-var-lib-cni-bin\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.740659 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738423    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18f03b5d-d4a0-4198-8775-4eecf35d1ffc-tmp-dir\") pod \"node-resolver-bhhst\" (UID: \"18f03b5d-d4a0-4198-8775-4eecf35d1ffc\") " pod="openshift-dns/node-resolver-bhhst"
Jul 22 12:54:14.740659 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738450    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.740659 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738476    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs\") pod \"network-metrics-daemon-k7tvv\" (UID: \"de51b06a-8a46-462a-8e91-e96529e7d461\") " pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:14.740659 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738519    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-host-run-netns\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.740659 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738557    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-lib-modules\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.740659 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738589    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7c11e2c-eacc-4764-9ab9-3de705c894ee-host-run-netns\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.740659 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.738616    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b7614f14-9ad0-46fa-83a9-2fa3293b9a37-serviceca\") pod \"node-ca-wzfng\" (UID: \"b7614f14-9ad0-46fa-83a9-2fa3293b9a37\") " pod="openshift-image-registry/node-ca-wzfng"
Jul 22 12:54:14.741261 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.740830    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd75730f-ceb2-4726-9562-d25606150f76-agent-certs\") pod \"konnectivity-agent-lsw8h\" (UID: \"fd75730f-ceb2-4726-9562-d25606150f76\") " pod="kube-system/konnectivity-agent-lsw8h"
Jul 22 12:54:14.741261 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.740910    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-ovn-node-metrics-cert\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.744895 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:14.744867    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 12:54:14.744895 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:14.744892    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 12:54:14.745069 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:14.744906    2557 projected.go:196] Error preparing data for projected volume kube-api-access-j2t5b for pod openshift-network-diagnostics/network-check-target-m4kh6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:54:14.745069 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:14.744970    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b podName:c1cf4f26-18a3-4496-8637-9e255bc1540e nodeName:}" failed. No retries permitted until 2026-07-22 12:54:15.244952801 +0000 UTC m=+3.009604422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j2t5b" (UniqueName: "kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b") pod "network-check-target-m4kh6" (UID: "c1cf4f26-18a3-4496-8637-9e255bc1540e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:54:14.745334 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.745311    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf7vk\" (UniqueName: \"kubernetes.io/projected/8cdb9822-8e98-4721-8771-20772d77220c-kube-api-access-xf7vk\") pod \"iptables-alerter-snfzs\" (UID: \"8cdb9822-8e98-4721-8771-20772d77220c\") " pod="openshift-network-operator/iptables-alerter-snfzs"
Jul 22 12:54:14.745918 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.745896    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg7fm\" (UniqueName: \"kubernetes.io/projected/b7614f14-9ad0-46fa-83a9-2fa3293b9a37-kube-api-access-sg7fm\") pod \"node-ca-wzfng\" (UID: \"b7614f14-9ad0-46fa-83a9-2fa3293b9a37\") " pod="openshift-image-registry/node-ca-wzfng"
Jul 22 12:54:14.746214 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.746180    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hckbg\" (UniqueName: \"kubernetes.io/projected/d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c-kube-api-access-hckbg\") pod \"ovnkube-node-crfsb\" (UID: \"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.747941 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.747918    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjvcz\" (UniqueName: \"kubernetes.io/projected/f7c11e2c-eacc-4764-9ab9-3de705c894ee-kube-api-access-mjvcz\") pod \"multus-tmmtf\" (UID: \"f7c11e2c-eacc-4764-9ab9-3de705c894ee\") " pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.809026 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.808278    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal" event={"ID":"6c8c76d9b2e66e247a9ed607844729dc","Type":"ContainerStarted","Data":"ef1d1de88ac2b867ffd5ff3893514a4ead1492ee851db321c1a8f804405f0a49"}
Jul 22 12:54:14.811088 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.811058    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal" event={"ID":"a6e375ecd0701850088a8ac8d4843555","Type":"ContainerStarted","Data":"47521d7fefd6a2b0d5671c931bebb79ac343fc128852f80c5e9ef5509e64d744"}
Jul 22 12:54:14.839886 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.839851    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/18f03b5d-d4a0-4198-8775-4eecf35d1ffc-hosts-file\") pod \"node-resolver-bhhst\" (UID: \"18f03b5d-d4a0-4198-8775-4eecf35d1ffc\") " pod="openshift-dns/node-resolver-bhhst"
Jul 22 12:54:14.840042 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.839894    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18f03b5d-d4a0-4198-8775-4eecf35d1ffc-tmp-dir\") pod \"node-resolver-bhhst\" (UID: \"18f03b5d-d4a0-4198-8775-4eecf35d1ffc\") " pod="openshift-dns/node-resolver-bhhst"
Jul 22 12:54:14.840042 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.839922    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.840042 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.839950    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs\") pod \"network-metrics-daemon-k7tvv\" (UID: \"de51b06a-8a46-462a-8e91-e96529e7d461\") " pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:14.840042 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.839973    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-lib-modules\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.840042 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.839987    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/18f03b5d-d4a0-4198-8775-4eecf35d1ffc-hosts-file\") pod \"node-resolver-bhhst\" (UID: \"18f03b5d-d4a0-4198-8775-4eecf35d1ffc\") " pod="openshift-dns/node-resolver-bhhst"
Jul 22 12:54:14.840042 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840003    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7be0f0fb-738c-4431-a268-fb2944dfafd8-device-dir\") pod \"aws-ebs-csi-driver-node-x8vpv\" (UID: \"7be0f0fb-738c-4431-a268-fb2944dfafd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.840340 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840043    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7be0f0fb-738c-4431-a268-fb2944dfafd8-etc-selinux\") pod \"aws-ebs-csi-driver-node-x8vpv\" (UID: \"7be0f0fb-738c-4431-a268-fb2944dfafd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.840340 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840077    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-sys\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.840340 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840109    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7be0f0fb-738c-4431-a268-fb2944dfafd8-socket-dir\") pod \"aws-ebs-csi-driver-node-x8vpv\" (UID: \"7be0f0fb-738c-4431-a268-fb2944dfafd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.840340 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840134    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-cnibin\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.840340 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:14.840159    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:54:14.840340 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840175    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7be0f0fb-738c-4431-a268-fb2944dfafd8-sys-fs\") pod \"aws-ebs-csi-driver-node-x8vpv\" (UID: \"7be0f0fb-738c-4431-a268-fb2944dfafd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.840340 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840201    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-os-release\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.840340 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840227    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-etc-sysctl-d\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.840340 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:14.840247    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs podName:de51b06a-8a46-462a-8e91-e96529e7d461 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:15.340226292 +0000 UTC m=+3.104877904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs") pod "network-metrics-daemon-k7tvv" (UID: "de51b06a-8a46-462a-8e91-e96529e7d461") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:54:14.840340 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840279    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-system-cni-dir\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.840340 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840307    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv7pq\" (UniqueName: \"kubernetes.io/projected/de51b06a-8a46-462a-8e91-e96529e7d461-kube-api-access-dv7pq\") pod \"network-metrics-daemon-k7tvv\" (UID: \"de51b06a-8a46-462a-8e91-e96529e7d461\") " pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:14.840340 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840328    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18f03b5d-d4a0-4198-8775-4eecf35d1ffc-tmp-dir\") pod \"node-resolver-bhhst\" (UID: \"18f03b5d-d4a0-4198-8775-4eecf35d1ffc\") " pod="openshift-dns/node-resolver-bhhst"
Jul 22 12:54:14.840340 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840342    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whxxf\" (UniqueName: \"kubernetes.io/projected/7be0f0fb-738c-4431-a268-fb2944dfafd8-kube-api-access-whxxf\") pod \"aws-ebs-csi-driver-node-x8vpv\" (UID: \"7be0f0fb-738c-4431-a268-fb2944dfafd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.840836 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840346    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-etc-sysctl-d\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.840836 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840394    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-etc-sysctl-conf\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.840836 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840423    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-run\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.840836 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840448    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/307ac7cd-170c-4090-9cda-7be00b22dccc-etc-tuned\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.840836 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840467    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7be0f0fb-738c-4431-a268-fb2944dfafd8-etc-selinux\") pod \"aws-ebs-csi-driver-node-x8vpv\" (UID: \"7be0f0fb-738c-4431-a268-fb2944dfafd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.840836 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840472    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7be0f0fb-738c-4431-a268-fb2944dfafd8-registration-dir\") pod \"aws-ebs-csi-driver-node-x8vpv\" (UID: \"7be0f0fb-738c-4431-a268-fb2944dfafd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.840836 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840474    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-lib-modules\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.840836 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840397    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7be0f0fb-738c-4431-a268-fb2944dfafd8-device-dir\") pod \"aws-ebs-csi-driver-node-x8vpv\" (UID: \"7be0f0fb-738c-4431-a268-fb2944dfafd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.840836 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840538    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-run\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.840836 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840587    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7be0f0fb-738c-4431-a268-fb2944dfafd8-socket-dir\") pod \"aws-ebs-csi-driver-node-x8vpv\" (UID: \"7be0f0fb-738c-4431-a268-fb2944dfafd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.840836 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840615    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.840836 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840633    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nkzt\" (UniqueName: \"kubernetes.io/projected/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-kube-api-access-2nkzt\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.840836 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840742    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-etc-sysctl-conf\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.841437 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840987    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-system-cni-dir\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.841437 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.840986    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-sys\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.841437 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.841031    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7be0f0fb-738c-4431-a268-fb2944dfafd8-registration-dir\") pod \"aws-ebs-csi-driver-node-x8vpv\" (UID: \"7be0f0fb-738c-4431-a268-fb2944dfafd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.841437 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.841084    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7be0f0fb-738c-4431-a268-fb2944dfafd8-sys-fs\") pod \"aws-ebs-csi-driver-node-x8vpv\" (UID: \"7be0f0fb-738c-4431-a268-fb2944dfafd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.841437 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.841112    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-os-release\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.841437 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.841118    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-cnibin\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.841437 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.841161    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-etc-modprobe-d\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.841437 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.841223    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5t8p\" (UniqueName: \"kubernetes.io/projected/18f03b5d-d4a0-4198-8775-4eecf35d1ffc-kube-api-access-l5t8p\") pod \"node-resolver-bhhst\" (UID: \"18f03b5d-d4a0-4198-8775-4eecf35d1ffc\") " pod="openshift-dns/node-resolver-bhhst"
Jul 22 12:54:14.841437 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.841236    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-etc-modprobe-d\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.841437 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.841247    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-host\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.841437 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.841271    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdkdt\" (UniqueName: \"kubernetes.io/projected/307ac7cd-170c-4090-9cda-7be00b22dccc-kube-api-access-hdkdt\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.841437 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.841294    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.841437 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.841341    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.841437 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.841374    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-etc-kubernetes\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.841437 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.841396    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-etc-systemd\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.841437 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.841422    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/307ac7cd-170c-4090-9cda-7be00b22dccc-tmp\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.841437 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.841445    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-etc-sysconfig\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.842167 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.841468    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-var-lib-kubelet\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.842167 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.841490    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7be0f0fb-738c-4431-a268-fb2944dfafd8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x8vpv\" (UID: \"7be0f0fb-738c-4431-a268-fb2944dfafd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.842167 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.841514    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.842167 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.841925    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.842167 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.841988    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-host\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.842167 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.842034    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.842608 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.842454    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-etc-kubernetes\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.842608 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.842512    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-etc-systemd\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.842608 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.842514    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.842608 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.842517    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-var-lib-kubelet\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.842608 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.842558    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7be0f0fb-738c-4431-a268-fb2944dfafd8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x8vpv\" (UID: \"7be0f0fb-738c-4431-a268-fb2944dfafd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.842608 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.842577    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/307ac7cd-170c-4090-9cda-7be00b22dccc-etc-sysconfig\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.843905 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.843881    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/307ac7cd-170c-4090-9cda-7be00b22dccc-etc-tuned\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.844675 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.844655    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/307ac7cd-170c-4090-9cda-7be00b22dccc-tmp\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.849783 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.849696    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv7pq\" (UniqueName: \"kubernetes.io/projected/de51b06a-8a46-462a-8e91-e96529e7d461-kube-api-access-dv7pq\") pod \"network-metrics-daemon-k7tvv\" (UID: \"de51b06a-8a46-462a-8e91-e96529e7d461\") " pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:14.849783 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.849703    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nkzt\" (UniqueName: \"kubernetes.io/projected/a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4-kube-api-access-2nkzt\") pod \"multus-additional-cni-plugins-kkn5g\" (UID: \"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4\") " pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:14.849918 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.849835    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whxxf\" (UniqueName: \"kubernetes.io/projected/7be0f0fb-738c-4431-a268-fb2944dfafd8-kube-api-access-whxxf\") pod \"aws-ebs-csi-driver-node-x8vpv\" (UID: \"7be0f0fb-738c-4431-a268-fb2944dfafd8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.850918 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.850875    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdkdt\" (UniqueName: \"kubernetes.io/projected/307ac7cd-170c-4090-9cda-7be00b22dccc-kube-api-access-hdkdt\") pod \"tuned-flrmb\" (UID: \"307ac7cd-170c-4090-9cda-7be00b22dccc\") " pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.851221 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.851191    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5t8p\" (UniqueName: \"kubernetes.io/projected/18f03b5d-d4a0-4198-8775-4eecf35d1ffc-kube-api-access-l5t8p\") pod \"node-resolver-bhhst\" (UID: \"18f03b5d-d4a0-4198-8775-4eecf35d1ffc\") " pod="openshift-dns/node-resolver-bhhst"
Jul 22 12:54:14.872034 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.872013    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 12:54:14.922618 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.922583    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lsw8h"
Jul 22 12:54:14.931832 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.931807    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tmmtf"
Jul 22 12:54:14.943945 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.943918    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-snfzs"
Jul 22 12:54:14.952848 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.952829    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:14.960800 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.960777    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wzfng"
Jul 22 12:54:14.966905 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.966882    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-flrmb"
Jul 22 12:54:14.974603 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.974584    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bhhst"
Jul 22 12:54:14.982492 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.982473    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv"
Jul 22 12:54:14.989233 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:14.989216    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kkn5g"
Jul 22 12:54:15.243200 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:15.243160    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret\") pod \"global-pull-secret-syncer-2hjdp\" (UID: \"8acd9f4a-3905-4940-9304-9709d2917fcf\") " pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:15.243389 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:15.243343    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 12:54:15.243447 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:15.243427    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret podName:8acd9f4a-3905-4940-9304-9709d2917fcf nodeName:}" failed. No retries permitted until 2026-07-22 12:54:16.243407185 +0000 UTC m=+4.008058800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret") pod "global-pull-secret-syncer-2hjdp" (UID: "8acd9f4a-3905-4940-9304-9709d2917fcf") : object "kube-system"/"original-pull-secret" not registered
Jul 22 12:54:15.344259 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:15.344218    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs\") pod \"network-metrics-daemon-k7tvv\" (UID: \"de51b06a-8a46-462a-8e91-e96529e7d461\") " pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:15.344448 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:15.344279    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2t5b\" (UniqueName: \"kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b\") pod \"network-check-target-m4kh6\" (UID: \"c1cf4f26-18a3-4496-8637-9e255bc1540e\") " pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:15.344448 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:15.344405    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:54:15.344448 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:15.344424    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 12:54:15.344448 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:15.344440    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 12:54:15.344641 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:15.344453    2557 projected.go:196] Error preparing data for projected volume kube-api-access-j2t5b for pod openshift-network-diagnostics/network-check-target-m4kh6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:54:15.344641 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:15.344481    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs podName:de51b06a-8a46-462a-8e91-e96529e7d461 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:16.344462373 +0000 UTC m=+4.109113980 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs") pod "network-metrics-daemon-k7tvv" (UID: "de51b06a-8a46-462a-8e91-e96529e7d461") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:54:15.344641 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:15.344503    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b podName:c1cf4f26-18a3-4496-8637-9e255bc1540e nodeName:}" failed. No retries permitted until 2026-07-22 12:54:16.344487861 +0000 UTC m=+4.109139465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j2t5b" (UniqueName: "kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b") pod "network-check-target-m4kh6" (UID: "c1cf4f26-18a3-4496-8637-9e255bc1540e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:54:15.666462 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:15.666404    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 12:49:14 +0000 UTC" deadline="2028-02-09 18:15:31.586901956 +0000 UTC"
Jul 22 12:54:15.666462 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:15.666452    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13613h21m15.920452479s"
Jul 22 12:54:15.719116 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:15.719072    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod307ac7cd_170c_4090_9cda_7be00b22dccc.slice/crio-6c5e9fc6f70dcf5abb606c6e614e86443f6b6700e0d1e6f2d956c4fb4a3a6154 WatchSource:0}: Error finding container 6c5e9fc6f70dcf5abb606c6e614e86443f6b6700e0d1e6f2d956c4fb4a3a6154: Status 404 returned error can't find the container with id 6c5e9fc6f70dcf5abb606c6e614e86443f6b6700e0d1e6f2d956c4fb4a3a6154
Jul 22 12:54:15.720490 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:15.720444    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7c11e2c_eacc_4764_9ab9_3de705c894ee.slice/crio-333e6811037813edff0d0a09abd84c986e0363f2147d422016f3b33d68259c6f WatchSource:0}: Error finding container 333e6811037813edff0d0a09abd84c986e0363f2147d422016f3b33d68259c6f: Status 404 returned error can't find the container with id 333e6811037813edff0d0a09abd84c986e0363f2147d422016f3b33d68259c6f
Jul 22 12:54:15.723921 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:15.723901    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7be0f0fb_738c_4431_a268_fb2944dfafd8.slice/crio-dd070c003f73bb86cefcd57141f938701dcef1e7287e33b03e0eff1c150c939d WatchSource:0}: Error finding container dd070c003f73bb86cefcd57141f938701dcef1e7287e33b03e0eff1c150c939d: Status 404 returned error can't find the container with id dd070c003f73bb86cefcd57141f938701dcef1e7287e33b03e0eff1c150c939d
Jul 22 12:54:15.724414 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:15.724379    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda48dc7c9_01e8_4ffc_b77a_b1c320c7c5b4.slice/crio-c0ce176cc267fb3d463d6652598b45915caed8ae2a78cac167ba535b7772131b WatchSource:0}: Error finding container c0ce176cc267fb3d463d6652598b45915caed8ae2a78cac167ba535b7772131b: Status 404 returned error can't find the container with id c0ce176cc267fb3d463d6652598b45915caed8ae2a78cac167ba535b7772131b
Jul 22 12:54:15.725805 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:15.725787    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7614f14_9ad0_46fa_83a9_2fa3293b9a37.slice/crio-566232eceff2413280635a53b419ff129819207d11d9d2f1cde437b0c2b3f199 WatchSource:0}: Error finding container 566232eceff2413280635a53b419ff129819207d11d9d2f1cde437b0c2b3f199: Status 404 returned error can't find the container with id 566232eceff2413280635a53b419ff129819207d11d9d2f1cde437b0c2b3f199
Jul 22 12:54:15.726843 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:15.726819    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cdb9822_8e98_4721_8771_20772d77220c.slice/crio-e52b00f183e72e967a0f54add16cb8ac7f08f8379d02f52ca4ccb89db54bcdf3 WatchSource:0}: Error finding container e52b00f183e72e967a0f54add16cb8ac7f08f8379d02f52ca4ccb89db54bcdf3: Status 404 returned error can't find the container with id e52b00f183e72e967a0f54add16cb8ac7f08f8379d02f52ca4ccb89db54bcdf3
Jul 22 12:54:15.727820 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:15.727726    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd75730f_ceb2_4726_9562_d25606150f76.slice/crio-b5718437260e4a65d7b3532bee3e49592687e0473186562605570dbffe69f3d3 WatchSource:0}: Error finding container b5718437260e4a65d7b3532bee3e49592687e0473186562605570dbffe69f3d3: Status 404 returned error can't find the container with id b5718437260e4a65d7b3532bee3e49592687e0473186562605570dbffe69f3d3
Jul 22 12:54:15.729002 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:15.728849    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b6cad8_6f10_4e84_b07a_6ef1fba72e6c.slice/crio-d8fb08873d652bf70d27fe884fda34c697c9accd1ed90c2c9f0402b10f2606d2 WatchSource:0}: Error finding container d8fb08873d652bf70d27fe884fda34c697c9accd1ed90c2c9f0402b10f2606d2: Status 404 returned error can't find the container with id d8fb08873d652bf70d27fe884fda34c697c9accd1ed90c2c9f0402b10f2606d2
Jul 22 12:54:15.803267 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:15.803242    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:15.803374 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:15.803353    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4kh6" podUID="c1cf4f26-18a3-4496-8637-9e255bc1540e"
Jul 22 12:54:15.813448 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:15.813420    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bhhst" event={"ID":"18f03b5d-d4a0-4198-8775-4eecf35d1ffc","Type":"ContainerStarted","Data":"99811d5248da44065f4e04488521b70c1ea7d47c944c6678fbddbfbb15b08898"}
Jul 22 12:54:15.814785 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:15.814762    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-crfsb" event={"ID":"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c","Type":"ContainerStarted","Data":"d8fb08873d652bf70d27fe884fda34c697c9accd1ed90c2c9f0402b10f2606d2"}
Jul 22 12:54:15.815896 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:15.815871    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lsw8h" event={"ID":"fd75730f-ceb2-4726-9562-d25606150f76","Type":"ContainerStarted","Data":"b5718437260e4a65d7b3532bee3e49592687e0473186562605570dbffe69f3d3"}
Jul 22 12:54:15.817082 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:15.817057    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-snfzs" event={"ID":"8cdb9822-8e98-4721-8771-20772d77220c","Type":"ContainerStarted","Data":"e52b00f183e72e967a0f54add16cb8ac7f08f8379d02f52ca4ccb89db54bcdf3"}
Jul 22 12:54:15.818320 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:15.818294    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wzfng" event={"ID":"b7614f14-9ad0-46fa-83a9-2fa3293b9a37","Type":"ContainerStarted","Data":"566232eceff2413280635a53b419ff129819207d11d9d2f1cde437b0c2b3f199"}
Jul 22 12:54:15.819686 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:15.819658    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tmmtf" event={"ID":"f7c11e2c-eacc-4764-9ab9-3de705c894ee","Type":"ContainerStarted","Data":"333e6811037813edff0d0a09abd84c986e0363f2147d422016f3b33d68259c6f"}
Jul 22 12:54:15.820907 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:15.820875    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-flrmb" event={"ID":"307ac7cd-170c-4090-9cda-7be00b22dccc","Type":"ContainerStarted","Data":"6c5e9fc6f70dcf5abb606c6e614e86443f6b6700e0d1e6f2d956c4fb4a3a6154"}
Jul 22 12:54:15.822983 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:15.822962    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kkn5g" event={"ID":"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4","Type":"ContainerStarted","Data":"c0ce176cc267fb3d463d6652598b45915caed8ae2a78cac167ba535b7772131b"}
Jul 22 12:54:15.824007 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:15.823984    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv" event={"ID":"7be0f0fb-738c-4431-a268-fb2944dfafd8","Type":"ContainerStarted","Data":"dd070c003f73bb86cefcd57141f938701dcef1e7287e33b03e0eff1c150c939d"}
Jul 22 12:54:16.251270 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:16.250962    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret\") pod \"global-pull-secret-syncer-2hjdp\" (UID: \"8acd9f4a-3905-4940-9304-9709d2917fcf\") " pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:16.251270 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:16.251228    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 12:54:16.251494 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:16.251328    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret podName:8acd9f4a-3905-4940-9304-9709d2917fcf nodeName:}" failed. No retries permitted until 2026-07-22 12:54:18.251294634 +0000 UTC m=+6.015946238 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret") pod "global-pull-secret-syncer-2hjdp" (UID: "8acd9f4a-3905-4940-9304-9709d2917fcf") : object "kube-system"/"original-pull-secret" not registered
Jul 22 12:54:16.352259 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:16.352219    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2t5b\" (UniqueName: \"kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b\") pod \"network-check-target-m4kh6\" (UID: \"c1cf4f26-18a3-4496-8637-9e255bc1540e\") " pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:16.352418 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:16.352305    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs\") pod \"network-metrics-daemon-k7tvv\" (UID: \"de51b06a-8a46-462a-8e91-e96529e7d461\") " pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:16.352485 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:16.352429    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:54:16.352538 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:16.352490    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs podName:de51b06a-8a46-462a-8e91-e96529e7d461 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:18.352471795 +0000 UTC m=+6.117123416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs") pod "network-metrics-daemon-k7tvv" (UID: "de51b06a-8a46-462a-8e91-e96529e7d461") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:54:16.353309 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:16.352914    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 12:54:16.353309 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:16.352936    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 12:54:16.353309 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:16.352949    2557 projected.go:196] Error preparing data for projected volume kube-api-access-j2t5b for pod openshift-network-diagnostics/network-check-target-m4kh6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:54:16.353309 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:16.353004    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b podName:c1cf4f26-18a3-4496-8637-9e255bc1540e nodeName:}" failed. No retries permitted until 2026-07-22 12:54:18.352987293 +0000 UTC m=+6.117638916 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j2t5b" (UniqueName: "kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b") pod "network-check-target-m4kh6" (UID: "c1cf4f26-18a3-4496-8637-9e255bc1540e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:54:16.667042 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:16.666924    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 12:49:14 +0000 UTC" deadline="2028-04-29 13:42:33.910095632 +0000 UTC"
Jul 22 12:54:16.667042 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:16.666991    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15528h48m17.243111164s"
Jul 22 12:54:16.806330 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:16.805618    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:16.806330 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:16.805768    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjdp" podUID="8acd9f4a-3905-4940-9304-9709d2917fcf"
Jul 22 12:54:16.806330 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:16.806161    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:16.806330 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:16.806268    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7tvv" podUID="de51b06a-8a46-462a-8e91-e96529e7d461"
Jul 22 12:54:16.832642 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:16.832610    2557 generic.go:356] "Generic (PLEG): container finished" podID="6c8c76d9b2e66e247a9ed607844729dc" containerID="7258e08abdae7ae5450d9e376749b764d501af67105a352c2329fc5b1aef6f3e" exitCode=0
Jul 22 12:54:16.832943 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:16.832701    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal" event={"ID":"6c8c76d9b2e66e247a9ed607844729dc","Type":"ContainerDied","Data":"7258e08abdae7ae5450d9e376749b764d501af67105a352c2329fc5b1aef6f3e"}
Jul 22 12:54:16.837174 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:16.836674    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal" event={"ID":"a6e375ecd0701850088a8ac8d4843555","Type":"ContainerStarted","Data":"6c8cf6502ebdb0485c30bb1c3be9d3106c33a5966be5e305a10dad04464bb887"}
Jul 22 12:54:17.803191 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:17.803145    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:17.803658 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:17.803278    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4kh6" podUID="c1cf4f26-18a3-4496-8637-9e255bc1540e"
Jul 22 12:54:17.876105 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:17.876064    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal" event={"ID":"6c8c76d9b2e66e247a9ed607844729dc","Type":"ContainerStarted","Data":"39b008c4fedf9bf6c927173d2a8f781a00d956d322b5245bcfa0b1690fba936f"}
Jul 22 12:54:17.893092 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:17.893033    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-162.ec2.internal" podStartSLOduration=3.893011087 podStartE2EDuration="3.893011087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:54:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:16.861571513 +0000 UTC m=+4.626223140" watchObservedRunningTime="2026-07-22 12:54:17.893011087 +0000 UTC m=+5.657662714"
Jul 22 12:54:18.271834 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:18.271209    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret\") pod \"global-pull-secret-syncer-2hjdp\" (UID: \"8acd9f4a-3905-4940-9304-9709d2917fcf\") " pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:18.271834 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:18.271401    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 12:54:18.271834 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:18.271466    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret podName:8acd9f4a-3905-4940-9304-9709d2917fcf nodeName:}" failed. No retries permitted until 2026-07-22 12:54:22.271446826 +0000 UTC m=+10.036098444 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret") pod "global-pull-secret-syncer-2hjdp" (UID: "8acd9f4a-3905-4940-9304-9709d2917fcf") : object "kube-system"/"original-pull-secret" not registered
Jul 22 12:54:18.372704 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:18.371917    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs\") pod \"network-metrics-daemon-k7tvv\" (UID: \"de51b06a-8a46-462a-8e91-e96529e7d461\") " pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:18.372704 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:18.371974    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2t5b\" (UniqueName: \"kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b\") pod \"network-check-target-m4kh6\" (UID: \"c1cf4f26-18a3-4496-8637-9e255bc1540e\") " pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:18.372704 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:18.372157    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 12:54:18.372704 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:18.372174    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 12:54:18.372704 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:18.372188    2557 projected.go:196] Error preparing data for projected volume kube-api-access-j2t5b for pod openshift-network-diagnostics/network-check-target-m4kh6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:54:18.372704 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:18.372247    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b podName:c1cf4f26-18a3-4496-8637-9e255bc1540e nodeName:}" failed. No retries permitted until 2026-07-22 12:54:22.372229294 +0000 UTC m=+10.136880906 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j2t5b" (UniqueName: "kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b") pod "network-check-target-m4kh6" (UID: "c1cf4f26-18a3-4496-8637-9e255bc1540e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:54:18.372704 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:18.372321    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:54:18.372704 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:18.372355    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs podName:de51b06a-8a46-462a-8e91-e96529e7d461 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:22.372342104 +0000 UTC m=+10.136993713 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs") pod "network-metrics-daemon-k7tvv" (UID: "de51b06a-8a46-462a-8e91-e96529e7d461") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:54:18.804399 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:18.803833    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:18.804399 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:18.803977    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7tvv" podUID="de51b06a-8a46-462a-8e91-e96529e7d461"
Jul 22 12:54:18.804399 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:18.804061    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:18.804399 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:18.804172    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjdp" podUID="8acd9f4a-3905-4940-9304-9709d2917fcf"
Jul 22 12:54:19.802933 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:19.802897    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:19.803131 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:19.803038    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4kh6" podUID="c1cf4f26-18a3-4496-8637-9e255bc1540e"
Jul 22 12:54:20.802469 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:20.802388    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:20.802954 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:20.802503    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7tvv" podUID="de51b06a-8a46-462a-8e91-e96529e7d461"
Jul 22 12:54:20.802954 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:20.802553    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:20.802954 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:20.802664    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjdp" podUID="8acd9f4a-3905-4940-9304-9709d2917fcf"
Jul 22 12:54:21.802693 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:21.802653    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:21.803156 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:21.802818    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4kh6" podUID="c1cf4f26-18a3-4496-8637-9e255bc1540e"
Jul 22 12:54:22.306513 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:22.306482    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret\") pod \"global-pull-secret-syncer-2hjdp\" (UID: \"8acd9f4a-3905-4940-9304-9709d2917fcf\") " pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:22.306696 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:22.306626    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 12:54:22.306813 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:22.306721    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret podName:8acd9f4a-3905-4940-9304-9709d2917fcf nodeName:}" failed. No retries permitted until 2026-07-22 12:54:30.306687407 +0000 UTC m=+18.071339014 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret") pod "global-pull-secret-syncer-2hjdp" (UID: "8acd9f4a-3905-4940-9304-9709d2917fcf") : object "kube-system"/"original-pull-secret" not registered
Jul 22 12:54:22.407809 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:22.407746    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs\") pod \"network-metrics-daemon-k7tvv\" (UID: \"de51b06a-8a46-462a-8e91-e96529e7d461\") " pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:22.407809 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:22.407810    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2t5b\" (UniqueName: \"kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b\") pod \"network-check-target-m4kh6\" (UID: \"c1cf4f26-18a3-4496-8637-9e255bc1540e\") " pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:22.408040 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:22.407929    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:54:22.408040 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:22.407945    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 12:54:22.408040 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:22.407965    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 12:54:22.408040 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:22.407976    2557 projected.go:196] Error preparing data for projected volume kube-api-access-j2t5b for pod openshift-network-diagnostics/network-check-target-m4kh6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:54:22.408040 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:22.408004    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs podName:de51b06a-8a46-462a-8e91-e96529e7d461 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:30.407983965 +0000 UTC m=+18.172635589 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs") pod "network-metrics-daemon-k7tvv" (UID: "de51b06a-8a46-462a-8e91-e96529e7d461") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:54:22.408040 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:22.408025    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b podName:c1cf4f26-18a3-4496-8637-9e255bc1540e nodeName:}" failed. No retries permitted until 2026-07-22 12:54:30.408015389 +0000 UTC m=+18.172666999 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j2t5b" (UniqueName: "kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b") pod "network-check-target-m4kh6" (UID: "c1cf4f26-18a3-4496-8637-9e255bc1540e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:54:22.804214 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:22.803516    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:22.804214 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:22.803638    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjdp" podUID="8acd9f4a-3905-4940-9304-9709d2917fcf"
Jul 22 12:54:22.804214 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:22.804056    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:22.804214 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:22.804171    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7tvv" podUID="de51b06a-8a46-462a-8e91-e96529e7d461"
Jul 22 12:54:23.803072 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:23.803043    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:23.803198 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:23.803175    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4kh6" podUID="c1cf4f26-18a3-4496-8637-9e255bc1540e"
Jul 22 12:54:24.802806 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:24.802408    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:24.802806 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:24.802551    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjdp" podUID="8acd9f4a-3905-4940-9304-9709d2917fcf"
Jul 22 12:54:24.802806 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:24.802611    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:24.802806 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:24.802760    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7tvv" podUID="de51b06a-8a46-462a-8e91-e96529e7d461"
Jul 22 12:54:25.802535 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:25.802501    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:25.802686 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:25.802614    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4kh6" podUID="c1cf4f26-18a3-4496-8637-9e255bc1540e"
Jul 22 12:54:26.802546 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:26.802513    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:26.803034 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:26.802513    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:26.803034 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:26.802655    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7tvv" podUID="de51b06a-8a46-462a-8e91-e96529e7d461"
Jul 22 12:54:26.803034 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:26.802735    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjdp" podUID="8acd9f4a-3905-4940-9304-9709d2917fcf"
Jul 22 12:54:27.802762 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:27.802705    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:27.803175 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:27.802840    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4kh6" podUID="c1cf4f26-18a3-4496-8637-9e255bc1540e"
Jul 22 12:54:28.803040 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:28.802929    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:28.803493 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:28.803083    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7tvv" podUID="de51b06a-8a46-462a-8e91-e96529e7d461"
Jul 22 12:54:28.803493 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:28.803142    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:28.803493 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:28.803245    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjdp" podUID="8acd9f4a-3905-4940-9304-9709d2917fcf"
Jul 22 12:54:29.803289 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:29.803253    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:29.803876 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:29.803382    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4kh6" podUID="c1cf4f26-18a3-4496-8637-9e255bc1540e"
Jul 22 12:54:30.366966 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:30.366930    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret\") pod \"global-pull-secret-syncer-2hjdp\" (UID: \"8acd9f4a-3905-4940-9304-9709d2917fcf\") " pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:30.367121 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:30.367083    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 12:54:30.367164 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:30.367145    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret podName:8acd9f4a-3905-4940-9304-9709d2917fcf nodeName:}" failed. No retries permitted until 2026-07-22 12:54:46.36712871 +0000 UTC m=+34.131780318 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret") pod "global-pull-secret-syncer-2hjdp" (UID: "8acd9f4a-3905-4940-9304-9709d2917fcf") : object "kube-system"/"original-pull-secret" not registered
Jul 22 12:54:30.467991 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:30.467963    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2t5b\" (UniqueName: \"kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b\") pod \"network-check-target-m4kh6\" (UID: \"c1cf4f26-18a3-4496-8637-9e255bc1540e\") " pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:30.468162 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:30.468020    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs\") pod \"network-metrics-daemon-k7tvv\" (UID: \"de51b06a-8a46-462a-8e91-e96529e7d461\") " pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:30.468162 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:30.468102    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:54:30.468162 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:30.468118    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 12:54:30.468162 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:30.468138    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 12:54:30.468162 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:30.468149    2557 projected.go:196] Error preparing data for projected volume kube-api-access-j2t5b for pod openshift-network-diagnostics/network-check-target-m4kh6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:54:30.468162 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:30.468154    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs podName:de51b06a-8a46-462a-8e91-e96529e7d461 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:46.468139228 +0000 UTC m=+34.232790832 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs") pod "network-metrics-daemon-k7tvv" (UID: "de51b06a-8a46-462a-8e91-e96529e7d461") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:54:30.468343 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:30.468188    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b podName:c1cf4f26-18a3-4496-8637-9e255bc1540e nodeName:}" failed. No retries permitted until 2026-07-22 12:54:46.468176043 +0000 UTC m=+34.232827664 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j2t5b" (UniqueName: "kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b") pod "network-check-target-m4kh6" (UID: "c1cf4f26-18a3-4496-8637-9e255bc1540e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:54:30.803259 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:30.803172    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:30.803417 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:30.803178    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:30.803417 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:30.803301    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjdp" podUID="8acd9f4a-3905-4940-9304-9709d2917fcf"
Jul 22 12:54:30.803417 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:30.803401    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7tvv" podUID="de51b06a-8a46-462a-8e91-e96529e7d461"
Jul 22 12:54:31.802979 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:31.802947    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:31.803153 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:31.803062    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4kh6" podUID="c1cf4f26-18a3-4496-8637-9e255bc1540e"
Jul 22 12:54:32.803785 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:32.803749    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:32.803785 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:32.803778    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:32.804292 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:32.803903    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7tvv" podUID="de51b06a-8a46-462a-8e91-e96529e7d461"
Jul 22 12:54:32.804292 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:32.804049    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjdp" podUID="8acd9f4a-3905-4940-9304-9709d2917fcf"
Jul 22 12:54:33.802616 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:33.802572    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:33.802797 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:33.802722    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4kh6" podUID="c1cf4f26-18a3-4496-8637-9e255bc1540e"
Jul 22 12:54:34.803545 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:34.803519    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:34.803979 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:34.803664    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjdp" podUID="8acd9f4a-3905-4940-9304-9709d2917fcf"
Jul 22 12:54:34.804064 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:34.804040    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:34.804170 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:34.804145    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7tvv" podUID="de51b06a-8a46-462a-8e91-e96529e7d461"
Jul 22 12:54:34.914903 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:34.913605    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bhhst" event={"ID":"18f03b5d-d4a0-4198-8775-4eecf35d1ffc","Type":"ContainerStarted","Data":"c31dbc0c1ffbccfee247e8dfd20e7f1f0979bcd8ff103038c6fb31acee89bbb4"}
Jul 22 12:54:34.915932 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:34.915897    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-crfsb" event={"ID":"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c","Type":"ContainerStarted","Data":"e839a6ce9c7b9fb0ae9a8ac59bc0c4de5be1fb2ec151e8cfc010360e13f5f274"}
Jul 22 12:54:34.917491 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:34.917438    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lsw8h" event={"ID":"fd75730f-ceb2-4726-9562-d25606150f76","Type":"ContainerStarted","Data":"4ab2a538e0e2a67bd126dd81d6b324db6a894e265c8dfd1ea5c13c91139a7528"}
Jul 22 12:54:34.920139 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:34.919939    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wzfng" event={"ID":"b7614f14-9ad0-46fa-83a9-2fa3293b9a37","Type":"ContainerStarted","Data":"8e99a0e0222fcbf0a3ce8cf4866e2cd2db700605deeb8017bbcb9b3d7a3ce08e"}
Jul 22 12:54:34.921753 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:34.921724    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tmmtf" event={"ID":"f7c11e2c-eacc-4764-9ab9-3de705c894ee","Type":"ContainerStarted","Data":"9d73538c19d11c8753b8adf1de90ae7e5072231fef98179a2cc82ceb6666b9a0"}
Jul 22 12:54:34.923449 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:34.923421    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-flrmb" event={"ID":"307ac7cd-170c-4090-9cda-7be00b22dccc","Type":"ContainerStarted","Data":"fd8e2ab8aa9027a94f874d6366e24f8cbfa03ed13dc29d15a3d1a61bde81a88d"}
Jul 22 12:54:34.925147 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:34.925072    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kkn5g" event={"ID":"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4","Type":"ContainerStarted","Data":"d82cce59860993a482e46d0a7e80c801be99037556494d808e53de8826b82306"}
Jul 22 12:54:34.931737 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:34.931551    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv" event={"ID":"7be0f0fb-738c-4431-a268-fb2944dfafd8","Type":"ContainerStarted","Data":"c9388307c36becd1e2f99939fc9ed97cf6e9ae934b24dd033309f707e0bc2f3a"}
Jul 22 12:54:34.936014 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:34.933111    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bhhst" podStartSLOduration=3.9507354279999998 podStartE2EDuration="22.933095019s" totalImagesPullingTime="18.982359591s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:54:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:34.931688167 +0000 UTC m=+22.696339788" watchObservedRunningTime="2026-07-22 12:54:34.933095019 +0000 UTC m=+22.697746646"
Jul 22 12:54:34.936778 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:34.936727    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-162.ec2.internal" podStartSLOduration=20.936686086 podStartE2EDuration="20.936686086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:54:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:17.893764901 +0000 UTC m=+5.658416528" watchObservedRunningTime="2026-07-22 12:54:34.936686086 +0000 UTC m=+22.701337718"
Jul 22 12:54:34.954537 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:34.954422    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lsw8h" podStartSLOduration=8.187217596 podStartE2EDuration="22.954400788s" totalImagesPullingTime="14.767183192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:54:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:34.953660221 +0000 UTC m=+22.718311848" watchObservedRunningTime="2026-07-22 12:54:34.954400788 +0000 UTC m=+22.719052415"
Jul 22 12:54:35.019671 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:35.019474    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tmmtf" podStartSLOduration=3.970240029 podStartE2EDuration="23.019457047s" totalImagesPullingTime="19.049217018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:54:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:35.005338114 +0000 UTC m=+22.769989742" watchObservedRunningTime="2026-07-22 12:54:35.019457047 +0000 UTC m=+22.784108764"
Jul 22 12:54:35.035456 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:35.035408    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wzfng" podStartSLOduration=4.163982142 podStartE2EDuration="23.035394027s" totalImagesPullingTime="18.871411885s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:54:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:35.01923276 +0000 UTC m=+22.783884387" watchObservedRunningTime="2026-07-22 12:54:35.035394027 +0000 UTC m=+22.800045653"
Jul 22 12:54:35.035859 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:35.035807    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-flrmb" podStartSLOduration=4.040691203 podStartE2EDuration="23.035793498s" totalImagesPullingTime="18.995102295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:54:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:35.035310588 +0000 UTC m=+22.799962237" watchObservedRunningTime="2026-07-22 12:54:35.035793498 +0000 UTC m=+22.800445126"
Jul 22 12:54:35.802966 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:35.802926    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:35.803157 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:35.803043    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4kh6" podUID="c1cf4f26-18a3-4496-8637-9e255bc1540e"
Jul 22 12:54:35.936455 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:35.936423    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-crfsb" event={"ID":"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c","Type":"ContainerStarted","Data":"f4bb81a966bde2bc83a2342b052dffc5df36957304c0d211cb5071980ea210f1"}
Jul 22 12:54:35.937303 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:35.936498    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-crfsb" event={"ID":"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c","Type":"ContainerStarted","Data":"321b56bd3bb1ca328f18cced725cba1363a118e16e8a47d3eaf32ab2dee9d38a"}
Jul 22 12:54:35.937303 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:35.936545    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-crfsb" event={"ID":"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c","Type":"ContainerStarted","Data":"993454ecdafd4ae8b8cd23ad1bd1335f17305ae2bec4f554c03f0d7317dd1971"}
Jul 22 12:54:35.937303 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:35.936577    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-crfsb" event={"ID":"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c","Type":"ContainerStarted","Data":"49d9df11df8c0ba48466d7a43b887d7425a905e86788ede978fe825cd87165d4"}
Jul 22 12:54:35.937303 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:35.936607    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-crfsb" event={"ID":"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c","Type":"ContainerStarted","Data":"8ef215f1229550b4cde48960eb3fc07b500b3598eb7ef35d8c49f303216dce38"}
Jul 22 12:54:35.937852 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:35.937829    2557 generic.go:356] "Generic (PLEG): container finished" podID="a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4" containerID="d82cce59860993a482e46d0a7e80c801be99037556494d808e53de8826b82306" exitCode=0
Jul 22 12:54:35.937948 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:35.937926    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kkn5g" event={"ID":"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4","Type":"ContainerDied","Data":"d82cce59860993a482e46d0a7e80c801be99037556494d808e53de8826b82306"}
Jul 22 12:54:36.000750 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:36.000661    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bhhst_18f03b5d-d4a0-4198-8775-4eecf35d1ffc/dns-node-resolver/0.log"
Jul 22 12:54:36.401868 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:36.401846    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 12:54:36.687485 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:36.687374    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T12:54:36.401861175Z","UUID":"70d32a65-5239-4b21-b7c6-589849c6d0db","Handler":null,"Name":"","Endpoint":""}
Jul 22 12:54:36.689069 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:36.689043    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 12:54:36.689192 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:36.689087    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 12:54:36.803966 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:36.803362    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:36.803966 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:36.803498    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjdp" podUID="8acd9f4a-3905-4940-9304-9709d2917fcf"
Jul 22 12:54:36.803966 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:36.803362    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:36.803966 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:36.803915    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7tvv" podUID="de51b06a-8a46-462a-8e91-e96529e7d461"
Jul 22 12:54:36.942535 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:36.942450    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv" event={"ID":"7be0f0fb-738c-4431-a268-fb2944dfafd8","Type":"ContainerStarted","Data":"48ecb1e86715dd411a3502a013a7c4d9cb551948d0263c63e06fdde8874f04a4"}
Jul 22 12:54:36.944241 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:36.944211    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-snfzs" event={"ID":"8cdb9822-8e98-4721-8771-20772d77220c","Type":"ContainerStarted","Data":"29c4f5041b3f42f44ec16ffbe477eada7612526dde69ead6666de749474b427f"}
Jul 22 12:54:36.981122 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:36.981097    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wzfng_b7614f14-9ad0-46fa-83a9-2fa3293b9a37/node-ca/0.log"
Jul 22 12:54:37.803195 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:37.803158    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:37.803474 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:37.803295    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4kh6" podUID="c1cf4f26-18a3-4496-8637-9e255bc1540e"
Jul 22 12:54:37.950487 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:37.950451    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-crfsb" event={"ID":"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c","Type":"ContainerStarted","Data":"1f0673015d26e92494dd8a1687b307a6d448a6d047c926bfb60c6a2f5b4e39a3"}
Jul 22 12:54:37.952992 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:37.952956    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv" event={"ID":"7be0f0fb-738c-4431-a268-fb2944dfafd8","Type":"ContainerStarted","Data":"a46be3dd42b348e1c1fe01b5d3068f6cb17c55c5f4916a130f2bcd192b6a1f29"}
Jul 22 12:54:37.972291 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:37.972239    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8vpv" podStartSLOduration=4.799230062 podStartE2EDuration="25.972224002s" totalImagesPullingTime="21.17299394s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:54:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:37.972069415 +0000 UTC m=+25.736721084" watchObservedRunningTime="2026-07-22 12:54:37.972224002 +0000 UTC m=+25.736875627"
Jul 22 12:54:37.972623 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:37.972596    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-snfzs" podStartSLOduration=7.102115775 podStartE2EDuration="25.972586538s" totalImagesPullingTime="18.870470763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:54:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:36.957197943 +0000 UTC m=+24.721849570" watchObservedRunningTime="2026-07-22 12:54:37.972586538 +0000 UTC m=+25.737238205"
Jul 22 12:54:38.803401 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:38.803359    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:38.803688 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:38.803360    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:38.803688 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:38.803496    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjdp" podUID="8acd9f4a-3905-4940-9304-9709d2917fcf"
Jul 22 12:54:38.803688 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:38.803587    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7tvv" podUID="de51b06a-8a46-462a-8e91-e96529e7d461"
Jul 22 12:54:38.961523 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:38.961478    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lsw8h"
Jul 22 12:54:38.962164 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:38.962143    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lsw8h"
Jul 22 12:54:39.803046 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:39.802869    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:39.803222 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:39.803143    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4kh6" podUID="c1cf4f26-18a3-4496-8637-9e255bc1540e"
Jul 22 12:54:40.392196 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:40.392174    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lsw8h"
Jul 22 12:54:40.392789 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:40.392771    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lsw8h"
Jul 22 12:54:40.802858 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:40.802819    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:40.803060 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:40.802826    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:40.803060 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:40.802941    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjdp" podUID="8acd9f4a-3905-4940-9304-9709d2917fcf"
Jul 22 12:54:40.803060 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:40.803018    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7tvv" podUID="de51b06a-8a46-462a-8e91-e96529e7d461"
Jul 22 12:54:40.962473 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:40.962437    2557 generic.go:356] "Generic (PLEG): container finished" podID="a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4" containerID="9c265bad99eaa1e3bffb3e65ad7399c5848bcd28b183a489aba6479cc0495d17" exitCode=0
Jul 22 12:54:40.962661 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:40.962524    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kkn5g" event={"ID":"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4","Type":"ContainerDied","Data":"9c265bad99eaa1e3bffb3e65ad7399c5848bcd28b183a489aba6479cc0495d17"}
Jul 22 12:54:40.968408 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:40.968366    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-crfsb" event={"ID":"d3b6cad8-6f10-4e84-b07a-6ef1fba72e6c","Type":"ContainerStarted","Data":"e1d94c8d9cf43b84ce34b7b063e06f76251d501e8de051b48c30bd5726891a50"}
Jul 22 12:54:41.006045 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:41.005989    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-crfsb" podStartSLOduration=9.960508519 podStartE2EDuration="29.005974031s" totalImagesPullingTime="19.045465512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:54:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:41.00466584 +0000 UTC m=+28.769317466" watchObservedRunningTime="2026-07-22 12:54:41.005974031 +0000 UTC m=+28.770625657"
Jul 22 12:54:41.803315 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:41.803275    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:41.803919 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:41.803383    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4kh6" podUID="c1cf4f26-18a3-4496-8637-9e255bc1540e"
Jul 22 12:54:41.971289 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:41.971256    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:41.971643 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:41.971623    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:41.971732 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:41.971694    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:41.987529 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:41.987495    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:41.987759 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:41.987731    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:54:42.584141 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:42.583940    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m4kh6"]
Jul 22 12:54:42.584319 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:42.584271    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:42.584420 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:42.584388    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4kh6" podUID="c1cf4f26-18a3-4496-8637-9e255bc1540e"
Jul 22 12:54:42.586837 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:42.586807    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k7tvv"]
Jul 22 12:54:42.586976 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:42.586955    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:42.587141 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:42.587109    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7tvv" podUID="de51b06a-8a46-462a-8e91-e96529e7d461"
Jul 22 12:54:42.587817 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:42.587791    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2hjdp"]
Jul 22 12:54:42.587925 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:42.587908    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:42.588027 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:42.588003    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjdp" podUID="8acd9f4a-3905-4940-9304-9709d2917fcf"
Jul 22 12:54:43.803034 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:43.803000    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:43.803414 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:43.803116    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4kh6" podUID="c1cf4f26-18a3-4496-8637-9e255bc1540e"
Jul 22 12:54:43.978087 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:43.978046    2557 generic.go:356] "Generic (PLEG): container finished" podID="a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4" containerID="97043fdde76161ba71a1372380b900ca8311973e8566a6bb08e8eb237687de02" exitCode=0
Jul 22 12:54:43.978260 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:43.978096    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kkn5g" event={"ID":"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4","Type":"ContainerDied","Data":"97043fdde76161ba71a1372380b900ca8311973e8566a6bb08e8eb237687de02"}
Jul 22 12:54:44.803125 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:44.803040    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:44.803470 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:44.803168    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7tvv" podUID="de51b06a-8a46-462a-8e91-e96529e7d461"
Jul 22 12:54:44.803470 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:44.803218    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:44.803470 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:44.803300    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjdp" podUID="8acd9f4a-3905-4940-9304-9709d2917fcf"
Jul 22 12:54:45.802731 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:45.802553    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:45.802873 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:45.802821    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m4kh6" podUID="c1cf4f26-18a3-4496-8637-9e255bc1540e"
Jul 22 12:54:45.984808 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:45.984762    2557 generic.go:356] "Generic (PLEG): container finished" podID="a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4" containerID="ed970a2d796a86661edd13557c9c0cc8fea84873779aa361b9a90b70a9747e12" exitCode=0
Jul 22 12:54:45.985175 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:45.984814    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kkn5g" event={"ID":"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4","Type":"ContainerDied","Data":"ed970a2d796a86661edd13557c9c0cc8fea84873779aa361b9a90b70a9747e12"}
Jul 22 12:54:46.392437 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:46.392395    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret\") pod \"global-pull-secret-syncer-2hjdp\" (UID: \"8acd9f4a-3905-4940-9304-9709d2917fcf\") " pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:46.392615 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:46.392536    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 12:54:46.392615 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:46.392599    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret podName:8acd9f4a-3905-4940-9304-9709d2917fcf nodeName:}" failed. No retries permitted until 2026-07-22 12:55:18.392581046 +0000 UTC m=+66.157232671 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret") pod "global-pull-secret-syncer-2hjdp" (UID: "8acd9f4a-3905-4940-9304-9709d2917fcf") : object "kube-system"/"original-pull-secret" not registered
Jul 22 12:54:46.493565 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:46.493524    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs\") pod \"network-metrics-daemon-k7tvv\" (UID: \"de51b06a-8a46-462a-8e91-e96529e7d461\") " pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:46.493565 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:46.493570    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2t5b\" (UniqueName: \"kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b\") pod \"network-check-target-m4kh6\" (UID: \"c1cf4f26-18a3-4496-8637-9e255bc1540e\") " pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:46.493862 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:46.493744    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:54:46.493862 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:46.493829    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs podName:de51b06a-8a46-462a-8e91-e96529e7d461 nodeName:}" failed. No retries permitted until 2026-07-22 12:55:18.493806238 +0000 UTC m=+66.258457845 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs") pod "network-metrics-daemon-k7tvv" (UID: "de51b06a-8a46-462a-8e91-e96529e7d461") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 12:54:46.493862 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:46.493757    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 12:54:46.493862 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:46.493855    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 12:54:46.493862 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:46.493866    2557 projected.go:196] Error preparing data for projected volume kube-api-access-j2t5b for pod openshift-network-diagnostics/network-check-target-m4kh6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:54:46.494093 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:46.493906    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b podName:c1cf4f26-18a3-4496-8637-9e255bc1540e nodeName:}" failed. No retries permitted until 2026-07-22 12:55:18.493895845 +0000 UTC m=+66.258547449 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j2t5b" (UniqueName: "kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b") pod "network-check-target-m4kh6" (UID: "c1cf4f26-18a3-4496-8637-9e255bc1540e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 12:54:46.806419 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:46.806263    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:46.806419 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:46.806396    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hjdp" podUID="8acd9f4a-3905-4940-9304-9709d2917fcf"
Jul 22 12:54:46.806594 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:46.806469    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:46.806643 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:46.806616    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k7tvv" podUID="de51b06a-8a46-462a-8e91-e96529e7d461"
Jul 22 12:54:47.533600 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.533529    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-162.ec2.internal" event="NodeReady"
Jul 22 12:54:47.533955 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.533656    2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 12:54:47.585179 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.585145    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-g7dkc"]
Jul 22 12:54:47.587315 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.587257    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g7dkc"
Jul 22 12:54:47.588653 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.588630    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cn9mj"]
Jul 22 12:54:47.589461 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.589431    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 12:54:47.589617 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.589592    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 12:54:47.589752 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.589734    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x9ndv\""
Jul 22 12:54:47.589897 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.589881    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 12:54:47.590845 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.590826    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cn9mj"
Jul 22 12:54:47.592500 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.592479    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 12:54:47.592598 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.592545    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dxxk2\""
Jul 22 12:54:47.592676 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.592657    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 12:54:47.592919 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.592903    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 12:54:47.592994 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.592911    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 12:54:47.596621 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.596350    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g7dkc"]
Jul 22 12:54:47.602158 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.602135    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cn9mj"]
Jul 22 12:54:47.607974 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.607948    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2b9ht"]
Jul 22 12:54:47.610204 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.610183    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2b9ht"
Jul 22 12:54:47.612155 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.612135    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 12:54:47.612258 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.612185    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 12:54:47.612258 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.612192    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6s9tz\""
Jul 22 12:54:47.621032 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.621010    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2b9ht"]
Jul 22 12:54:47.702048 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.702013    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef4193f1-c592-437c-ad52-3167ecfb8430-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cn9mj\" (UID: \"ef4193f1-c592-437c-ad52-3167ecfb8430\") " pod="openshift-insights/insights-runtime-extractor-cn9mj"
Jul 22 12:54:47.702290 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.702078    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f354fe87-0789-4245-a1e3-b4a522296723-cert\") pod \"ingress-canary-g7dkc\" (UID: \"f354fe87-0789-4245-a1e3-b4a522296723\") " pod="openshift-ingress-canary/ingress-canary-g7dkc"
Jul 22 12:54:47.702290 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.702104    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzk29\" (UniqueName: \"kubernetes.io/projected/f354fe87-0789-4245-a1e3-b4a522296723-kube-api-access-vzk29\") pod \"ingress-canary-g7dkc\" (UID: \"f354fe87-0789-4245-a1e3-b4a522296723\") " pod="openshift-ingress-canary/ingress-canary-g7dkc"
Jul 22 12:54:47.702290 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.702194    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef4193f1-c592-437c-ad52-3167ecfb8430-data-volume\") pod \"insights-runtime-extractor-cn9mj\" (UID: \"ef4193f1-c592-437c-ad52-3167ecfb8430\") " pod="openshift-insights/insights-runtime-extractor-cn9mj"
Jul 22 12:54:47.702290 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.702246    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef4193f1-c592-437c-ad52-3167ecfb8430-crio-socket\") pod \"insights-runtime-extractor-cn9mj\" (UID: \"ef4193f1-c592-437c-ad52-3167ecfb8430\") " pod="openshift-insights/insights-runtime-extractor-cn9mj"
Jul 22 12:54:47.702290 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.702274    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef4193f1-c592-437c-ad52-3167ecfb8430-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cn9mj\" (UID: \"ef4193f1-c592-437c-ad52-3167ecfb8430\") " pod="openshift-insights/insights-runtime-extractor-cn9mj"
Jul 22 12:54:47.702487 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.702299    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkr5z\" (UniqueName: \"kubernetes.io/projected/ef4193f1-c592-437c-ad52-3167ecfb8430-kube-api-access-jkr5z\") pod \"insights-runtime-extractor-cn9mj\" (UID: \"ef4193f1-c592-437c-ad52-3167ecfb8430\") " pod="openshift-insights/insights-runtime-extractor-cn9mj"
Jul 22 12:54:47.702487 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.702323    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4b298e8-535d-4f7a-a08b-050e622b9602-tmp-dir\") pod \"dns-default-2b9ht\" (UID: \"d4b298e8-535d-4f7a-a08b-050e622b9602\") " pod="openshift-dns/dns-default-2b9ht"
Jul 22 12:54:47.702487 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.702346    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njlpp\" (UniqueName: \"kubernetes.io/projected/d4b298e8-535d-4f7a-a08b-050e622b9602-kube-api-access-njlpp\") pod \"dns-default-2b9ht\" (UID: \"d4b298e8-535d-4f7a-a08b-050e622b9602\") " pod="openshift-dns/dns-default-2b9ht"
Jul 22 12:54:47.702487 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.702415    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4b298e8-535d-4f7a-a08b-050e622b9602-config-volume\") pod \"dns-default-2b9ht\" (UID: \"d4b298e8-535d-4f7a-a08b-050e622b9602\") " pod="openshift-dns/dns-default-2b9ht"
Jul 22 12:54:47.702487 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.702436    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4b298e8-535d-4f7a-a08b-050e622b9602-metrics-tls\") pod \"dns-default-2b9ht\" (UID: \"d4b298e8-535d-4f7a-a08b-050e622b9602\") " pod="openshift-dns/dns-default-2b9ht"
Jul 22 12:54:47.802961 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.802884    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:54:47.803113 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.802976    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4b298e8-535d-4f7a-a08b-050e622b9602-config-volume\") pod \"dns-default-2b9ht\" (UID: \"d4b298e8-535d-4f7a-a08b-050e622b9602\") " pod="openshift-dns/dns-default-2b9ht"
Jul 22 12:54:47.803113 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.803014    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4b298e8-535d-4f7a-a08b-050e622b9602-metrics-tls\") pod \"dns-default-2b9ht\" (UID: \"d4b298e8-535d-4f7a-a08b-050e622b9602\") " pod="openshift-dns/dns-default-2b9ht"
Jul 22 12:54:47.803113 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.803051    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef4193f1-c592-437c-ad52-3167ecfb8430-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cn9mj\" (UID: \"ef4193f1-c592-437c-ad52-3167ecfb8430\") " pod="openshift-insights/insights-runtime-extractor-cn9mj"
Jul 22 12:54:47.803113 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.803085    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f354fe87-0789-4245-a1e3-b4a522296723-cert\") pod \"ingress-canary-g7dkc\" (UID: \"f354fe87-0789-4245-a1e3-b4a522296723\") " pod="openshift-ingress-canary/ingress-canary-g7dkc"
Jul 22 12:54:47.803113 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.803099    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzk29\" (UniqueName: \"kubernetes.io/projected/f354fe87-0789-4245-a1e3-b4a522296723-kube-api-access-vzk29\") pod \"ingress-canary-g7dkc\" (UID: \"f354fe87-0789-4245-a1e3-b4a522296723\") " pod="openshift-ingress-canary/ingress-canary-g7dkc"
Jul 22 12:54:47.803363 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.803123    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef4193f1-c592-437c-ad52-3167ecfb8430-data-volume\") pod \"insights-runtime-extractor-cn9mj\" (UID: \"ef4193f1-c592-437c-ad52-3167ecfb8430\") " pod="openshift-insights/insights-runtime-extractor-cn9mj"
Jul 22 12:54:47.803363 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.803149    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef4193f1-c592-437c-ad52-3167ecfb8430-crio-socket\") pod \"insights-runtime-extractor-cn9mj\" (UID: \"ef4193f1-c592-437c-ad52-3167ecfb8430\") " pod="openshift-insights/insights-runtime-extractor-cn9mj"
Jul 22 12:54:47.803363 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.803166    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef4193f1-c592-437c-ad52-3167ecfb8430-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cn9mj\" (UID: \"ef4193f1-c592-437c-ad52-3167ecfb8430\") " pod="openshift-insights/insights-runtime-extractor-cn9mj"
Jul 22 12:54:47.803363 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:47.803164    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 12:54:47.803363 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.803208    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkr5z\" (UniqueName: \"kubernetes.io/projected/ef4193f1-c592-437c-ad52-3167ecfb8430-kube-api-access-jkr5z\") pod \"insights-runtime-extractor-cn9mj\" (UID: \"ef4193f1-c592-437c-ad52-3167ecfb8430\") " pod="openshift-insights/insights-runtime-extractor-cn9mj"
Jul 22 12:54:47.803363 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:47.803221    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4b298e8-535d-4f7a-a08b-050e622b9602-metrics-tls podName:d4b298e8-535d-4f7a-a08b-050e622b9602 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:48.303207412 +0000 UTC m=+36.067859016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4b298e8-535d-4f7a-a08b-050e622b9602-metrics-tls") pod "dns-default-2b9ht" (UID: "d4b298e8-535d-4f7a-a08b-050e622b9602") : secret "dns-default-metrics-tls" not found
Jul 22 12:54:47.803363 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.803266    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4b298e8-535d-4f7a-a08b-050e622b9602-tmp-dir\") pod \"dns-default-2b9ht\" (UID: \"d4b298e8-535d-4f7a-a08b-050e622b9602\") " pod="openshift-dns/dns-default-2b9ht"
Jul 22 12:54:47.803363 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.803294    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njlpp\" (UniqueName: \"kubernetes.io/projected/d4b298e8-535d-4f7a-a08b-050e622b9602-kube-api-access-njlpp\") pod \"dns-default-2b9ht\" (UID: \"d4b298e8-535d-4f7a-a08b-050e622b9602\") " pod="openshift-dns/dns-default-2b9ht"
Jul 22 12:54:47.803744 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.803487    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef4193f1-c592-437c-ad52-3167ecfb8430-data-volume\") pod \"insights-runtime-extractor-cn9mj\" (UID: \"ef4193f1-c592-437c-ad52-3167ecfb8430\") " pod="openshift-insights/insights-runtime-extractor-cn9mj"
Jul 22 12:54:47.803744 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.803561    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4b298e8-535d-4f7a-a08b-050e622b9602-config-volume\") pod \"dns-default-2b9ht\" (UID: \"d4b298e8-535d-4f7a-a08b-050e622b9602\") " pod="openshift-dns/dns-default-2b9ht"
Jul 22 12:54:47.803744 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.803644    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef4193f1-c592-437c-ad52-3167ecfb8430-crio-socket\") pod \"insights-runtime-extractor-cn9mj\" (UID: \"ef4193f1-c592-437c-ad52-3167ecfb8430\") " pod="openshift-insights/insights-runtime-extractor-cn9mj"
Jul 22 12:54:47.803901 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.803831    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef4193f1-c592-437c-ad52-3167ecfb8430-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cn9mj\" (UID: \"ef4193f1-c592-437c-ad52-3167ecfb8430\") " pod="openshift-insights/insights-runtime-extractor-cn9mj"
Jul 22 12:54:47.803901 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.803873    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4b298e8-535d-4f7a-a08b-050e622b9602-tmp-dir\") pod \"dns-default-2b9ht\" (UID: \"d4b298e8-535d-4f7a-a08b-050e622b9602\") " pod="openshift-dns/dns-default-2b9ht"
Jul 22 12:54:47.803901 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:47.803896    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 12:54:47.804111 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:47.803973    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef4193f1-c592-437c-ad52-3167ecfb8430-insights-runtime-extractor-tls podName:ef4193f1-c592-437c-ad52-3167ecfb8430 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:48.303953269 +0000 UTC m=+36.068604875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef4193f1-c592-437c-ad52-3167ecfb8430-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cn9mj" (UID: "ef4193f1-c592-437c-ad52-3167ecfb8430") : secret "insights-runtime-extractor-tls" not found
Jul 22 12:54:47.806264 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.806241    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 12:54:47.806732 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.806503    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-frnxs\""
Jul 22 12:54:47.806732 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.806509    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 12:54:47.808003 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.807983    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f354fe87-0789-4245-a1e3-b4a522296723-cert\") pod \"ingress-canary-g7dkc\" (UID: \"f354fe87-0789-4245-a1e3-b4a522296723\") " pod="openshift-ingress-canary/ingress-canary-g7dkc"
Jul 22 12:54:47.818316 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.818272    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkr5z\" (UniqueName: \"kubernetes.io/projected/ef4193f1-c592-437c-ad52-3167ecfb8430-kube-api-access-jkr5z\") pod \"insights-runtime-extractor-cn9mj\" (UID: \"ef4193f1-c592-437c-ad52-3167ecfb8430\") " pod="openshift-insights/insights-runtime-extractor-cn9mj"
Jul 22 12:54:47.818316 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.818271    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njlpp\" (UniqueName: \"kubernetes.io/projected/d4b298e8-535d-4f7a-a08b-050e622b9602-kube-api-access-njlpp\") pod \"dns-default-2b9ht\" (UID: \"d4b298e8-535d-4f7a-a08b-050e622b9602\") " pod="openshift-dns/dns-default-2b9ht"
Jul 22 12:54:47.822989 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.822944    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzk29\" (UniqueName: \"kubernetes.io/projected/f354fe87-0789-4245-a1e3-b4a522296723-kube-api-access-vzk29\") pod \"ingress-canary-g7dkc\" (UID: \"f354fe87-0789-4245-a1e3-b4a522296723\") " pod="openshift-ingress-canary/ingress-canary-g7dkc"
Jul 22 12:54:47.902943 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:47.902889    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g7dkc"
Jul 22 12:54:48.059294 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:48.059169    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g7dkc"]
Jul 22 12:54:48.064418 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:54:48.064387    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf354fe87_0789_4245_a1e3_b4a522296723.slice/crio-0a5188be9edd43d53740f8eacddeb69c3aeb7a77f37711f7f908a65be729a338 WatchSource:0}: Error finding container 0a5188be9edd43d53740f8eacddeb69c3aeb7a77f37711f7f908a65be729a338: Status 404 returned error can't find the container with id 0a5188be9edd43d53740f8eacddeb69c3aeb7a77f37711f7f908a65be729a338
Jul 22 12:54:48.308073 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:48.308037    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef4193f1-c592-437c-ad52-3167ecfb8430-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cn9mj\" (UID: \"ef4193f1-c592-437c-ad52-3167ecfb8430\") " pod="openshift-insights/insights-runtime-extractor-cn9mj"
Jul 22 12:54:48.308250 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:48.308111    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4b298e8-535d-4f7a-a08b-050e622b9602-metrics-tls\") pod \"dns-default-2b9ht\" (UID: \"d4b298e8-535d-4f7a-a08b-050e622b9602\") " pod="openshift-dns/dns-default-2b9ht"
Jul 22 12:54:48.308250 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:48.308211    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 12:54:48.308250 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:48.308212    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 12:54:48.308365 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:48.308268    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4b298e8-535d-4f7a-a08b-050e622b9602-metrics-tls podName:d4b298e8-535d-4f7a-a08b-050e622b9602 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:49.308251057 +0000 UTC m=+37.072902681 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4b298e8-535d-4f7a-a08b-050e622b9602-metrics-tls") pod "dns-default-2b9ht" (UID: "d4b298e8-535d-4f7a-a08b-050e622b9602") : secret "dns-default-metrics-tls" not found
Jul 22 12:54:48.308365 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:48.308282    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef4193f1-c592-437c-ad52-3167ecfb8430-insights-runtime-extractor-tls podName:ef4193f1-c592-437c-ad52-3167ecfb8430 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:49.30827614 +0000 UTC m=+37.072927743 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef4193f1-c592-437c-ad52-3167ecfb8430-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cn9mj" (UID: "ef4193f1-c592-437c-ad52-3167ecfb8430") : secret "insights-runtime-extractor-tls" not found
Jul 22 12:54:48.808389 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:48.808358    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:54:48.809141 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:48.808818    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:54:48.811522 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:48.811345    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 12:54:48.811522 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:48.811424    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 12:54:48.811725 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:48.811578    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fsqrc\""
Jul 22 12:54:48.995738 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:48.995671    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g7dkc" event={"ID":"f354fe87-0789-4245-a1e3-b4a522296723","Type":"ContainerStarted","Data":"0a5188be9edd43d53740f8eacddeb69c3aeb7a77f37711f7f908a65be729a338"}
Jul 22 12:54:49.316567 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:49.316527    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4b298e8-535d-4f7a-a08b-050e622b9602-metrics-tls\") pod \"dns-default-2b9ht\" (UID: \"d4b298e8-535d-4f7a-a08b-050e622b9602\") " pod="openshift-dns/dns-default-2b9ht"
Jul 22 12:54:49.316769 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:49.316624    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef4193f1-c592-437c-ad52-3167ecfb8430-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cn9mj\" (UID: \"ef4193f1-c592-437c-ad52-3167ecfb8430\") " pod="openshift-insights/insights-runtime-extractor-cn9mj"
Jul 22 12:54:49.316769 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:49.316722    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 12:54:49.316899 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:49.316776    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 12:54:49.316899 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:49.316801    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4b298e8-535d-4f7a-a08b-050e622b9602-metrics-tls podName:d4b298e8-535d-4f7a-a08b-050e622b9602 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:51.31678313 +0000 UTC m=+39.081434757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4b298e8-535d-4f7a-a08b-050e622b9602-metrics-tls") pod "dns-default-2b9ht" (UID: "d4b298e8-535d-4f7a-a08b-050e622b9602") : secret "dns-default-metrics-tls" not found
Jul 22 12:54:49.316899 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:49.316829    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef4193f1-c592-437c-ad52-3167ecfb8430-insights-runtime-extractor-tls podName:ef4193f1-c592-437c-ad52-3167ecfb8430 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:51.31681256 +0000 UTC m=+39.081464166 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef4193f1-c592-437c-ad52-3167ecfb8430-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cn9mj" (UID: "ef4193f1-c592-437c-ad52-3167ecfb8430") : secret "insights-runtime-extractor-tls" not found
Jul 22 12:54:51.332454 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:51.332265    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef4193f1-c592-437c-ad52-3167ecfb8430-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cn9mj\" (UID: \"ef4193f1-c592-437c-ad52-3167ecfb8430\") " pod="openshift-insights/insights-runtime-extractor-cn9mj"
Jul 22 12:54:51.332863 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:51.332488    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4b298e8-535d-4f7a-a08b-050e622b9602-metrics-tls\") pod \"dns-default-2b9ht\" (UID: \"d4b298e8-535d-4f7a-a08b-050e622b9602\") " pod="openshift-dns/dns-default-2b9ht"
Jul 22 12:54:51.332863 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:51.332423    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 12:54:51.332863 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:51.332569    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef4193f1-c592-437c-ad52-3167ecfb8430-insights-runtime-extractor-tls podName:ef4193f1-c592-437c-ad52-3167ecfb8430 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:55.332552814 +0000 UTC m=+43.097204424 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef4193f1-c592-437c-ad52-3167ecfb8430-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cn9mj" (UID: "ef4193f1-c592-437c-ad52-3167ecfb8430") : secret "insights-runtime-extractor-tls" not found
Jul 22 12:54:51.332863 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:51.332604    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 12:54:51.332863 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:51.332657    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4b298e8-535d-4f7a-a08b-050e622b9602-metrics-tls podName:d4b298e8-535d-4f7a-a08b-050e622b9602 nodeName:}" failed. No retries permitted until 2026-07-22 12:54:55.332640433 +0000 UTC m=+43.097292056 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4b298e8-535d-4f7a-a08b-050e622b9602-metrics-tls") pod "dns-default-2b9ht" (UID: "d4b298e8-535d-4f7a-a08b-050e622b9602") : secret "dns-default-metrics-tls" not found
Jul 22 12:54:52.005979 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:52.005945    2557 generic.go:356] "Generic (PLEG): container finished" podID="a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4" containerID="0c5e3dda3dbe37ad5486610a84b19b67b3715ee29930bf233fccdd11b0226a2b" exitCode=0
Jul 22 12:54:52.006153 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:52.006018    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kkn5g" event={"ID":"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4","Type":"ContainerDied","Data":"0c5e3dda3dbe37ad5486610a84b19b67b3715ee29930bf233fccdd11b0226a2b"}
Jul 22 12:54:52.007462 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:52.007432    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g7dkc" event={"ID":"f354fe87-0789-4245-a1e3-b4a522296723","Type":"ContainerStarted","Data":"dec87febe7bf42c19e7a034939f9790a58ac8633af44ba966c6f6be7b42b9e11"}
Jul 22 12:54:52.043972 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:52.043928    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-g7dkc" podStartSLOduration=1.751129056 podStartE2EDuration="5.043911321s" totalImagesPullingTime="3.292782265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:54:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:52.043309157 +0000 UTC m=+39.807960774" watchObservedRunningTime="2026-07-22 12:54:52.043911321 +0000 UTC m=+39.808562946"
Jul 22 12:54:53.013552 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:53.013516    2557 generic.go:356] "Generic (PLEG): container finished" podID="a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4" containerID="e7ad393afc2f04f537df01966548b0a6678d5a8e35ec4eb683549e7441b4026d" exitCode=0
Jul 22 12:54:53.013939 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:53.013568    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kkn5g" event={"ID":"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4","Type":"ContainerDied","Data":"e7ad393afc2f04f537df01966548b0a6678d5a8e35ec4eb683549e7441b4026d"}
Jul 22 12:54:54.019150 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:54.019114    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kkn5g" event={"ID":"a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4","Type":"ContainerStarted","Data":"ebe28a96fc942eb9665d381d8c7b5de4300d737c6f4f1d39793ad99bcbbc79c7"}
Jul 22 12:54:54.041558 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:54.041508    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kkn5g" podStartSLOduration=9.911603764 podStartE2EDuration="42.041489814s" totalImagesPullingTime="32.12988605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:54:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:54:54.041063798 +0000 UTC m=+41.805715426" watchObservedRunningTime="2026-07-22 12:54:54.041489814 +0000 UTC m=+41.806141447"
Jul 22 12:54:55.367680 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:55.367640    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4b298e8-535d-4f7a-a08b-050e622b9602-metrics-tls\") pod \"dns-default-2b9ht\" (UID: \"d4b298e8-535d-4f7a-a08b-050e622b9602\") " pod="openshift-dns/dns-default-2b9ht"
Jul 22 12:54:55.368115 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:54:55.367739    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef4193f1-c592-437c-ad52-3167ecfb8430-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cn9mj\" (UID: \"ef4193f1-c592-437c-ad52-3167ecfb8430\") " pod="openshift-insights/insights-runtime-extractor-cn9mj"
Jul 22 12:54:55.368115 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:55.367804    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 12:54:55.368115 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:55.367835    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 12:54:55.368115 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:55.367869    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4b298e8-535d-4f7a-a08b-050e622b9602-metrics-tls podName:d4b298e8-535d-4f7a-a08b-050e622b9602 nodeName:}" failed. No retries permitted until 2026-07-22 12:55:03.367853665 +0000 UTC m=+51.132505269 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4b298e8-535d-4f7a-a08b-050e622b9602-metrics-tls") pod "dns-default-2b9ht" (UID: "d4b298e8-535d-4f7a-a08b-050e622b9602") : secret "dns-default-metrics-tls" not found
Jul 22 12:54:55.368115 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:54:55.367883    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef4193f1-c592-437c-ad52-3167ecfb8430-insights-runtime-extractor-tls podName:ef4193f1-c592-437c-ad52-3167ecfb8430 nodeName:}" failed. No retries permitted until 2026-07-22 12:55:03.367877205 +0000 UTC m=+51.132528809 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef4193f1-c592-437c-ad52-3167ecfb8430-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cn9mj" (UID: "ef4193f1-c592-437c-ad52-3167ecfb8430") : secret "insights-runtime-extractor-tls" not found
Jul 22 12:55:03.424623 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:03.424583    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef4193f1-c592-437c-ad52-3167ecfb8430-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cn9mj\" (UID: \"ef4193f1-c592-437c-ad52-3167ecfb8430\") " pod="openshift-insights/insights-runtime-extractor-cn9mj"
Jul 22 12:55:03.425094 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:03.424648    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4b298e8-535d-4f7a-a08b-050e622b9602-metrics-tls\") pod \"dns-default-2b9ht\" (UID: \"d4b298e8-535d-4f7a-a08b-050e622b9602\") " pod="openshift-dns/dns-default-2b9ht"
Jul 22 12:55:03.428418 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:03.428391    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4b298e8-535d-4f7a-a08b-050e622b9602-metrics-tls\") pod \"dns-default-2b9ht\" (UID: \"d4b298e8-535d-4f7a-a08b-050e622b9602\") " pod="openshift-dns/dns-default-2b9ht"
Jul 22 12:55:03.428544 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:03.428390    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef4193f1-c592-437c-ad52-3167ecfb8430-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cn9mj\" (UID: \"ef4193f1-c592-437c-ad52-3167ecfb8430\") " pod="openshift-insights/insights-runtime-extractor-cn9mj"
Jul 22 12:55:03.509783 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:03.509737    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cn9mj"
Jul 22 12:55:03.520928 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:03.520896    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2b9ht"
Jul 22 12:55:03.666267 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:03.665960    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cn9mj"]
Jul 22 12:55:03.690609 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:03.690573    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2b9ht"]
Jul 22 12:55:03.695596 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:55:03.695567    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4b298e8_535d_4f7a_a08b_050e622b9602.slice/crio-b1b03ddfbc97a45836e0431a732af15ad48c193fb567bfd1c9a684ab12b5f7a1 WatchSource:0}: Error finding container b1b03ddfbc97a45836e0431a732af15ad48c193fb567bfd1c9a684ab12b5f7a1: Status 404 returned error can't find the container with id b1b03ddfbc97a45836e0431a732af15ad48c193fb567bfd1c9a684ab12b5f7a1
Jul 22 12:55:04.042349 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:04.042271    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2b9ht" event={"ID":"d4b298e8-535d-4f7a-a08b-050e622b9602","Type":"ContainerStarted","Data":"b1b03ddfbc97a45836e0431a732af15ad48c193fb567bfd1c9a684ab12b5f7a1"}
Jul 22 12:55:04.043361 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:04.043337    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cn9mj" event={"ID":"ef4193f1-c592-437c-ad52-3167ecfb8430","Type":"ContainerStarted","Data":"2acb40156e64c839ae92ae5e1f34acfe6a3c081e27973a509792ff6739c43412"}
Jul 22 12:55:09.443694 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.443466    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-5rq77"]
Jul 22 12:55:09.447901 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.447878    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-cd859bb7-z4qcz"]
Jul 22 12:55:09.448029 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.448001    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5rq77"
Jul 22 12:55:09.450023 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.450003    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cd859bb7-z4qcz"
Jul 22 12:55:09.451778 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.451757    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bfs59\""
Jul 22 12:55:09.451894 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.451781    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 22 12:55:09.451894 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.451821    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 22 12:55:09.452442 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.452427    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 22 12:55:09.452672 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.452652    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 22 12:55:09.452964 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.452950    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 22 12:55:09.453405 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.453387    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"]
Jul 22 12:55:09.453749 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.453730    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 22 12:55:09.455297 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.455282    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"
Jul 22 12:55:09.458896 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.458878    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 22 12:55:09.458896 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.458884    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 22 12:55:09.459133 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.459109    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-cd859bb7-z4qcz"]
Jul 22 12:55:09.459237 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.459203    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 22 12:55:09.459281 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.459236    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 22 12:55:09.462307 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.462286    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-5rq77"]
Jul 22 12:55:09.471704 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.471685    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b5e75d98-d069-4a16-a226-200a512e5fb5-klusterlet-config\") pod \"klusterlet-addon-workmgr-cd859bb7-z4qcz\" (UID: \"b5e75d98-d069-4a16-a226-200a512e5fb5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cd859bb7-z4qcz"
Jul 22 12:55:09.471812 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.471738    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7bb6\" (UniqueName: \"kubernetes.io/projected/3e2aab97-f71c-4993-8dd6-229c7e432162-kube-api-access-r7bb6\") pod \"cluster-proxy-proxy-agent-6f84d796c4-qx5cx\" (UID: \"3e2aab97-f71c-4993-8dd6-229c7e432162\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"
Jul 22 12:55:09.471812 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.471779    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/24304c8d-9d78-419e-b158-e917bb1d20a0-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5rq77\" (UID: \"24304c8d-9d78-419e-b158-e917bb1d20a0\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5rq77"
Jul 22 12:55:09.471812 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.471796    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drzdt\" (UniqueName: \"kubernetes.io/projected/b5e75d98-d069-4a16-a226-200a512e5fb5-kube-api-access-drzdt\") pod \"klusterlet-addon-workmgr-cd859bb7-z4qcz\" (UID: \"b5e75d98-d069-4a16-a226-200a512e5fb5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cd859bb7-z4qcz"
Jul 22 12:55:09.471951 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.471819    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3e2aab97-f71c-4993-8dd6-229c7e432162-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f84d796c4-qx5cx\" (UID: \"3e2aab97-f71c-4993-8dd6-229c7e432162\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"
Jul 22 12:55:09.471951 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.471836    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5e75d98-d069-4a16-a226-200a512e5fb5-tmp\") pod \"klusterlet-addon-workmgr-cd859bb7-z4qcz\" (UID: \"b5e75d98-d069-4a16-a226-200a512e5fb5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cd859bb7-z4qcz"
Jul 22 12:55:09.471951 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.471851    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3e2aab97-f71c-4993-8dd6-229c7e432162-hub\") pod \"cluster-proxy-proxy-agent-6f84d796c4-qx5cx\" (UID: \"3e2aab97-f71c-4993-8dd6-229c7e432162\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"
Jul 22 12:55:09.471951 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.471870    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e2aab97-f71c-4993-8dd6-229c7e432162-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f84d796c4-qx5cx\" (UID: \"3e2aab97-f71c-4993-8dd6-229c7e432162\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"
Jul 22 12:55:09.471951 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.471918    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/24304c8d-9d78-419e-b158-e917bb1d20a0-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-5rq77\" (UID: \"24304c8d-9d78-419e-b158-e917bb1d20a0\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5rq77"
Jul 22 12:55:09.471951 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.471941    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3e2aab97-f71c-4993-8dd6-229c7e432162-ca\") pod \"cluster-proxy-proxy-agent-6f84d796c4-qx5cx\" (UID: \"3e2aab97-f71c-4993-8dd6-229c7e432162\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"
Jul 22 12:55:09.472123 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.471993    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e2aab97-f71c-4993-8dd6-229c7e432162-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f84d796c4-qx5cx\" (UID: \"3e2aab97-f71c-4993-8dd6-229c7e432162\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"
Jul 22 12:55:09.476330 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.476309    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"]
Jul 22 12:55:09.573235 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.573203    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/24304c8d-9d78-419e-b158-e917bb1d20a0-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5rq77\" (UID: \"24304c8d-9d78-419e-b158-e917bb1d20a0\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5rq77"
Jul 22 12:55:09.573235 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.573237    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drzdt\" (UniqueName: \"kubernetes.io/projected/b5e75d98-d069-4a16-a226-200a512e5fb5-kube-api-access-drzdt\") pod \"klusterlet-addon-workmgr-cd859bb7-z4qcz\" (UID: \"b5e75d98-d069-4a16-a226-200a512e5fb5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cd859bb7-z4qcz"
Jul 22 12:55:09.573435 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.573255    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3e2aab97-f71c-4993-8dd6-229c7e432162-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f84d796c4-qx5cx\" (UID: \"3e2aab97-f71c-4993-8dd6-229c7e432162\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"
Jul 22 12:55:09.573435 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.573291    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5e75d98-d069-4a16-a226-200a512e5fb5-tmp\") pod \"klusterlet-addon-workmgr-cd859bb7-z4qcz\" (UID: \"b5e75d98-d069-4a16-a226-200a512e5fb5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cd859bb7-z4qcz"
Jul 22 12:55:09.573501 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.573465    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3e2aab97-f71c-4993-8dd6-229c7e432162-hub\") pod \"cluster-proxy-proxy-agent-6f84d796c4-qx5cx\" (UID: \"3e2aab97-f71c-4993-8dd6-229c7e432162\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"
Jul 22 12:55:09.573542 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.573499    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e2aab97-f71c-4993-8dd6-229c7e432162-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f84d796c4-qx5cx\" (UID: \"3e2aab97-f71c-4993-8dd6-229c7e432162\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"
Jul 22 12:55:09.573653 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.573630    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/24304c8d-9d78-419e-b158-e917bb1d20a0-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-5rq77\" (UID: \"24304c8d-9d78-419e-b158-e917bb1d20a0\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5rq77"
Jul 22 12:55:09.573765 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.573661    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5e75d98-d069-4a16-a226-200a512e5fb5-tmp\") pod \"klusterlet-addon-workmgr-cd859bb7-z4qcz\" (UID: \"b5e75d98-d069-4a16-a226-200a512e5fb5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cd859bb7-z4qcz"
Jul 22 12:55:09.573765 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.573668    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3e2aab97-f71c-4993-8dd6-229c7e432162-ca\") pod \"cluster-proxy-proxy-agent-6f84d796c4-qx5cx\" (UID: \"3e2aab97-f71c-4993-8dd6-229c7e432162\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"
Jul 22 12:55:09.573881 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.573794    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e2aab97-f71c-4993-8dd6-229c7e432162-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f84d796c4-qx5cx\" (UID: \"3e2aab97-f71c-4993-8dd6-229c7e432162\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"
Jul 22 12:55:09.573881 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.573852    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b5e75d98-d069-4a16-a226-200a512e5fb5-klusterlet-config\") pod \"klusterlet-addon-workmgr-cd859bb7-z4qcz\" (UID: \"b5e75d98-d069-4a16-a226-200a512e5fb5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cd859bb7-z4qcz"
Jul 22 12:55:09.573985 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.573884    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7bb6\" (UniqueName: \"kubernetes.io/projected/3e2aab97-f71c-4993-8dd6-229c7e432162-kube-api-access-r7bb6\") pod \"cluster-proxy-proxy-agent-6f84d796c4-qx5cx\" (UID: \"3e2aab97-f71c-4993-8dd6-229c7e432162\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"
Jul 22 12:55:09.574381 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.574355    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e2aab97-f71c-4993-8dd6-229c7e432162-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f84d796c4-qx5cx\" (UID: \"3e2aab97-f71c-4993-8dd6-229c7e432162\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"
Jul 22 12:55:09.574502 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.574383    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/24304c8d-9d78-419e-b158-e917bb1d20a0-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-5rq77\" (UID: \"24304c8d-9d78-419e-b158-e917bb1d20a0\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5rq77"
Jul 22 12:55:09.576105 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.576080    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3e2aab97-f71c-4993-8dd6-229c7e432162-ca\") pod \"cluster-proxy-proxy-agent-6f84d796c4-qx5cx\" (UID: \"3e2aab97-f71c-4993-8dd6-229c7e432162\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"
Jul 22 12:55:09.576359 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.576305    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3e2aab97-f71c-4993-8dd6-229c7e432162-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f84d796c4-qx5cx\" (UID: \"3e2aab97-f71c-4993-8dd6-229c7e432162\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"
Jul 22 12:55:09.576453 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.576400    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/24304c8d-9d78-419e-b158-e917bb1d20a0-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5rq77\" (UID: \"24304c8d-9d78-419e-b158-e917bb1d20a0\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5rq77"
Jul 22 12:55:09.576519 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.576478    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3e2aab97-f71c-4993-8dd6-229c7e432162-hub\") pod \"cluster-proxy-proxy-agent-6f84d796c4-qx5cx\" (UID: \"3e2aab97-f71c-4993-8dd6-229c7e432162\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"
Jul 22 12:55:09.576585 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.576531    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b5e75d98-d069-4a16-a226-200a512e5fb5-klusterlet-config\") pod \"klusterlet-addon-workmgr-cd859bb7-z4qcz\" (UID: \"b5e75d98-d069-4a16-a226-200a512e5fb5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cd859bb7-z4qcz"
Jul 22 12:55:09.576822 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.576804    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3e2aab97-f71c-4993-8dd6-229c7e432162-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f84d796c4-qx5cx\" (UID: \"3e2aab97-f71c-4993-8dd6-229c7e432162\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"
Jul 22 12:55:09.586884 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.586863    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7bb6\" (UniqueName: \"kubernetes.io/projected/3e2aab97-f71c-4993-8dd6-229c7e432162-kube-api-access-r7bb6\") pod \"cluster-proxy-proxy-agent-6f84d796c4-qx5cx\" (UID: \"3e2aab97-f71c-4993-8dd6-229c7e432162\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"
Jul 22 12:55:09.586970 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.586926    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drzdt\" (UniqueName: \"kubernetes.io/projected/b5e75d98-d069-4a16-a226-200a512e5fb5-kube-api-access-drzdt\") pod \"klusterlet-addon-workmgr-cd859bb7-z4qcz\" (UID: \"b5e75d98-d069-4a16-a226-200a512e5fb5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cd859bb7-z4qcz"
Jul 22 12:55:09.759333 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.759065    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5rq77"
Jul 22 12:55:09.766992 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.766655    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cd859bb7-z4qcz"
Jul 22 12:55:09.779874 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.779695    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"
Jul 22 12:55:09.974729 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.974675    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-cd859bb7-z4qcz"]
Jul 22 12:55:09.979468 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:55:09.979432    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e75d98_d069_4a16_a226_200a512e5fb5.slice/crio-df1a0e59c45a8bb01749336e07ca7b3c4985e847ab766463decfc4d536439db5 WatchSource:0}: Error finding container df1a0e59c45a8bb01749336e07ca7b3c4985e847ab766463decfc4d536439db5: Status 404 returned error can't find the container with id df1a0e59c45a8bb01749336e07ca7b3c4985e847ab766463decfc4d536439db5
Jul 22 12:55:09.996775 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:09.996749    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx"]
Jul 22 12:55:10.000530 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:55:10.000493    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e2aab97_f71c_4993_8dd6_229c7e432162.slice/crio-df23de16f4bbbca9577a54fbdaf44803e0f77615bc6ff8c7296ba57252a7bc02 WatchSource:0}: Error finding container df23de16f4bbbca9577a54fbdaf44803e0f77615bc6ff8c7296ba57252a7bc02: Status 404 returned error can't find the container with id df23de16f4bbbca9577a54fbdaf44803e0f77615bc6ff8c7296ba57252a7bc02
Jul 22 12:55:10.060206 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:10.060111    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx" event={"ID":"3e2aab97-f71c-4993-8dd6-229c7e432162","Type":"ContainerStarted","Data":"df23de16f4bbbca9577a54fbdaf44803e0f77615bc6ff8c7296ba57252a7bc02"}
Jul 22 12:55:10.061591 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:10.061555    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cd859bb7-z4qcz" event={"ID":"b5e75d98-d069-4a16-a226-200a512e5fb5","Type":"ContainerStarted","Data":"df1a0e59c45a8bb01749336e07ca7b3c4985e847ab766463decfc4d536439db5"}
Jul 22 12:55:10.064498 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:10.064472    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2b9ht" event={"ID":"d4b298e8-535d-4f7a-a08b-050e622b9602","Type":"ContainerStarted","Data":"ac1cf00738c2457ec9ed1012634edbc03350c1d84bcc0c355ad2546df4f68767"}
Jul 22 12:55:10.064599 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:10.064527    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2b9ht" event={"ID":"d4b298e8-535d-4f7a-a08b-050e622b9602","Type":"ContainerStarted","Data":"705c6946a9433f5ed2581c7e16d7b1d9f03cc684a9551c0ba52fb48d9b549004"}
Jul 22 12:55:10.064599 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:10.064570    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2b9ht"
Jul 22 12:55:10.066474 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:10.066422    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cn9mj" event={"ID":"ef4193f1-c592-437c-ad52-3167ecfb8430","Type":"ContainerStarted","Data":"a45715fe64f314b1196f15f7ebdea6a6ef03544de76ec5f12b2fcabbcbae425c"}
Jul 22 12:55:10.088918 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:10.088824    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2b9ht" podStartSLOduration=17.714779703 podStartE2EDuration="23.088805002s" totalImagesPullingTime="5.374025299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:54:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:10.08815917 +0000 UTC m=+57.852810796" watchObservedRunningTime="2026-07-22 12:55:10.088805002 +0000 UTC m=+57.853456629"
Jul 22 12:55:10.199676 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:10.199641    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-5rq77"]
Jul 22 12:55:10.203530 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:55:10.203502    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24304c8d_9d78_419e_b158_e917bb1d20a0.slice/crio-aa434ac48be0f44271a48d5271d22dfa19908e160d029a6a89fba7551c6bc556 WatchSource:0}: Error finding container aa434ac48be0f44271a48d5271d22dfa19908e160d029a6a89fba7551c6bc556: Status 404 returned error can't find the container with id aa434ac48be0f44271a48d5271d22dfa19908e160d029a6a89fba7551c6bc556
Jul 22 12:55:11.074094 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:11.074007    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5rq77" event={"ID":"24304c8d-9d78-419e-b158-e917bb1d20a0","Type":"ContainerStarted","Data":"aa434ac48be0f44271a48d5271d22dfa19908e160d029a6a89fba7551c6bc556"}
Jul 22 12:55:14.000337 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:14.000307    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-crfsb"
Jul 22 12:55:18.096580 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.096540    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cd859bb7-z4qcz" event={"ID":"b5e75d98-d069-4a16-a226-200a512e5fb5","Type":"ContainerStarted","Data":"4c78f537da3f729ec42c81aad83f9448ec4aec3627e1a48aa33969b05534ae92"}
Jul 22 12:55:18.097100 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.096777    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cd859bb7-z4qcz"
Jul 22 12:55:18.098804 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.098763    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cd859bb7-z4qcz"
Jul 22 12:55:18.098985 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.098962    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cn9mj" event={"ID":"ef4193f1-c592-437c-ad52-3167ecfb8430","Type":"ContainerStarted","Data":"1514ec5c55d5b3d4ebbda6bb4c076d5aef3890c88b59237860347585b03939b4"}
Jul 22 12:55:18.100451 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.100420    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5rq77" event={"ID":"24304c8d-9d78-419e-b158-e917bb1d20a0","Type":"ContainerStarted","Data":"5ed10959b6df995ce9311be9961e16624b5599bea3e235064609fc99316bd63e"}
Jul 22 12:55:18.106076 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.106042    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx" event={"ID":"3e2aab97-f71c-4993-8dd6-229c7e432162","Type":"ContainerStarted","Data":"439cdee82ebd5e4d39302dfe2ab164ac1dc95edd67d518514547f1a2cb1f2eaf"}
Jul 22 12:55:18.106183 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.106086    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx" event={"ID":"3e2aab97-f71c-4993-8dd6-229c7e432162","Type":"ContainerStarted","Data":"5ade5b2cc19644d8cdb2d4f6f2769464106a2c50d5ef89507f9e3526e29d7682"}
Jul 22 12:55:18.106183 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.106105    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx" event={"ID":"3e2aab97-f71c-4993-8dd6-229c7e432162","Type":"ContainerStarted","Data":"2e4a790b0827a459312d1e65b17e8d3070cf8c2c13f13b17c207f146d07b81bc"}
Jul 22 12:55:18.112457 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.112408    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cd859bb7-z4qcz" podStartSLOduration=1.9622080020000001 podStartE2EDuration="9.112392582s" totalImagesPullingTime="7.15018458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:55:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:18.111526124 +0000 UTC m=+65.876177763" watchObservedRunningTime="2026-07-22 12:55:18.112392582 +0000 UTC m=+65.877044205"
Jul 22 12:55:18.126546 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.126490    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5rq77" podStartSLOduration=2.198628533 podStartE2EDuration="9.126469984s" totalImagesPullingTime="6.927841451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:55:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:18.125594165 +0000 UTC m=+65.890245792" watchObservedRunningTime="2026-07-22 12:55:18.126469984 +0000 UTC m=+65.891121612"
Jul 22 12:55:18.160889 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.160827    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f84d796c4-qx5cx" podStartSLOduration=2.002915308 podStartE2EDuration="9.160807315s" totalImagesPullingTime="7.157892007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:55:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:18.159308576 +0000 UTC m=+65.923960227" watchObservedRunningTime="2026-07-22 12:55:18.160807315 +0000 UTC m=+65.925458944"
Jul 22 12:55:18.449997 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.449956    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret\") pod \"global-pull-secret-syncer-2hjdp\" (UID: \"8acd9f4a-3905-4940-9304-9709d2917fcf\") " pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:55:18.452110 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.452082    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 12:55:18.463267 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.463240    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8acd9f4a-3905-4940-9304-9709d2917fcf-original-pull-secret\") pod \"global-pull-secret-syncer-2hjdp\" (UID: \"8acd9f4a-3905-4940-9304-9709d2917fcf\") " pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:55:18.525327 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.525292    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hjdp"
Jul 22 12:55:18.550680 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.550648    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2t5b\" (UniqueName: \"kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b\") pod \"network-check-target-m4kh6\" (UID: \"c1cf4f26-18a3-4496-8637-9e255bc1540e\") " pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:55:18.550870 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.550756    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs\") pod \"network-metrics-daemon-k7tvv\" (UID: \"de51b06a-8a46-462a-8e91-e96529e7d461\") " pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:55:18.553136 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.553071    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 12:55:18.553136 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.553091    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 12:55:18.562990 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.562954    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 12:55:18.563251 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.563223    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de51b06a-8a46-462a-8e91-e96529e7d461-metrics-certs\") pod \"network-metrics-daemon-k7tvv\" (UID: \"de51b06a-8a46-462a-8e91-e96529e7d461\") " pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:55:18.574071 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.574049    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2t5b\" (UniqueName: \"kubernetes.io/projected/c1cf4f26-18a3-4496-8637-9e255bc1540e-kube-api-access-j2t5b\") pod \"network-check-target-m4kh6\" (UID: \"c1cf4f26-18a3-4496-8637-9e255bc1540e\") " pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:55:18.666328 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.666293    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2hjdp"]
Jul 22 12:55:18.669603 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:55:18.669578    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8acd9f4a_3905_4940_9304_9709d2917fcf.slice/crio-323e83d589b4b84a0f79828d4d7277b19d923e202c3fb7a4ba8065cff7f8333b WatchSource:0}: Error finding container 323e83d589b4b84a0f79828d4d7277b19d923e202c3fb7a4ba8065cff7f8333b: Status 404 returned error can't find the container with id 323e83d589b4b84a0f79828d4d7277b19d923e202c3fb7a4ba8065cff7f8333b
Jul 22 12:55:18.719287 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.719207    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-frnxs\""
Jul 22 12:55:18.727648 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.727625    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:55:18.834406 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.834268    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fsqrc\""
Jul 22 12:55:18.843064 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.843040    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k7tvv"
Jul 22 12:55:18.873486 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.873451    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m4kh6"]
Jul 22 12:55:18.877124 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:55:18.877093    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1cf4f26_18a3_4496_8637_9e255bc1540e.slice/crio-3b77575462f60a2a099cd9cdfe0a2804f2720a06cb40035a7629698bc9e07f20 WatchSource:0}: Error finding container 3b77575462f60a2a099cd9cdfe0a2804f2720a06cb40035a7629698bc9e07f20: Status 404 returned error can't find the container with id 3b77575462f60a2a099cd9cdfe0a2804f2720a06cb40035a7629698bc9e07f20
Jul 22 12:55:18.984876 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:18.984790    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k7tvv"]
Jul 22 12:55:18.988794 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:55:18.988762    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde51b06a_8a46_462a_8e91_e96529e7d461.slice/crio-f40267d3a65be1807fb109e85b273b5d0ba6880e39edfb74796e19471e79a08b WatchSource:0}: Error finding container f40267d3a65be1807fb109e85b273b5d0ba6880e39edfb74796e19471e79a08b: Status 404 returned error can't find the container with id f40267d3a65be1807fb109e85b273b5d0ba6880e39edfb74796e19471e79a08b
Jul 22 12:55:19.112108 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:19.112073    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k7tvv" event={"ID":"de51b06a-8a46-462a-8e91-e96529e7d461","Type":"ContainerStarted","Data":"f40267d3a65be1807fb109e85b273b5d0ba6880e39edfb74796e19471e79a08b"}
Jul 22 12:55:19.113308 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:19.113278    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m4kh6" event={"ID":"c1cf4f26-18a3-4496-8637-9e255bc1540e","Type":"ContainerStarted","Data":"3b77575462f60a2a099cd9cdfe0a2804f2720a06cb40035a7629698bc9e07f20"}
Jul 22 12:55:19.114416 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:19.114390    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2hjdp" event={"ID":"8acd9f4a-3905-4940-9304-9709d2917fcf","Type":"ContainerStarted","Data":"323e83d589b4b84a0f79828d4d7277b19d923e202c3fb7a4ba8065cff7f8333b"}
Jul 22 12:55:20.076468 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.076435    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2b9ht"
Jul 22 12:55:20.460166 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.460123    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pfpdx"]
Jul 22 12:55:20.631337 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.631309    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.633648 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.633622    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 12:55:20.634148 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.634038    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 12:55:20.634273 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.634148    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 12:55:20.634912 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.634859    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 12:55:20.634912 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.634870    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-k8hfc\""
Jul 22 12:55:20.635229 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.634926    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 12:55:20.635229 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.634958    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 12:55:20.668023 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.667985    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/678ba1fe-592e-4010-b87a-c8c22e64707b-root\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.668023 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.668026    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/678ba1fe-592e-4010-b87a-c8c22e64707b-sys\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.668257 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.668044    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/678ba1fe-592e-4010-b87a-c8c22e64707b-node-exporter-textfile\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.668257 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.668084    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/678ba1fe-592e-4010-b87a-c8c22e64707b-node-exporter-tls\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.668257 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.668171    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/678ba1fe-592e-4010-b87a-c8c22e64707b-metrics-client-ca\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.668257 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.668200    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/678ba1fe-592e-4010-b87a-c8c22e64707b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.668257 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.668243    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/678ba1fe-592e-4010-b87a-c8c22e64707b-node-exporter-wtmp\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.668449 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.668299    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt54d\" (UniqueName: \"kubernetes.io/projected/678ba1fe-592e-4010-b87a-c8c22e64707b-kube-api-access-lt54d\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.668449 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.668330    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/678ba1fe-592e-4010-b87a-c8c22e64707b-node-exporter-accelerators-collector-config\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.768692 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.768599    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt54d\" (UniqueName: \"kubernetes.io/projected/678ba1fe-592e-4010-b87a-c8c22e64707b-kube-api-access-lt54d\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.768692 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.768640    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/678ba1fe-592e-4010-b87a-c8c22e64707b-node-exporter-accelerators-collector-config\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.768692 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.768675    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/678ba1fe-592e-4010-b87a-c8c22e64707b-root\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.768980 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.768698    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/678ba1fe-592e-4010-b87a-c8c22e64707b-sys\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.768980 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.768741    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/678ba1fe-592e-4010-b87a-c8c22e64707b-node-exporter-textfile\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.768980 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.768823    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/678ba1fe-592e-4010-b87a-c8c22e64707b-root\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.768980 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.768854    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/678ba1fe-592e-4010-b87a-c8c22e64707b-node-exporter-tls\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.768980 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.768899    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/678ba1fe-592e-4010-b87a-c8c22e64707b-metrics-client-ca\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.768980 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.768825    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/678ba1fe-592e-4010-b87a-c8c22e64707b-sys\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.768980 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.768925    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/678ba1fe-592e-4010-b87a-c8c22e64707b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.769244 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.769001    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/678ba1fe-592e-4010-b87a-c8c22e64707b-node-exporter-wtmp\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.769244 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.769089    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/678ba1fe-592e-4010-b87a-c8c22e64707b-node-exporter-textfile\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.769244 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.769153    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/678ba1fe-592e-4010-b87a-c8c22e64707b-node-exporter-wtmp\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.769352 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.769288    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/678ba1fe-592e-4010-b87a-c8c22e64707b-node-exporter-accelerators-collector-config\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.769459 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.769432    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/678ba1fe-592e-4010-b87a-c8c22e64707b-metrics-client-ca\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.771192 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.771173    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/678ba1fe-592e-4010-b87a-c8c22e64707b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.771274 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.771259    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/678ba1fe-592e-4010-b87a-c8c22e64707b-node-exporter-tls\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.776504 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.776486    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt54d\" (UniqueName: \"kubernetes.io/projected/678ba1fe-592e-4010-b87a-c8c22e64707b-kube-api-access-lt54d\") pod \"node-exporter-pfpdx\" (UID: \"678ba1fe-592e-4010-b87a-c8c22e64707b\") " pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.942480 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:20.942447    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pfpdx"
Jul 22 12:55:20.974616 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:55:20.974591    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod678ba1fe_592e_4010_b87a_c8c22e64707b.slice/crio-c55e720030e858d3ebfd921e6e8fbc2555fe055c24db4b2b2475adce7f64cfb8 WatchSource:0}: Error finding container c55e720030e858d3ebfd921e6e8fbc2555fe055c24db4b2b2475adce7f64cfb8: Status 404 returned error can't find the container with id c55e720030e858d3ebfd921e6e8fbc2555fe055c24db4b2b2475adce7f64cfb8
Jul 22 12:55:21.122877 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:21.122849    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfpdx" event={"ID":"678ba1fe-592e-4010-b87a-c8c22e64707b","Type":"ContainerStarted","Data":"c55e720030e858d3ebfd921e6e8fbc2555fe055c24db4b2b2475adce7f64cfb8"}
Jul 22 12:55:22.132771 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.132732    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cn9mj" event={"ID":"ef4193f1-c592-437c-ad52-3167ecfb8430","Type":"ContainerStarted","Data":"83e5e4c3d21b519cdc8e0f159e5b1647f6f5104b411800be2da8991ead81bf64"}
Jul 22 12:55:22.337394 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.337326    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cn9mj" podStartSLOduration=17.818697757 podStartE2EDuration="35.33730066s" totalImagesPullingTime="17.518602903s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:54:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:22.153553613 +0000 UTC m=+69.918205240" watchObservedRunningTime="2026-07-22 12:55:22.33730066 +0000 UTC m=+70.101952287"
Jul 22 12:55:22.338247 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.337881    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bb75678-p7vxm"]
Jul 22 12:55:22.351109 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.350196    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:22.352170 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.352142    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bb75678-p7vxm"]
Jul 22 12:55:22.352383 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.352364    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 22 12:55:22.352599 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.352582    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 22 12:55:22.353787 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.353767    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cb2bb\""
Jul 22 12:55:22.355171 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.354967    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 22 12:55:22.355263 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.355183    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 22 12:55:22.355381 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.355364    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 22 12:55:22.355576 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.355562    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 22 12:55:22.355667 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.355650    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 22 12:55:22.360385 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.360341    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 22 12:55:22.382066 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.382032    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-console-config\") pod \"console-7bb75678-p7vxm\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") " pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:22.382234 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.382085    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-console-serving-cert\") pod \"console-7bb75678-p7vxm\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") " pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:22.382234 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.382129    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-service-ca\") pod \"console-7bb75678-p7vxm\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") " pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:22.382234 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.382159    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtgvg\" (UniqueName: \"kubernetes.io/projected/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-kube-api-access-mtgvg\") pod \"console-7bb75678-p7vxm\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") " pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:22.382234 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.382194    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-trusted-ca-bundle\") pod \"console-7bb75678-p7vxm\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") " pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:22.382234 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.382217    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-oauth-serving-cert\") pod \"console-7bb75678-p7vxm\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") " pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:22.382481 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.382248    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-console-oauth-config\") pod \"console-7bb75678-p7vxm\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") " pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:22.483984 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.483563    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-service-ca\") pod \"console-7bb75678-p7vxm\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") " pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:22.483984 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.483612    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtgvg\" (UniqueName: \"kubernetes.io/projected/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-kube-api-access-mtgvg\") pod \"console-7bb75678-p7vxm\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") " pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:22.483984 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.483651    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-trusted-ca-bundle\") pod \"console-7bb75678-p7vxm\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") " pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:22.483984 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.483674    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-oauth-serving-cert\") pod \"console-7bb75678-p7vxm\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") " pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:22.483984 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.483720    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-console-oauth-config\") pod \"console-7bb75678-p7vxm\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") " pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:22.483984 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.483772    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-console-config\") pod \"console-7bb75678-p7vxm\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") " pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:22.483984 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.483809    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-console-serving-cert\") pod \"console-7bb75678-p7vxm\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") " pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:22.484447 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.484394    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-service-ca\") pod \"console-7bb75678-p7vxm\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") " pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:22.485378 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.484541    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-oauth-serving-cert\") pod \"console-7bb75678-p7vxm\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") " pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:22.485378 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.485003    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-console-config\") pod \"console-7bb75678-p7vxm\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") " pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:22.485378 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.485336    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-trusted-ca-bundle\") pod \"console-7bb75678-p7vxm\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") " pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:22.486998 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.486965    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-console-oauth-config\") pod \"console-7bb75678-p7vxm\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") " pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:22.487103 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.487034    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-console-serving-cert\") pod \"console-7bb75678-p7vxm\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") " pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:22.493986 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.493936    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtgvg\" (UniqueName: \"kubernetes.io/projected/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-kube-api-access-mtgvg\") pod \"console-7bb75678-p7vxm\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") " pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:22.664807 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:22.664770    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:23.070766 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:23.070688    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bb75678-p7vxm"]
Jul 22 12:55:23.140759 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:23.140698    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k7tvv" event={"ID":"de51b06a-8a46-462a-8e91-e96529e7d461","Type":"ContainerStarted","Data":"87edbc8062115d0d0efdce8ad7ddad4ce720f156e8d40ca1ff5545ef0ed8075f"}
Jul 22 12:55:23.143498 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:23.143371    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfpdx" event={"ID":"678ba1fe-592e-4010-b87a-c8c22e64707b","Type":"ContainerStarted","Data":"fb4bcea13e1f2e8b04ecbbc3b33d352586cc321c3b8924511bbb627cfa5fbb68"}
Jul 22 12:55:24.095146 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:55:24.095121    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb06f1dbf_975d_4e11_8b7e_34f800dffd5a.slice/crio-6d1f5abb308f5e81d32105a2efe924d2cbf77f6acf580b9bb720ca8acc1d65ed WatchSource:0}: Error finding container 6d1f5abb308f5e81d32105a2efe924d2cbf77f6acf580b9bb720ca8acc1d65ed: Status 404 returned error can't find the container with id 6d1f5abb308f5e81d32105a2efe924d2cbf77f6acf580b9bb720ca8acc1d65ed
Jul 22 12:55:24.148478 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:24.148438    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb75678-p7vxm" event={"ID":"b06f1dbf-975d-4e11-8b7e-34f800dffd5a","Type":"ContainerStarted","Data":"6d1f5abb308f5e81d32105a2efe924d2cbf77f6acf580b9bb720ca8acc1d65ed"}
Jul 22 12:55:26.159027 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:26.158975    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k7tvv" event={"ID":"de51b06a-8a46-462a-8e91-e96529e7d461","Type":"ContainerStarted","Data":"f57465469246360d1f3b67db6be2dba03e1950ca7b94885ffe4bceb18810a2b9"}
Jul 22 12:55:26.160630 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:26.160600    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m4kh6" event={"ID":"c1cf4f26-18a3-4496-8637-9e255bc1540e","Type":"ContainerStarted","Data":"4ae6fe1f596511939757ab742e6750bcb972e250a052f2454e09530b68eb65f0"}
Jul 22 12:55:26.161052 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:26.160662    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:55:26.162638 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:26.162617    2557 generic.go:356] "Generic (PLEG): container finished" podID="678ba1fe-592e-4010-b87a-c8c22e64707b" containerID="fb4bcea13e1f2e8b04ecbbc3b33d352586cc321c3b8924511bbb627cfa5fbb68" exitCode=0
Jul 22 12:55:26.162826 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:26.162689    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfpdx" event={"ID":"678ba1fe-592e-4010-b87a-c8c22e64707b","Type":"ContainerDied","Data":"fb4bcea13e1f2e8b04ecbbc3b33d352586cc321c3b8924511bbb627cfa5fbb68"}
Jul 22 12:55:26.164417 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:26.164391    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2hjdp" event={"ID":"8acd9f4a-3905-4940-9304-9709d2917fcf","Type":"ContainerStarted","Data":"c599d55b68490da21af265cd465d5f077cb40680c66fa8ea1a46dd8dc8f5ef0e"}
Jul 22 12:55:26.176026 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:26.175983    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k7tvv" podStartSLOduration=70.254765075 podStartE2EDuration="1m14.175965469s" totalImagesPullingTime="3.921200394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:54:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:26.175125652 +0000 UTC m=+73.939777280" watchObservedRunningTime="2026-07-22 12:55:26.175965469 +0000 UTC m=+73.940617098"
Jul 22 12:55:26.190497 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:26.190453    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2hjdp" podStartSLOduration=67.352691134 podStartE2EDuration="1m14.190439421s" totalImagesPullingTime="6.837748287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:54:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:26.189135249 +0000 UTC m=+73.953786877" watchObservedRunningTime="2026-07-22 12:55:26.190439421 +0000 UTC m=+73.955091047"
Jul 22 12:55:26.221876 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:26.221835    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m4kh6" podStartSLOduration=67.59336186 podStartE2EDuration="1m14.221817831s" totalImagesPullingTime="6.628455971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:54:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:26.221547577 +0000 UTC m=+73.986199203" watchObservedRunningTime="2026-07-22 12:55:26.221817831 +0000 UTC m=+73.986469469"
Jul 22 12:55:27.172005 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:27.171964    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfpdx" event={"ID":"678ba1fe-592e-4010-b87a-c8c22e64707b","Type":"ContainerStarted","Data":"a71a788d8dcc9ef181b55ecb74037639347b1b7ae15f2879c3e266c6e8b92299"}
Jul 22 12:55:27.172485 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:27.172033    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfpdx" event={"ID":"678ba1fe-592e-4010-b87a-c8c22e64707b","Type":"ContainerStarted","Data":"0a80c7cdb1d61d0b11ec7e79e615320006fb041f054c10e050e0f19d5423df31"}
Jul 22 12:55:27.192891 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:27.192844    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pfpdx" podStartSLOduration=5.173452442 podStartE2EDuration="7.192823859s" totalImagesPullingTime="1.938388936s" totalInitContainerRuntime="80.982481ms" isStatefulPod=true podCreationTimestamp="2026-07-22 12:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:27.19190034 +0000 UTC m=+74.956551966" watchObservedRunningTime="2026-07-22 12:55:27.192823859 +0000 UTC m=+74.957475485"
Jul 22 12:55:28.177364 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:28.177330    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb75678-p7vxm" event={"ID":"b06f1dbf-975d-4e11-8b7e-34f800dffd5a","Type":"ContainerStarted","Data":"6770789ffd92c5966cbcf53d5dba90b04f2097536d7d086316b9d7635f8d1b04"}
Jul 22 12:55:28.195065 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:28.195018    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bb75678-p7vxm" podStartSLOduration=2.507983138 podStartE2EDuration="6.195003777s" totalImagesPullingTime="3.687020639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:55:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:55:28.193949529 +0000 UTC m=+75.958601167" watchObservedRunningTime="2026-07-22 12:55:28.195003777 +0000 UTC m=+75.959655404"
Jul 22 12:55:28.747513 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:28.747482    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bb75678-p7vxm"]
Jul 22 12:55:32.665770 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:32.665705    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:55.204283 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:55.204224    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bb75678-p7vxm" podUID="b06f1dbf-975d-4e11-8b7e-34f800dffd5a" containerName="console" containerID="cri-o://6770789ffd92c5966cbcf53d5dba90b04f2097536d7d086316b9d7635f8d1b04" gracePeriod=15
Jul 22 12:55:56.010352 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.010318    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:56.132631 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.132600    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-service-ca\") pod \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") "
Jul 22 12:55:56.132827 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.132647    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-console-oauth-config\") pod \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") "
Jul 22 12:55:56.132827 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.132665    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-console-serving-cert\") pod \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") "
Jul 22 12:55:56.132827 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.132704    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-console-config\") pod \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") "
Jul 22 12:55:56.132827 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.132761    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-trusted-ca-bundle\") pod \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") "
Jul 22 12:55:56.132827 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.132800    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-oauth-serving-cert\") pod \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") "
Jul 22 12:55:56.133071 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.132835    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtgvg\" (UniqueName: \"kubernetes.io/projected/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-kube-api-access-mtgvg\") pod \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\" (UID: \"b06f1dbf-975d-4e11-8b7e-34f800dffd5a\") "
Jul 22 12:55:56.133201 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.133070    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-service-ca" (OuterVolumeSpecName: "service-ca") pod "b06f1dbf-975d-4e11-8b7e-34f800dffd5a" (UID: "b06f1dbf-975d-4e11-8b7e-34f800dffd5a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:55:56.133298 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.133273    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b06f1dbf-975d-4e11-8b7e-34f800dffd5a" (UID: "b06f1dbf-975d-4e11-8b7e-34f800dffd5a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:55:56.133360 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.133290    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b06f1dbf-975d-4e11-8b7e-34f800dffd5a" (UID: "b06f1dbf-975d-4e11-8b7e-34f800dffd5a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:55:56.133360 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.133266    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-console-config" (OuterVolumeSpecName: "console-config") pod "b06f1dbf-975d-4e11-8b7e-34f800dffd5a" (UID: "b06f1dbf-975d-4e11-8b7e-34f800dffd5a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:55:56.135221 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.135192    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b06f1dbf-975d-4e11-8b7e-34f800dffd5a" (UID: "b06f1dbf-975d-4e11-8b7e-34f800dffd5a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:55:56.135327 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.135191    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-kube-api-access-mtgvg" (OuterVolumeSpecName: "kube-api-access-mtgvg") pod "b06f1dbf-975d-4e11-8b7e-34f800dffd5a" (UID: "b06f1dbf-975d-4e11-8b7e-34f800dffd5a"). InnerVolumeSpecName "kube-api-access-mtgvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:55:56.135327 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.135248    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b06f1dbf-975d-4e11-8b7e-34f800dffd5a" (UID: "b06f1dbf-975d-4e11-8b7e-34f800dffd5a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:55:56.234319 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.234276    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-console-oauth-config\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 12:55:56.234319 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.234311    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-console-serving-cert\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 12:55:56.234319 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.234322    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-console-config\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 12:55:56.234319 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.234331    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-trusted-ca-bundle\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 12:55:56.234806 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.234340    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-oauth-serving-cert\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 12:55:56.234806 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.234349    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtgvg\" (UniqueName: \"kubernetes.io/projected/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-kube-api-access-mtgvg\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 12:55:56.234806 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.234359    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b06f1dbf-975d-4e11-8b7e-34f800dffd5a-service-ca\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 12:55:56.271204 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.271176    2557 generic.go:356] "Generic (PLEG): container finished" podID="b06f1dbf-975d-4e11-8b7e-34f800dffd5a" containerID="6770789ffd92c5966cbcf53d5dba90b04f2097536d7d086316b9d7635f8d1b04" exitCode=0
Jul 22 12:55:56.271351 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.271221    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb75678-p7vxm"
Jul 22 12:55:56.271351 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.271235    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb75678-p7vxm" event={"ID":"b06f1dbf-975d-4e11-8b7e-34f800dffd5a","Type":"ContainerDied","Data":"6770789ffd92c5966cbcf53d5dba90b04f2097536d7d086316b9d7635f8d1b04"}
Jul 22 12:55:56.271351 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.271277    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb75678-p7vxm" event={"ID":"b06f1dbf-975d-4e11-8b7e-34f800dffd5a","Type":"ContainerDied","Data":"6d1f5abb308f5e81d32105a2efe924d2cbf77f6acf580b9bb720ca8acc1d65ed"}
Jul 22 12:55:56.271351 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.271299    2557 scope.go:117] "RemoveContainer" containerID="6770789ffd92c5966cbcf53d5dba90b04f2097536d7d086316b9d7635f8d1b04"
Jul 22 12:55:56.280017 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.279995    2557 scope.go:117] "RemoveContainer" containerID="6770789ffd92c5966cbcf53d5dba90b04f2097536d7d086316b9d7635f8d1b04"
Jul 22 12:55:56.280315 ip-10-0-141-162 kubenswrapper[2557]: E0722 12:55:56.280295    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6770789ffd92c5966cbcf53d5dba90b04f2097536d7d086316b9d7635f8d1b04\": container with ID starting with 6770789ffd92c5966cbcf53d5dba90b04f2097536d7d086316b9d7635f8d1b04 not found: ID does not exist" containerID="6770789ffd92c5966cbcf53d5dba90b04f2097536d7d086316b9d7635f8d1b04"
Jul 22 12:55:56.280392 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.280339    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6770789ffd92c5966cbcf53d5dba90b04f2097536d7d086316b9d7635f8d1b04"} err="failed to get container status \"6770789ffd92c5966cbcf53d5dba90b04f2097536d7d086316b9d7635f8d1b04\": rpc error: code = NotFound desc = could not find container \"6770789ffd92c5966cbcf53d5dba90b04f2097536d7d086316b9d7635f8d1b04\": container with ID starting with 6770789ffd92c5966cbcf53d5dba90b04f2097536d7d086316b9d7635f8d1b04 not found: ID does not exist"
Jul 22 12:55:56.296932 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.294668    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bb75678-p7vxm"]
Jul 22 12:55:56.299724 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.299682    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bb75678-p7vxm"]
Jul 22 12:55:56.806531 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:56.806498    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b06f1dbf-975d-4e11-8b7e-34f800dffd5a" path="/var/lib/kubelet/pods/b06f1dbf-975d-4e11-8b7e-34f800dffd5a/volumes"
Jul 22 12:55:57.174737 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:55:57.174697    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m4kh6"
Jul 22 12:57:55.944498 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:55.944462    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b9cff4d8f-zjfdk"]
Jul 22 12:57:55.944935 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:55.944690    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b06f1dbf-975d-4e11-8b7e-34f800dffd5a" containerName="console"
Jul 22 12:57:55.944935 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:55.944700    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b06f1dbf-975d-4e11-8b7e-34f800dffd5a" containerName="console"
Jul 22 12:57:55.944935 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:55.944755    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b06f1dbf-975d-4e11-8b7e-34f800dffd5a" containerName="console"
Jul 22 12:57:55.946554 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:55.946538    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:55.948562 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:55.948538    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 22 12:57:55.948800 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:55.948783    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 22 12:57:55.949065 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:55.949052    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 22 12:57:55.949608 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:55.949593    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 22 12:57:55.949692 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:55.949626    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cb2bb\""
Jul 22 12:57:55.949971 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:55.949925    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 22 12:57:55.949971 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:55.949950    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 22 12:57:55.950110 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:55.949986    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 22 12:57:55.955654 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:55.955417    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 22 12:57:55.960828 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:55.960807    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b9cff4d8f-zjfdk"]
Jul 22 12:57:56.079496 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.079466    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4929bb38-bc70-4924-94de-d227a5e27bb0-console-serving-cert\") pod \"console-6b9cff4d8f-zjfdk\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") " pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:56.079496 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.079503    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-trusted-ca-bundle\") pod \"console-6b9cff4d8f-zjfdk\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") " pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:56.079732 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.079519    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9dp6\" (UniqueName: \"kubernetes.io/projected/4929bb38-bc70-4924-94de-d227a5e27bb0-kube-api-access-v9dp6\") pod \"console-6b9cff4d8f-zjfdk\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") " pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:56.079732 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.079587    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-console-config\") pod \"console-6b9cff4d8f-zjfdk\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") " pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:56.079732 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.079649    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4929bb38-bc70-4924-94de-d227a5e27bb0-console-oauth-config\") pod \"console-6b9cff4d8f-zjfdk\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") " pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:56.079732 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.079682    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-service-ca\") pod \"console-6b9cff4d8f-zjfdk\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") " pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:56.079732 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.079703    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-oauth-serving-cert\") pod \"console-6b9cff4d8f-zjfdk\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") " pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:56.180867 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.180819    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-service-ca\") pod \"console-6b9cff4d8f-zjfdk\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") " pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:56.180867 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.180869    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-oauth-serving-cert\") pod \"console-6b9cff4d8f-zjfdk\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") " pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:56.181056 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.180990    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4929bb38-bc70-4924-94de-d227a5e27bb0-console-serving-cert\") pod \"console-6b9cff4d8f-zjfdk\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") " pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:56.181056 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.181027    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-trusted-ca-bundle\") pod \"console-6b9cff4d8f-zjfdk\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") " pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:56.181158 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.181054    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9dp6\" (UniqueName: \"kubernetes.io/projected/4929bb38-bc70-4924-94de-d227a5e27bb0-kube-api-access-v9dp6\") pod \"console-6b9cff4d8f-zjfdk\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") " pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:56.181158 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.181085    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-console-config\") pod \"console-6b9cff4d8f-zjfdk\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") " pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:56.181158 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.181135    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4929bb38-bc70-4924-94de-d227a5e27bb0-console-oauth-config\") pod \"console-6b9cff4d8f-zjfdk\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") " pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:56.181625 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.181597    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-service-ca\") pod \"console-6b9cff4d8f-zjfdk\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") " pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:56.181771 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.181607    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-oauth-serving-cert\") pod \"console-6b9cff4d8f-zjfdk\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") " pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:56.181771 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.181761    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-console-config\") pod \"console-6b9cff4d8f-zjfdk\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") " pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:56.182082 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.182060    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-trusted-ca-bundle\") pod \"console-6b9cff4d8f-zjfdk\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") " pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:56.183488 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.183464    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4929bb38-bc70-4924-94de-d227a5e27bb0-console-oauth-config\") pod \"console-6b9cff4d8f-zjfdk\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") " pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:56.183577 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.183543    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4929bb38-bc70-4924-94de-d227a5e27bb0-console-serving-cert\") pod \"console-6b9cff4d8f-zjfdk\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") " pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:56.190028 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.190006    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9dp6\" (UniqueName: \"kubernetes.io/projected/4929bb38-bc70-4924-94de-d227a5e27bb0-kube-api-access-v9dp6\") pod \"console-6b9cff4d8f-zjfdk\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") " pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:56.256629 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.256554    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:57:56.378424 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.378396    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b9cff4d8f-zjfdk"]
Jul 22 12:57:56.381640 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:57:56.381611    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4929bb38_bc70_4924_94de_d227a5e27bb0.slice/crio-d78f8c816d265010107c7d7dbaaf428530332d556b26cfbaa8a97bbece07753e WatchSource:0}: Error finding container d78f8c816d265010107c7d7dbaaf428530332d556b26cfbaa8a97bbece07753e: Status 404 returned error can't find the container with id d78f8c816d265010107c7d7dbaaf428530332d556b26cfbaa8a97bbece07753e
Jul 22 12:57:56.661418 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.661387    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9cff4d8f-zjfdk" event={"ID":"4929bb38-bc70-4924-94de-d227a5e27bb0","Type":"ContainerStarted","Data":"9a807fb08a09678db2eb91f1fb324a56db3138a15dbdec36f21b679bab9e0d4f"}
Jul 22 12:57:56.661595 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.661441    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9cff4d8f-zjfdk" event={"ID":"4929bb38-bc70-4924-94de-d227a5e27bb0","Type":"ContainerStarted","Data":"d78f8c816d265010107c7d7dbaaf428530332d556b26cfbaa8a97bbece07753e"}
Jul 22 12:57:56.678882 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:57:56.678835    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b9cff4d8f-zjfdk" podStartSLOduration=1.6788209699999999 podStartE2EDuration="1.67882097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:57:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:57:56.67737751 +0000 UTC m=+224.442029149" watchObservedRunningTime="2026-07-22 12:57:56.67882097 +0000 UTC m=+224.443472659"
Jul 22 12:58:06.256781 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:58:06.256744    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:58:06.257195 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:58:06.256813    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:58:06.261848 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:58:06.261826    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:58:06.697265 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:58:06.697240    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 12:59:12.640187 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:12.640157    2557 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 12:59:24.584039 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:24.584005    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w66r6"]
Jul 22 12:59:24.586028 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:24.586013    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w66r6"
Jul 22 12:59:24.588092 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:24.588070    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-g7clb\""
Jul 22 12:59:24.588206 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:24.588072    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 22 12:59:24.588372 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:24.588357    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 22 12:59:24.602147 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:24.602120    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w66r6"]
Jul 22 12:59:24.691854 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:24.691811    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d84a72a-b6a6-4c4b-9df8-83f6d40bf381-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-w66r6\" (UID: \"8d84a72a-b6a6-4c4b-9df8-83f6d40bf381\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w66r6"
Jul 22 12:59:24.692038 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:24.691896    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwccs\" (UniqueName: \"kubernetes.io/projected/8d84a72a-b6a6-4c4b-9df8-83f6d40bf381-kube-api-access-cwccs\") pod \"cert-manager-operator-controller-manager-55c444bf86-w66r6\" (UID: \"8d84a72a-b6a6-4c4b-9df8-83f6d40bf381\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w66r6"
Jul 22 12:59:24.792970 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:24.792938    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d84a72a-b6a6-4c4b-9df8-83f6d40bf381-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-w66r6\" (UID: \"8d84a72a-b6a6-4c4b-9df8-83f6d40bf381\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w66r6"
Jul 22 12:59:24.793104 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:24.792995    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwccs\" (UniqueName: \"kubernetes.io/projected/8d84a72a-b6a6-4c4b-9df8-83f6d40bf381-kube-api-access-cwccs\") pod \"cert-manager-operator-controller-manager-55c444bf86-w66r6\" (UID: \"8d84a72a-b6a6-4c4b-9df8-83f6d40bf381\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w66r6"
Jul 22 12:59:24.793297 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:24.793278    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d84a72a-b6a6-4c4b-9df8-83f6d40bf381-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-w66r6\" (UID: \"8d84a72a-b6a6-4c4b-9df8-83f6d40bf381\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w66r6"
Jul 22 12:59:24.806593 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:24.806562    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwccs\" (UniqueName: \"kubernetes.io/projected/8d84a72a-b6a6-4c4b-9df8-83f6d40bf381-kube-api-access-cwccs\") pod \"cert-manager-operator-controller-manager-55c444bf86-w66r6\" (UID: \"8d84a72a-b6a6-4c4b-9df8-83f6d40bf381\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w66r6"
Jul 22 12:59:24.894593 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:24.894550    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w66r6"
Jul 22 12:59:25.033858 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:25.033698    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w66r6"]
Jul 22 12:59:25.036863 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:59:25.036831    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d84a72a_b6a6_4c4b_9df8_83f6d40bf381.slice/crio-57c049bdcaf65f35d9d7d2477f172d7f089b8700f118ea5a8437c8876bcf71cd WatchSource:0}: Error finding container 57c049bdcaf65f35d9d7d2477f172d7f089b8700f118ea5a8437c8876bcf71cd: Status 404 returned error can't find the container with id 57c049bdcaf65f35d9d7d2477f172d7f089b8700f118ea5a8437c8876bcf71cd
Jul 22 12:59:25.039309 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:25.039287    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 12:59:25.953019 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:25.952987    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w66r6" event={"ID":"8d84a72a-b6a6-4c4b-9df8-83f6d40bf381","Type":"ContainerStarted","Data":"57c049bdcaf65f35d9d7d2477f172d7f089b8700f118ea5a8437c8876bcf71cd"}
Jul 22 12:59:28.966615 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:28.966582    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w66r6" event={"ID":"8d84a72a-b6a6-4c4b-9df8-83f6d40bf381","Type":"ContainerStarted","Data":"b1ee7910d3faa5062a5a47f0aa92d8797df711929118709aab98c6a0ce99b9e1"}
Jul 22 12:59:28.991390 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:28.991334    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-w66r6" podStartSLOduration=1.9090947790000001 podStartE2EDuration="4.99131107s" totalImagesPullingTime="3.082216291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:59:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:59:28.990020347 +0000 UTC m=+316.754671973" watchObservedRunningTime="2026-07-22 12:59:28.99131107 +0000 UTC m=+316.755962696"
Jul 22 12:59:41.759963 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:41.759925    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c5jh4"]
Jul 22 12:59:41.762170 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:41.762152    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-c5jh4"
Jul 22 12:59:41.764306 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:41.764284    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-pkggh\""
Jul 22 12:59:41.764433 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:41.764324    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 22 12:59:41.764841 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:41.764827    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 22 12:59:41.771551 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:41.771528    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c5jh4"]
Jul 22 12:59:41.925010 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:41.924974    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7dad651-2cfd-4179-b53b-e34d8fad5a0a-bound-sa-token\") pod \"cert-manager-55b4d954d5-c5jh4\" (UID: \"b7dad651-2cfd-4179-b53b-e34d8fad5a0a\") " pod="cert-manager/cert-manager-55b4d954d5-c5jh4"
Jul 22 12:59:41.925195 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:41.925038    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnpww\" (UniqueName: \"kubernetes.io/projected/b7dad651-2cfd-4179-b53b-e34d8fad5a0a-kube-api-access-pnpww\") pod \"cert-manager-55b4d954d5-c5jh4\" (UID: \"b7dad651-2cfd-4179-b53b-e34d8fad5a0a\") " pod="cert-manager/cert-manager-55b4d954d5-c5jh4"
Jul 22 12:59:42.025615 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:42.025512    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7dad651-2cfd-4179-b53b-e34d8fad5a0a-bound-sa-token\") pod \"cert-manager-55b4d954d5-c5jh4\" (UID: \"b7dad651-2cfd-4179-b53b-e34d8fad5a0a\") " pod="cert-manager/cert-manager-55b4d954d5-c5jh4"
Jul 22 12:59:42.025615 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:42.025590    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnpww\" (UniqueName: \"kubernetes.io/projected/b7dad651-2cfd-4179-b53b-e34d8fad5a0a-kube-api-access-pnpww\") pod \"cert-manager-55b4d954d5-c5jh4\" (UID: \"b7dad651-2cfd-4179-b53b-e34d8fad5a0a\") " pod="cert-manager/cert-manager-55b4d954d5-c5jh4"
Jul 22 12:59:42.034062 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:42.034038    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7dad651-2cfd-4179-b53b-e34d8fad5a0a-bound-sa-token\") pod \"cert-manager-55b4d954d5-c5jh4\" (UID: \"b7dad651-2cfd-4179-b53b-e34d8fad5a0a\") " pod="cert-manager/cert-manager-55b4d954d5-c5jh4"
Jul 22 12:59:42.034267 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:42.034233    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnpww\" (UniqueName: \"kubernetes.io/projected/b7dad651-2cfd-4179-b53b-e34d8fad5a0a-kube-api-access-pnpww\") pod \"cert-manager-55b4d954d5-c5jh4\" (UID: \"b7dad651-2cfd-4179-b53b-e34d8fad5a0a\") " pod="cert-manager/cert-manager-55b4d954d5-c5jh4"
Jul 22 12:59:42.071208 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:42.071175    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-c5jh4"
Jul 22 12:59:42.199811 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:42.199777    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c5jh4"]
Jul 22 12:59:42.203073 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:59:42.203042    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7dad651_2cfd_4179_b53b_e34d8fad5a0a.slice/crio-d23b003b1fdb95d17eb5e1ad31f10189a40017cf2e3bf621e88e3c1a35a78608 WatchSource:0}: Error finding container d23b003b1fdb95d17eb5e1ad31f10189a40017cf2e3bf621e88e3c1a35a78608: Status 404 returned error can't find the container with id d23b003b1fdb95d17eb5e1ad31f10189a40017cf2e3bf621e88e3c1a35a78608
Jul 22 12:59:43.017294 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:43.017247    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-c5jh4" event={"ID":"b7dad651-2cfd-4179-b53b-e34d8fad5a0a","Type":"ContainerStarted","Data":"d23b003b1fdb95d17eb5e1ad31f10189a40017cf2e3bf621e88e3c1a35a78608"}
Jul 22 12:59:45.026231 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:45.026197    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-c5jh4" event={"ID":"b7dad651-2cfd-4179-b53b-e34d8fad5a0a","Type":"ContainerStarted","Data":"b73750ebe39e971f00c909ee7ce4e1318035fb72e2bc01f736c95b2ae79a7066"}
Jul 22 12:59:45.045132 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:45.045088    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-c5jh4" podStartSLOduration=1.650905824 podStartE2EDuration="4.045073377s" totalImagesPullingTime="2.394167553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:59:45.043480419 +0000 UTC m=+332.808132046" watchObservedRunningTime="2026-07-22 12:59:45.045073377 +0000 UTC m=+332.809724999"
Jul 22 12:59:47.703202 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:47.703165    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-787jw"]
Jul 22 12:59:47.705356 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:47.705338    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-787jw"
Jul 22 12:59:47.707337 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:47.707313    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-5mfgs\""
Jul 22 12:59:47.707466 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:47.707341    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 22 12:59:47.707893 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:47.707867    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 22 12:59:47.714618 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:47.714592    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-787jw"]
Jul 22 12:59:47.872163 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:47.872127    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f839a2cb-236d-41aa-b4b1-b483a362c686-tmp\") pod \"openshift-lws-operator-fd8ccff4c-787jw\" (UID: \"f839a2cb-236d-41aa-b4b1-b483a362c686\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-787jw"
Jul 22 12:59:47.872339 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:47.872181    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n69t7\" (UniqueName: \"kubernetes.io/projected/f839a2cb-236d-41aa-b4b1-b483a362c686-kube-api-access-n69t7\") pod \"openshift-lws-operator-fd8ccff4c-787jw\" (UID: \"f839a2cb-236d-41aa-b4b1-b483a362c686\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-787jw"
Jul 22 12:59:47.973140 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:47.973041    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n69t7\" (UniqueName: \"kubernetes.io/projected/f839a2cb-236d-41aa-b4b1-b483a362c686-kube-api-access-n69t7\") pod \"openshift-lws-operator-fd8ccff4c-787jw\" (UID: \"f839a2cb-236d-41aa-b4b1-b483a362c686\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-787jw"
Jul 22 12:59:47.973290 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:47.973190    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f839a2cb-236d-41aa-b4b1-b483a362c686-tmp\") pod \"openshift-lws-operator-fd8ccff4c-787jw\" (UID: \"f839a2cb-236d-41aa-b4b1-b483a362c686\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-787jw"
Jul 22 12:59:47.973554 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:47.973536    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f839a2cb-236d-41aa-b4b1-b483a362c686-tmp\") pod \"openshift-lws-operator-fd8ccff4c-787jw\" (UID: \"f839a2cb-236d-41aa-b4b1-b483a362c686\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-787jw"
Jul 22 12:59:47.981867 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:47.981847    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n69t7\" (UniqueName: \"kubernetes.io/projected/f839a2cb-236d-41aa-b4b1-b483a362c686-kube-api-access-n69t7\") pod \"openshift-lws-operator-fd8ccff4c-787jw\" (UID: \"f839a2cb-236d-41aa-b4b1-b483a362c686\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-787jw"
Jul 22 12:59:48.014644 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:48.014610    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-787jw"
Jul 22 12:59:48.140405 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:48.140372    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-787jw"]
Jul 22 12:59:48.143890 ip-10-0-141-162 kubenswrapper[2557]: W0722 12:59:48.143869    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf839a2cb_236d_41aa_b4b1_b483a362c686.slice/crio-f86b25e9a9dd9df30cefc14d8cd63a4085117ef95358cd0a65cf5810f913e8a5 WatchSource:0}: Error finding container f86b25e9a9dd9df30cefc14d8cd63a4085117ef95358cd0a65cf5810f913e8a5: Status 404 returned error can't find the container with id f86b25e9a9dd9df30cefc14d8cd63a4085117ef95358cd0a65cf5810f913e8a5
Jul 22 12:59:49.043806 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:49.043764    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-787jw" event={"ID":"f839a2cb-236d-41aa-b4b1-b483a362c686","Type":"ContainerStarted","Data":"f86b25e9a9dd9df30cefc14d8cd63a4085117ef95358cd0a65cf5810f913e8a5"}
Jul 22 12:59:51.054478 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:51.054445    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-787jw" event={"ID":"f839a2cb-236d-41aa-b4b1-b483a362c686","Type":"ContainerStarted","Data":"b27c43bb9ef3ec52b3688a1dbcc2bf97a58d3e438d264197e789cdc674b0fcef"}
Jul 22 12:59:51.072024 ip-10-0-141-162 kubenswrapper[2557]: I0722 12:59:51.071971    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-787jw" podStartSLOduration=1.820259426 podStartE2EDuration="4.071953783s" totalImagesPullingTime="2.251694357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:59:51.070991678 +0000 UTC m=+338.835643304" watchObservedRunningTime="2026-07-22 12:59:51.071953783 +0000 UTC m=+338.836605408"
Jul 22 13:00:08.704023 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.703946    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd"]
Jul 22 13:00:08.706919 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.706899    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd"
Jul 22 13:00:08.710429 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.710409    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2qg5c\""
Jul 22 13:00:08.711120 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.711098    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 13:00:08.712516 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.712498    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/847a52d1-8843-4647-8367-521aa59baada-tmp\") pod \"opendatahub-operator-controller-manager-74989f8477-8nbcd\" (UID: \"847a52d1-8843-4647-8367-521aa59baada\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd"
Jul 22 13:00:08.712615 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.712536    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/847a52d1-8843-4647-8367-521aa59baada-webhook-cert\") pod \"opendatahub-operator-controller-manager-74989f8477-8nbcd\" (UID: \"847a52d1-8843-4647-8367-521aa59baada\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd"
Jul 22 13:00:08.712615 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.712577    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/847a52d1-8843-4647-8367-521aa59baada-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74989f8477-8nbcd\" (UID: \"847a52d1-8843-4647-8367-521aa59baada\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd"
Jul 22 13:00:08.712749 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.712618    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/847a52d1-8843-4647-8367-521aa59baada-manifests\") pod \"opendatahub-operator-controller-manager-74989f8477-8nbcd\" (UID: \"847a52d1-8843-4647-8367-521aa59baada\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd"
Jul 22 13:00:08.712749 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.712648    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnzv5\" (UniqueName: \"kubernetes.io/projected/847a52d1-8843-4647-8367-521aa59baada-kube-api-access-dnzv5\") pod \"opendatahub-operator-controller-manager-74989f8477-8nbcd\" (UID: \"847a52d1-8843-4647-8367-521aa59baada\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd"
Jul 22 13:00:08.713522 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.713503    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 13:00:08.714026 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.714008    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 13:00:08.714298 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.714282    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 13:00:08.741400 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.741376    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd"]
Jul 22 13:00:08.813262 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.813237    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/847a52d1-8843-4647-8367-521aa59baada-manifests\") pod \"opendatahub-operator-controller-manager-74989f8477-8nbcd\" (UID: \"847a52d1-8843-4647-8367-521aa59baada\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd"
Jul 22 13:00:08.813393 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.813269    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnzv5\" (UniqueName: \"kubernetes.io/projected/847a52d1-8843-4647-8367-521aa59baada-kube-api-access-dnzv5\") pod \"opendatahub-operator-controller-manager-74989f8477-8nbcd\" (UID: \"847a52d1-8843-4647-8367-521aa59baada\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd"
Jul 22 13:00:08.813393 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.813297    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/847a52d1-8843-4647-8367-521aa59baada-tmp\") pod \"opendatahub-operator-controller-manager-74989f8477-8nbcd\" (UID: \"847a52d1-8843-4647-8367-521aa59baada\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd"
Jul 22 13:00:08.813393 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.813320    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/847a52d1-8843-4647-8367-521aa59baada-webhook-cert\") pod \"opendatahub-operator-controller-manager-74989f8477-8nbcd\" (UID: \"847a52d1-8843-4647-8367-521aa59baada\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd"
Jul 22 13:00:08.813393 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.813369    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/847a52d1-8843-4647-8367-521aa59baada-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74989f8477-8nbcd\" (UID: \"847a52d1-8843-4647-8367-521aa59baada\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd"
Jul 22 13:00:08.813640 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.813614    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/847a52d1-8843-4647-8367-521aa59baada-manifests\") pod \"opendatahub-operator-controller-manager-74989f8477-8nbcd\" (UID: \"847a52d1-8843-4647-8367-521aa59baada\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd"
Jul 22 13:00:08.815638 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.815617    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/847a52d1-8843-4647-8367-521aa59baada-tmp\") pod \"opendatahub-operator-controller-manager-74989f8477-8nbcd\" (UID: \"847a52d1-8843-4647-8367-521aa59baada\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd"
Jul 22 13:00:08.815861 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.815840    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/847a52d1-8843-4647-8367-521aa59baada-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74989f8477-8nbcd\" (UID: \"847a52d1-8843-4647-8367-521aa59baada\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd"
Jul 22 13:00:08.815918 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.815903    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/847a52d1-8843-4647-8367-521aa59baada-webhook-cert\") pod \"opendatahub-operator-controller-manager-74989f8477-8nbcd\" (UID: \"847a52d1-8843-4647-8367-521aa59baada\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd"
Jul 22 13:00:08.822017 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:08.821992    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnzv5\" (UniqueName: \"kubernetes.io/projected/847a52d1-8843-4647-8367-521aa59baada-kube-api-access-dnzv5\") pod \"opendatahub-operator-controller-manager-74989f8477-8nbcd\" (UID: \"847a52d1-8843-4647-8367-521aa59baada\") " pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd"
Jul 22 13:00:09.017058 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:09.016963    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd"
Jul 22 13:00:09.147348 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:09.147319    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd"]
Jul 22 13:00:09.150633 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:00:09.150592    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod847a52d1_8843_4647_8367_521aa59baada.slice/crio-f057eb21ea9e4b75c0f49056409212cff5513b1d0f11934c238337028d795c26 WatchSource:0}: Error finding container f057eb21ea9e4b75c0f49056409212cff5513b1d0f11934c238337028d795c26: Status 404 returned error can't find the container with id f057eb21ea9e4b75c0f49056409212cff5513b1d0f11934c238337028d795c26
Jul 22 13:00:10.128598 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:10.128568    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd" event={"ID":"847a52d1-8843-4647-8367-521aa59baada","Type":"ContainerStarted","Data":"f057eb21ea9e4b75c0f49056409212cff5513b1d0f11934c238337028d795c26"}
Jul 22 13:00:13.144020 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:13.143987    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd" event={"ID":"847a52d1-8843-4647-8367-521aa59baada","Type":"ContainerStarted","Data":"4d42b810082b51468574a48311f084b09bc4a9d1bd27cf07ac2961287fd4ce47"}
Jul 22 13:00:14.149776 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:14.149736    2557 generic.go:356] "Generic (PLEG): container finished" podID="847a52d1-8843-4647-8367-521aa59baada" containerID="4d42b810082b51468574a48311f084b09bc4a9d1bd27cf07ac2961287fd4ce47" exitCode=0
Jul 22 13:00:14.150154 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:14.149799    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd" event={"ID":"847a52d1-8843-4647-8367-521aa59baada","Type":"ContainerDied","Data":"4d42b810082b51468574a48311f084b09bc4a9d1bd27cf07ac2961287fd4ce47"}
Jul 22 13:00:16.159642 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:16.159601    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd" event={"ID":"847a52d1-8843-4647-8367-521aa59baada","Type":"ContainerStarted","Data":"b9bd200c374b04d755be5db157ab39d04e5e8809f13ae84176a119635d8849e7"}
Jul 22 13:00:16.160227 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:16.159689    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd"
Jul 22 13:00:16.181833 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:16.181785    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd" podStartSLOduration=2.353951459 podStartE2EDuration="8.181767486s" totalImagesPullingTime="4.760332741s" totalInitContainerRuntime="1.067483286s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:00:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:00:16.180485843 +0000 UTC m=+363.945137482" watchObservedRunningTime="2026-07-22 13:00:16.181767486 +0000 UTC m=+363.946419112"
Jul 22 13:00:27.165736 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:27.165681    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74989f8477-8nbcd"
Jul 22 13:00:37.657774 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:37.657737    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-68759d94bb-l4nvg"]
Jul 22 13:00:37.660779 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:37.660758    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68759d94bb-l4nvg"
Jul 22 13:00:37.663139 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:37.663118    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 22 13:00:37.663258 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:37.663120    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 22 13:00:37.663258 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:37.663120    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-w49jz\""
Jul 22 13:00:37.663258 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:37.663126    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 22 13:00:37.670501 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:37.670482    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68759d94bb-l4nvg"]
Jul 22 13:00:37.706685 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:37.706648    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3-cert\") pod \"lws-controller-manager-68759d94bb-l4nvg\" (UID: \"8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3\") " pod="openshift-lws-operator/lws-controller-manager-68759d94bb-l4nvg"
Jul 22 13:00:37.706685 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:37.706686    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3-metrics-cert\") pod \"lws-controller-manager-68759d94bb-l4nvg\" (UID: \"8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3\") " pod="openshift-lws-operator/lws-controller-manager-68759d94bb-l4nvg"
Jul 22 13:00:37.706919 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:37.706739    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3-manager-config\") pod \"lws-controller-manager-68759d94bb-l4nvg\" (UID: \"8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3\") " pod="openshift-lws-operator/lws-controller-manager-68759d94bb-l4nvg"
Jul 22 13:00:37.706919 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:37.706820    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4zzb\" (UniqueName: \"kubernetes.io/projected/8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3-kube-api-access-j4zzb\") pod \"lws-controller-manager-68759d94bb-l4nvg\" (UID: \"8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3\") " pod="openshift-lws-operator/lws-controller-manager-68759d94bb-l4nvg"
Jul 22 13:00:37.807934 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:37.807902    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4zzb\" (UniqueName: \"kubernetes.io/projected/8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3-kube-api-access-j4zzb\") pod \"lws-controller-manager-68759d94bb-l4nvg\" (UID: \"8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3\") " pod="openshift-lws-operator/lws-controller-manager-68759d94bb-l4nvg"
Jul 22 13:00:37.808148 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:37.807949    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3-cert\") pod \"lws-controller-manager-68759d94bb-l4nvg\" (UID: \"8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3\") " pod="openshift-lws-operator/lws-controller-manager-68759d94bb-l4nvg"
Jul 22 13:00:37.808148 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:37.807970    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3-metrics-cert\") pod \"lws-controller-manager-68759d94bb-l4nvg\" (UID: \"8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3\") " pod="openshift-lws-operator/lws-controller-manager-68759d94bb-l4nvg"
Jul 22 13:00:37.808148 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:37.807995    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3-manager-config\") pod \"lws-controller-manager-68759d94bb-l4nvg\" (UID: \"8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3\") " pod="openshift-lws-operator/lws-controller-manager-68759d94bb-l4nvg"
Jul 22 13:00:37.808587 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:37.808542    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3-manager-config\") pod \"lws-controller-manager-68759d94bb-l4nvg\" (UID: \"8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3\") " pod="openshift-lws-operator/lws-controller-manager-68759d94bb-l4nvg"
Jul 22 13:00:37.810378 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:37.810358    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3-metrics-cert\") pod \"lws-controller-manager-68759d94bb-l4nvg\" (UID: \"8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3\") " pod="openshift-lws-operator/lws-controller-manager-68759d94bb-l4nvg"
Jul 22 13:00:37.810493 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:37.810475    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3-cert\") pod \"lws-controller-manager-68759d94bb-l4nvg\" (UID: \"8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3\") " pod="openshift-lws-operator/lws-controller-manager-68759d94bb-l4nvg"
Jul 22 13:00:37.817434 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:37.817412    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4zzb\" (UniqueName: \"kubernetes.io/projected/8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3-kube-api-access-j4zzb\") pod \"lws-controller-manager-68759d94bb-l4nvg\" (UID: \"8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3\") " pod="openshift-lws-operator/lws-controller-manager-68759d94bb-l4nvg"
Jul 22 13:00:37.970033 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:37.969932    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68759d94bb-l4nvg"
Jul 22 13:00:38.112566 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:38.112535    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68759d94bb-l4nvg"]
Jul 22 13:00:38.117397 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:00:38.117376    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ff6f4ed_44eb_42f1_97c2_444f1a2ae6a3.slice/crio-fed428366285ca1b00a8449f013ff24b656db02c57b52b240cc88daab4cbb09d WatchSource:0}: Error finding container fed428366285ca1b00a8449f013ff24b656db02c57b52b240cc88daab4cbb09d: Status 404 returned error can't find the container with id fed428366285ca1b00a8449f013ff24b656db02c57b52b240cc88daab4cbb09d
Jul 22 13:00:38.244804 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:38.244721    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68759d94bb-l4nvg" event={"ID":"8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3","Type":"ContainerStarted","Data":"fed428366285ca1b00a8449f013ff24b656db02c57b52b240cc88daab4cbb09d"}
Jul 22 13:00:40.255788 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:40.255755    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68759d94bb-l4nvg" event={"ID":"8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3","Type":"ContainerStarted","Data":"d17168f265b93b562d90302d7fc0b8bd7440b48059de5045f6fa55a1ae036c66"}
Jul 22 13:00:40.256170 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:40.255838    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68759d94bb-l4nvg"
Jul 22 13:00:40.278661 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:40.278613    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-68759d94bb-l4nvg" podStartSLOduration=1.646315288 podStartE2EDuration="3.27859738s" totalImagesPullingTime="1.632282092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:00:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:00:40.2781102 +0000 UTC m=+388.042761827" watchObservedRunningTime="2026-07-22 13:00:40.27859738 +0000 UTC m=+388.043249006"
Jul 22 13:00:48.623129 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.623094    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"]
Jul 22 13:00:48.629582 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.629562    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.632057 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.632032    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 13:00:48.632167 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.632061    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 22 13:00:48.632167 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.632087    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9cpw9\""
Jul 22 13:00:48.632484 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.632471    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 13:00:48.639207 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.639182    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"]
Jul 22 13:00:48.692233 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.692197    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80ed3fa8-50b3-46ea-85ed-d090da5369e0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.692397 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.692243    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80ed3fa8-50b3-46ea-85ed-d090da5369e0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.692397 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.692264    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bmbp\" (UniqueName: \"kubernetes.io/projected/80ed3fa8-50b3-46ea-85ed-d090da5369e0-kube-api-access-6bmbp\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.692397 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.692330    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80ed3fa8-50b3-46ea-85ed-d090da5369e0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.692397 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.692365    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80ed3fa8-50b3-46ea-85ed-d090da5369e0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.692397 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.692384    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80ed3fa8-50b3-46ea-85ed-d090da5369e0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.692558 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.692400    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80ed3fa8-50b3-46ea-85ed-d090da5369e0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.692558 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.692419    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80ed3fa8-50b3-46ea-85ed-d090da5369e0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.692558 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.692470    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80ed3fa8-50b3-46ea-85ed-d090da5369e0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.793517 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.793478    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80ed3fa8-50b3-46ea-85ed-d090da5369e0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.793517 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.793520    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bmbp\" (UniqueName: \"kubernetes.io/projected/80ed3fa8-50b3-46ea-85ed-d090da5369e0-kube-api-access-6bmbp\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.793736 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.793542    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80ed3fa8-50b3-46ea-85ed-d090da5369e0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.793736 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.793558    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80ed3fa8-50b3-46ea-85ed-d090da5369e0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.793736 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.793577    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80ed3fa8-50b3-46ea-85ed-d090da5369e0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.793736 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.793592    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80ed3fa8-50b3-46ea-85ed-d090da5369e0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.793736 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.793617    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80ed3fa8-50b3-46ea-85ed-d090da5369e0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.793736 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.793666    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80ed3fa8-50b3-46ea-85ed-d090da5369e0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.794032 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.793777    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80ed3fa8-50b3-46ea-85ed-d090da5369e0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.794080 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.794033    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80ed3fa8-50b3-46ea-85ed-d090da5369e0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.794551 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.794523    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80ed3fa8-50b3-46ea-85ed-d090da5369e0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.794723 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.794688    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80ed3fa8-50b3-46ea-85ed-d090da5369e0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.794848 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.794824    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80ed3fa8-50b3-46ea-85ed-d090da5369e0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.794971 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.794946    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80ed3fa8-50b3-46ea-85ed-d090da5369e0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.800172 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.800148    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80ed3fa8-50b3-46ea-85ed-d090da5369e0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.800490 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.800469    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80ed3fa8-50b3-46ea-85ed-d090da5369e0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.804775 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.804756    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80ed3fa8-50b3-46ea-85ed-d090da5369e0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.805025 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.805009    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bmbp\" (UniqueName: \"kubernetes.io/projected/80ed3fa8-50b3-46ea-85ed-d090da5369e0-kube-api-access-6bmbp\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678r9kqv\" (UID: \"80ed3fa8-50b3-46ea-85ed-d090da5369e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:48.940149 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:48.940056    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:49.069437 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:49.069407    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"]
Jul 22 13:00:49.071788 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:00:49.071764    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ed3fa8_50b3_46ea_85ed_d090da5369e0.slice/crio-a05490cd0ddb6a2645e7aa9e4d62281a799bcc404db2e9dc5846a020f45243be WatchSource:0}: Error finding container a05490cd0ddb6a2645e7aa9e4d62281a799bcc404db2e9dc5846a020f45243be: Status 404 returned error can't find the container with id a05490cd0ddb6a2645e7aa9e4d62281a799bcc404db2e9dc5846a020f45243be
Jul 22 13:00:49.290218 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:49.290134    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv" event={"ID":"80ed3fa8-50b3-46ea-85ed-d090da5369e0","Type":"ContainerStarted","Data":"a05490cd0ddb6a2645e7aa9e4d62281a799bcc404db2e9dc5846a020f45243be"}
Jul 22 13:00:51.262585 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:51.262552    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68759d94bb-l4nvg"
Jul 22 13:00:51.583917 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:51.583876    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:00:51.584008 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:51.583956    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:00:51.584008 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:51.583990    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:00:52.305273 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:52.305191    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv" event={"ID":"80ed3fa8-50b3-46ea-85ed-d090da5369e0","Type":"ContainerStarted","Data":"f40dc13b068b3040266218141763a078c5f1276f415cb458eb5fa7cfa0f4d3fb"}
Jul 22 13:00:52.328822 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:52.328778    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv" podStartSLOduration=1.818801982 podStartE2EDuration="4.328762788s" totalImagesPullingTime="2.509960806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:00:52.327830084 +0000 UTC m=+400.092481746" watchObservedRunningTime="2026-07-22 13:00:52.328762788 +0000 UTC m=+400.093414479"
Jul 22 13:00:52.941006 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:52.940967    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:52.945363 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:52.945336    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:53.309404 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:53.309322    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:00:53.310285 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:00:53.310267    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678r9kqv"
Jul 22 13:01:30.878332 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:30.878300    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fwffb"]
Jul 22 13:01:30.888377 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:30.888345    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fwffb"
Jul 22 13:01:30.891784 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:30.891661    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-gb4ml\""
Jul 22 13:01:30.891784 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:30.891780    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 13:01:30.892261 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:30.892234    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 13:01:30.893197 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:30.893171    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fwffb"]
Jul 22 13:01:31.031777 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:31.031737    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fgxh\" (UniqueName: \"kubernetes.io/projected/a80f866b-94e9-4004-849d-926214d7a823-kube-api-access-6fgxh\") pod \"kuadrant-operator-catalog-fwffb\" (UID: \"a80f866b-94e9-4004-849d-926214d7a823\") " pod="kuadrant-system/kuadrant-operator-catalog-fwffb"
Jul 22 13:01:31.132940 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:31.132858    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fgxh\" (UniqueName: \"kubernetes.io/projected/a80f866b-94e9-4004-849d-926214d7a823-kube-api-access-6fgxh\") pod \"kuadrant-operator-catalog-fwffb\" (UID: \"a80f866b-94e9-4004-849d-926214d7a823\") " pod="kuadrant-system/kuadrant-operator-catalog-fwffb"
Jul 22 13:01:31.142549 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:31.142515    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fgxh\" (UniqueName: \"kubernetes.io/projected/a80f866b-94e9-4004-849d-926214d7a823-kube-api-access-6fgxh\") pod \"kuadrant-operator-catalog-fwffb\" (UID: \"a80f866b-94e9-4004-849d-926214d7a823\") " pod="kuadrant-system/kuadrant-operator-catalog-fwffb"
Jul 22 13:01:31.199568 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:31.199530    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fwffb"
Jul 22 13:01:31.232943 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:31.232898    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fwffb"]
Jul 22 13:01:31.340597 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:31.340567    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fwffb"]
Jul 22 13:01:31.344859 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:01:31.344835    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda80f866b_94e9_4004_849d_926214d7a823.slice/crio-564ef6f8066fb7ad8d64a8c833f3a02b381c7094f0d09d4f1269e61536ca1e68 WatchSource:0}: Error finding container 564ef6f8066fb7ad8d64a8c833f3a02b381c7094f0d09d4f1269e61536ca1e68: Status 404 returned error can't find the container with id 564ef6f8066fb7ad8d64a8c833f3a02b381c7094f0d09d4f1269e61536ca1e68
Jul 22 13:01:31.441840 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:31.441752    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2zgbl"]
Jul 22 13:01:31.446411 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:31.446388    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2zgbl"
Jul 22 13:01:31.453654 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:31.453494    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2zgbl"]
Jul 22 13:01:31.462847 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:31.462821    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fwffb" event={"ID":"a80f866b-94e9-4004-849d-926214d7a823","Type":"ContainerStarted","Data":"564ef6f8066fb7ad8d64a8c833f3a02b381c7094f0d09d4f1269e61536ca1e68"}
Jul 22 13:01:31.536251 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:31.536214    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4lnn\" (UniqueName: \"kubernetes.io/projected/0389e960-1445-48d7-9b98-27d38287f1bc-kube-api-access-b4lnn\") pod \"kuadrant-operator-catalog-2zgbl\" (UID: \"0389e960-1445-48d7-9b98-27d38287f1bc\") " pod="kuadrant-system/kuadrant-operator-catalog-2zgbl"
Jul 22 13:01:31.637118 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:31.637081    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4lnn\" (UniqueName: \"kubernetes.io/projected/0389e960-1445-48d7-9b98-27d38287f1bc-kube-api-access-b4lnn\") pod \"kuadrant-operator-catalog-2zgbl\" (UID: \"0389e960-1445-48d7-9b98-27d38287f1bc\") " pod="kuadrant-system/kuadrant-operator-catalog-2zgbl"
Jul 22 13:01:31.646533 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:31.646498    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4lnn\" (UniqueName: \"kubernetes.io/projected/0389e960-1445-48d7-9b98-27d38287f1bc-kube-api-access-b4lnn\") pod \"kuadrant-operator-catalog-2zgbl\" (UID: \"0389e960-1445-48d7-9b98-27d38287f1bc\") " pod="kuadrant-system/kuadrant-operator-catalog-2zgbl"
Jul 22 13:01:31.756935 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:31.756836    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2zgbl"
Jul 22 13:01:31.885003 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:31.884967    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2zgbl"]
Jul 22 13:01:31.887625 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:01:31.887601    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0389e960_1445_48d7_9b98_27d38287f1bc.slice/crio-8594667f1b3f865ea5959f18d39d53a58b9b27f6ce787a1f2f2fc85c3ebbab55 WatchSource:0}: Error finding container 8594667f1b3f865ea5959f18d39d53a58b9b27f6ce787a1f2f2fc85c3ebbab55: Status 404 returned error can't find the container with id 8594667f1b3f865ea5959f18d39d53a58b9b27f6ce787a1f2f2fc85c3ebbab55
Jul 22 13:01:32.469249 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:32.469208    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2zgbl" event={"ID":"0389e960-1445-48d7-9b98-27d38287f1bc","Type":"ContainerStarted","Data":"8594667f1b3f865ea5959f18d39d53a58b9b27f6ce787a1f2f2fc85c3ebbab55"}
Jul 22 13:01:35.485798 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:35.485761    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fwffb" event={"ID":"a80f866b-94e9-4004-849d-926214d7a823","Type":"ContainerStarted","Data":"e5d76cdc416870e9b4682826762c98aabad87c7d82372e36af4b3833495c40c6"}
Jul 22 13:01:35.486254 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:35.485845    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-fwffb" podUID="a80f866b-94e9-4004-849d-926214d7a823" containerName="registry-server" containerID="cri-o://e5d76cdc416870e9b4682826762c98aabad87c7d82372e36af4b3833495c40c6" gracePeriod=2
Jul 22 13:01:35.487418 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:35.487391    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2zgbl" event={"ID":"0389e960-1445-48d7-9b98-27d38287f1bc","Type":"ContainerStarted","Data":"5fa27dfb523cdb1d40d86d5197dfd3cfab4dd491c67122997de7f28a849d7a91"}
Jul 22 13:01:35.502524 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:35.502477    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fwffb" podStartSLOduration=2.417634619 podStartE2EDuration="5.502462489s" totalImagesPullingTime="3.08482787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:01:35.502338433 +0000 UTC m=+443.266990059" watchObservedRunningTime="2026-07-22 13:01:35.502462489 +0000 UTC m=+443.267114114"
Jul 22 13:01:35.518764 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:35.518703    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2zgbl" podStartSLOduration=1.812164527 podStartE2EDuration="4.518689476s" totalImagesPullingTime="2.706524949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:01:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:01:35.51718943 +0000 UTC m=+443.281841058" watchObservedRunningTime="2026-07-22 13:01:35.518689476 +0000 UTC m=+443.283341101"
Jul 22 13:01:35.732348 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:35.732322    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fwffb"
Jul 22 13:01:35.872208 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:35.872178    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fgxh\" (UniqueName: \"kubernetes.io/projected/a80f866b-94e9-4004-849d-926214d7a823-kube-api-access-6fgxh\") pod \"a80f866b-94e9-4004-849d-926214d7a823\" (UID: \"a80f866b-94e9-4004-849d-926214d7a823\") "
Jul 22 13:01:35.874289 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:35.874261    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a80f866b-94e9-4004-849d-926214d7a823-kube-api-access-6fgxh" (OuterVolumeSpecName: "kube-api-access-6fgxh") pod "a80f866b-94e9-4004-849d-926214d7a823" (UID: "a80f866b-94e9-4004-849d-926214d7a823"). InnerVolumeSpecName "kube-api-access-6fgxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:01:35.973319 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:35.973279    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fgxh\" (UniqueName: \"kubernetes.io/projected/a80f866b-94e9-4004-849d-926214d7a823-kube-api-access-6fgxh\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:01:36.492207 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:36.492168    2557 generic.go:356] "Generic (PLEG): container finished" podID="a80f866b-94e9-4004-849d-926214d7a823" containerID="e5d76cdc416870e9b4682826762c98aabad87c7d82372e36af4b3833495c40c6" exitCode=0
Jul 22 13:01:36.492207 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:36.492213    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fwffb"
Jul 22 13:01:36.492682 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:36.492248    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fwffb" event={"ID":"a80f866b-94e9-4004-849d-926214d7a823","Type":"ContainerDied","Data":"e5d76cdc416870e9b4682826762c98aabad87c7d82372e36af4b3833495c40c6"}
Jul 22 13:01:36.492682 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:36.492300    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fwffb" event={"ID":"a80f866b-94e9-4004-849d-926214d7a823","Type":"ContainerDied","Data":"564ef6f8066fb7ad8d64a8c833f3a02b381c7094f0d09d4f1269e61536ca1e68"}
Jul 22 13:01:36.492682 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:36.492325    2557 scope.go:117] "RemoveContainer" containerID="e5d76cdc416870e9b4682826762c98aabad87c7d82372e36af4b3833495c40c6"
Jul 22 13:01:36.500673 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:36.500655    2557 scope.go:117] "RemoveContainer" containerID="e5d76cdc416870e9b4682826762c98aabad87c7d82372e36af4b3833495c40c6"
Jul 22 13:01:36.500972 ip-10-0-141-162 kubenswrapper[2557]: E0722 13:01:36.500953    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5d76cdc416870e9b4682826762c98aabad87c7d82372e36af4b3833495c40c6\": container with ID starting with e5d76cdc416870e9b4682826762c98aabad87c7d82372e36af4b3833495c40c6 not found: ID does not exist" containerID="e5d76cdc416870e9b4682826762c98aabad87c7d82372e36af4b3833495c40c6"
Jul 22 13:01:36.501042 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:36.500985    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5d76cdc416870e9b4682826762c98aabad87c7d82372e36af4b3833495c40c6"} err="failed to get container status \"e5d76cdc416870e9b4682826762c98aabad87c7d82372e36af4b3833495c40c6\": rpc error: code = NotFound desc = could not find container \"e5d76cdc416870e9b4682826762c98aabad87c7d82372e36af4b3833495c40c6\": container with ID starting with e5d76cdc416870e9b4682826762c98aabad87c7d82372e36af4b3833495c40c6 not found: ID does not exist"
Jul 22 13:01:36.513680 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:36.513657    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fwffb"]
Jul 22 13:01:36.520652 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:36.520630    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fwffb"]
Jul 22 13:01:36.808442 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:36.808363    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a80f866b-94e9-4004-849d-926214d7a823" path="/var/lib/kubelet/pods/a80f866b-94e9-4004-849d-926214d7a823/volumes"
Jul 22 13:01:41.757460 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:41.757423    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-2zgbl"
Jul 22 13:01:41.757984 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:41.757501    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-2zgbl"
Jul 22 13:01:41.779220 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:41.779197    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-2zgbl"
Jul 22 13:01:42.542984 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:42.542959    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-2zgbl"
Jul 22 13:01:54.179799 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.179765    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d7995dc68-jhmqs"]
Jul 22 13:01:54.180210 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.180033    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a80f866b-94e9-4004-849d-926214d7a823" containerName="registry-server"
Jul 22 13:01:54.180210 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.180044    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a80f866b-94e9-4004-849d-926214d7a823" containerName="registry-server"
Jul 22 13:01:54.180210 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.180097    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a80f866b-94e9-4004-849d-926214d7a823" containerName="registry-server"
Jul 22 13:01:54.184061 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.184045    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.197893 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.197869    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d7995dc68-jhmqs"]
Jul 22 13:01:54.219973 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.219935    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fece7a9b-ee0d-4197-89d4-632fb93fbbf3-console-oauth-config\") pod \"console-7d7995dc68-jhmqs\" (UID: \"fece7a9b-ee0d-4197-89d4-632fb93fbbf3\") " pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.220133 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.219999    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fece7a9b-ee0d-4197-89d4-632fb93fbbf3-service-ca\") pod \"console-7d7995dc68-jhmqs\" (UID: \"fece7a9b-ee0d-4197-89d4-632fb93fbbf3\") " pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.220133 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.220022    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fece7a9b-ee0d-4197-89d4-632fb93fbbf3-trusted-ca-bundle\") pod \"console-7d7995dc68-jhmqs\" (UID: \"fece7a9b-ee0d-4197-89d4-632fb93fbbf3\") " pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.220133 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.220052    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fece7a9b-ee0d-4197-89d4-632fb93fbbf3-console-serving-cert\") pod \"console-7d7995dc68-jhmqs\" (UID: \"fece7a9b-ee0d-4197-89d4-632fb93fbbf3\") " pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.220133 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.220080    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fece7a9b-ee0d-4197-89d4-632fb93fbbf3-console-config\") pod \"console-7d7995dc68-jhmqs\" (UID: \"fece7a9b-ee0d-4197-89d4-632fb93fbbf3\") " pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.220133 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.220117    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxd7h\" (UniqueName: \"kubernetes.io/projected/fece7a9b-ee0d-4197-89d4-632fb93fbbf3-kube-api-access-rxd7h\") pod \"console-7d7995dc68-jhmqs\" (UID: \"fece7a9b-ee0d-4197-89d4-632fb93fbbf3\") " pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.220292 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.220136    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fece7a9b-ee0d-4197-89d4-632fb93fbbf3-oauth-serving-cert\") pod \"console-7d7995dc68-jhmqs\" (UID: \"fece7a9b-ee0d-4197-89d4-632fb93fbbf3\") " pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.320821 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.320782    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxd7h\" (UniqueName: \"kubernetes.io/projected/fece7a9b-ee0d-4197-89d4-632fb93fbbf3-kube-api-access-rxd7h\") pod \"console-7d7995dc68-jhmqs\" (UID: \"fece7a9b-ee0d-4197-89d4-632fb93fbbf3\") " pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.320821 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.320825    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fece7a9b-ee0d-4197-89d4-632fb93fbbf3-oauth-serving-cert\") pod \"console-7d7995dc68-jhmqs\" (UID: \"fece7a9b-ee0d-4197-89d4-632fb93fbbf3\") " pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.321048 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.320853    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fece7a9b-ee0d-4197-89d4-632fb93fbbf3-console-oauth-config\") pod \"console-7d7995dc68-jhmqs\" (UID: \"fece7a9b-ee0d-4197-89d4-632fb93fbbf3\") " pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.321048 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.320901    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fece7a9b-ee0d-4197-89d4-632fb93fbbf3-service-ca\") pod \"console-7d7995dc68-jhmqs\" (UID: \"fece7a9b-ee0d-4197-89d4-632fb93fbbf3\") " pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.321048 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.320927    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fece7a9b-ee0d-4197-89d4-632fb93fbbf3-trusted-ca-bundle\") pod \"console-7d7995dc68-jhmqs\" (UID: \"fece7a9b-ee0d-4197-89d4-632fb93fbbf3\") " pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.321048 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.320967    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fece7a9b-ee0d-4197-89d4-632fb93fbbf3-console-serving-cert\") pod \"console-7d7995dc68-jhmqs\" (UID: \"fece7a9b-ee0d-4197-89d4-632fb93fbbf3\") " pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.321048 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.320994    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fece7a9b-ee0d-4197-89d4-632fb93fbbf3-console-config\") pod \"console-7d7995dc68-jhmqs\" (UID: \"fece7a9b-ee0d-4197-89d4-632fb93fbbf3\") " pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.321675 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.321619    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fece7a9b-ee0d-4197-89d4-632fb93fbbf3-oauth-serving-cert\") pod \"console-7d7995dc68-jhmqs\" (UID: \"fece7a9b-ee0d-4197-89d4-632fb93fbbf3\") " pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.321839 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.321679    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fece7a9b-ee0d-4197-89d4-632fb93fbbf3-console-config\") pod \"console-7d7995dc68-jhmqs\" (UID: \"fece7a9b-ee0d-4197-89d4-632fb93fbbf3\") " pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.321839 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.321700    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fece7a9b-ee0d-4197-89d4-632fb93fbbf3-service-ca\") pod \"console-7d7995dc68-jhmqs\" (UID: \"fece7a9b-ee0d-4197-89d4-632fb93fbbf3\") " pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.321839 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.321798    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fece7a9b-ee0d-4197-89d4-632fb93fbbf3-trusted-ca-bundle\") pod \"console-7d7995dc68-jhmqs\" (UID: \"fece7a9b-ee0d-4197-89d4-632fb93fbbf3\") " pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.323403 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.323373    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fece7a9b-ee0d-4197-89d4-632fb93fbbf3-console-serving-cert\") pod \"console-7d7995dc68-jhmqs\" (UID: \"fece7a9b-ee0d-4197-89d4-632fb93fbbf3\") " pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.323499 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.323411    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fece7a9b-ee0d-4197-89d4-632fb93fbbf3-console-oauth-config\") pod \"console-7d7995dc68-jhmqs\" (UID: \"fece7a9b-ee0d-4197-89d4-632fb93fbbf3\") " pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.330754 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.330726    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxd7h\" (UniqueName: \"kubernetes.io/projected/fece7a9b-ee0d-4197-89d4-632fb93fbbf3-kube-api-access-rxd7h\") pod \"console-7d7995dc68-jhmqs\" (UID: \"fece7a9b-ee0d-4197-89d4-632fb93fbbf3\") " pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.493590 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.493494    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:01:54.629526 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:54.629492    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d7995dc68-jhmqs"]
Jul 22 13:01:54.633237 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:01:54.633206    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfece7a9b_ee0d_4197_89d4_632fb93fbbf3.slice/crio-84700da81cfd51b1d7e9eec6a23db2dc90afac9e08f94d23065482d7c55b4f50 WatchSource:0}: Error finding container 84700da81cfd51b1d7e9eec6a23db2dc90afac9e08f94d23065482d7c55b4f50: Status 404 returned error can't find the container with id 84700da81cfd51b1d7e9eec6a23db2dc90afac9e08f94d23065482d7c55b4f50
Jul 22 13:01:55.577310 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:55.577278    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7995dc68-jhmqs" event={"ID":"fece7a9b-ee0d-4197-89d4-632fb93fbbf3","Type":"ContainerStarted","Data":"eddf562e134f04298dc804ec1cb05bfcd2b79dc40500751327d3ba7e10d38c13"}
Jul 22 13:01:55.577849 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:55.577324    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d7995dc68-jhmqs" event={"ID":"fece7a9b-ee0d-4197-89d4-632fb93fbbf3","Type":"ContainerStarted","Data":"84700da81cfd51b1d7e9eec6a23db2dc90afac9e08f94d23065482d7c55b4f50"}
Jul 22 13:01:55.599824 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:01:55.599767    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d7995dc68-jhmqs" podStartSLOduration=1.599751312 podStartE2EDuration="1.599751312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:01:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:01:55.598545538 +0000 UTC m=+463.363197164" watchObservedRunningTime="2026-07-22 13:01:55.599751312 +0000 UTC m=+463.364402939"
Jul 22 13:02:03.745648 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:03.745606    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-klcmg"]
Jul 22 13:02:03.770477 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:03.770445    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-klcmg"]
Jul 22 13:02:03.770644 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:03.770581    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-klcmg"
Jul 22 13:02:03.773150 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:03.773130    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-rg89r\""
Jul 22 13:02:03.904453 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:03.904413    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq66z\" (UniqueName: \"kubernetes.io/projected/c99ef40d-1c69-4cd8-8716-cc0efeef7f72-kube-api-access-qq66z\") pod \"authorino-operator-75cc8d5cb7-klcmg\" (UID: \"c99ef40d-1c69-4cd8-8716-cc0efeef7f72\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-klcmg"
Jul 22 13:02:04.005690 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:04.005578    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq66z\" (UniqueName: \"kubernetes.io/projected/c99ef40d-1c69-4cd8-8716-cc0efeef7f72-kube-api-access-qq66z\") pod \"authorino-operator-75cc8d5cb7-klcmg\" (UID: \"c99ef40d-1c69-4cd8-8716-cc0efeef7f72\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-klcmg"
Jul 22 13:02:04.020478 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:04.020454    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq66z\" (UniqueName: \"kubernetes.io/projected/c99ef40d-1c69-4cd8-8716-cc0efeef7f72-kube-api-access-qq66z\") pod \"authorino-operator-75cc8d5cb7-klcmg\" (UID: \"c99ef40d-1c69-4cd8-8716-cc0efeef7f72\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-klcmg"
Jul 22 13:02:04.083260 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:04.083219    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-klcmg"
Jul 22 13:02:04.228677 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:04.228643    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-klcmg"]
Jul 22 13:02:04.232352 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:02:04.232312    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc99ef40d_1c69_4cd8_8716_cc0efeef7f72.slice/crio-b641f9177fda2a8222b36c63591017195c67cbe86d5f2a068cb48716b3c71398 WatchSource:0}: Error finding container b641f9177fda2a8222b36c63591017195c67cbe86d5f2a068cb48716b3c71398: Status 404 returned error can't find the container with id b641f9177fda2a8222b36c63591017195c67cbe86d5f2a068cb48716b3c71398
Jul 22 13:02:04.494483 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:04.494441    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:02:04.494747 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:04.494534    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:02:04.499170 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:04.499147    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:02:04.614603 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:04.614560    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-klcmg" event={"ID":"c99ef40d-1c69-4cd8-8716-cc0efeef7f72","Type":"ContainerStarted","Data":"b641f9177fda2a8222b36c63591017195c67cbe86d5f2a068cb48716b3c71398"}
Jul 22 13:02:04.618446 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:04.618421    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d7995dc68-jhmqs"
Jul 22 13:02:04.780525 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:04.780435    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b9cff4d8f-zjfdk"]
Jul 22 13:02:07.631226 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:07.631193    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-klcmg" event={"ID":"c99ef40d-1c69-4cd8-8716-cc0efeef7f72","Type":"ContainerStarted","Data":"8b6dffb29c61309098fc9539f0b125f49cfc28930a9b6d1d4cda705c84a253a4"}
Jul 22 13:02:07.631609 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:07.631270    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-klcmg"
Jul 22 13:02:07.664486 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:07.664430    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-klcmg" podStartSLOduration=1.718403612 podStartE2EDuration="4.664410205s" totalImagesPullingTime="2.946006593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:02:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:02:07.663606892 +0000 UTC m=+475.428258519" watchObservedRunningTime="2026-07-22 13:02:07.664410205 +0000 UTC m=+475.429061831"
Jul 22 13:02:14.571949 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:14.571907    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mfdd"]
Jul 22 13:02:14.575238 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:14.575217    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mfdd"
Jul 22 13:02:14.577611 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:14.577592    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-2ztnp\""
Jul 22 13:02:14.577732 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:14.577615    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 22 13:02:14.589950 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:14.589927    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mfdd"]
Jul 22 13:02:14.706084 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:14.706042    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d98ld\" (UniqueName: \"kubernetes.io/projected/0e51d5dc-9a77-4b59-9a0b-c4a4dce78b1f-kube-api-access-d98ld\") pod \"dns-operator-controller-manager-864dd78c4c-6mfdd\" (UID: \"0e51d5dc-9a77-4b59-9a0b-c4a4dce78b1f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mfdd"
Jul 22 13:02:14.807028 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:14.807000    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d98ld\" (UniqueName: \"kubernetes.io/projected/0e51d5dc-9a77-4b59-9a0b-c4a4dce78b1f-kube-api-access-d98ld\") pod \"dns-operator-controller-manager-864dd78c4c-6mfdd\" (UID: \"0e51d5dc-9a77-4b59-9a0b-c4a4dce78b1f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mfdd"
Jul 22 13:02:14.821769 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:14.821743    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d98ld\" (UniqueName: \"kubernetes.io/projected/0e51d5dc-9a77-4b59-9a0b-c4a4dce78b1f-kube-api-access-d98ld\") pod \"dns-operator-controller-manager-864dd78c4c-6mfdd\" (UID: \"0e51d5dc-9a77-4b59-9a0b-c4a4dce78b1f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mfdd"
Jul 22 13:02:14.885453 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:14.885422    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mfdd"
Jul 22 13:02:15.039381 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:15.039345    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mfdd"]
Jul 22 13:02:15.040357 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:02:15.040326    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e51d5dc_9a77_4b59_9a0b_c4a4dce78b1f.slice/crio-6c6528b2c53e7de1119d25b4bd6971bd3fc0651ec32e816cc0a862ad460d7855 WatchSource:0}: Error finding container 6c6528b2c53e7de1119d25b4bd6971bd3fc0651ec32e816cc0a862ad460d7855: Status 404 returned error can't find the container with id 6c6528b2c53e7de1119d25b4bd6971bd3fc0651ec32e816cc0a862ad460d7855
Jul 22 13:02:15.665785 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:15.665748    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mfdd" event={"ID":"0e51d5dc-9a77-4b59-9a0b-c4a4dce78b1f","Type":"ContainerStarted","Data":"6c6528b2c53e7de1119d25b4bd6971bd3fc0651ec32e816cc0a862ad460d7855"}
Jul 22 13:02:17.676929 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:17.676892    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mfdd" event={"ID":"0e51d5dc-9a77-4b59-9a0b-c4a4dce78b1f","Type":"ContainerStarted","Data":"55ab082534e25eaa18cf71b18417ebad441f9ba35edce705c57ed21452d5d995"}
Jul 22 13:02:17.677365 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:17.676998    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mfdd"
Jul 22 13:02:17.697185 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:17.697127    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mfdd" podStartSLOduration=1.720185946 podStartE2EDuration="3.697109308s" totalImagesPullingTime="1.976923362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:02:17.696037754 +0000 UTC m=+485.460689381" watchObservedRunningTime="2026-07-22 13:02:17.697109308 +0000 UTC m=+485.461760933"
Jul 22 13:02:18.637427 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:18.637398    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-klcmg"
Jul 22 13:02:20.674823 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:20.674786    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-w55d9"]
Jul 22 13:02:20.678010 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:20.677988    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w55d9"
Jul 22 13:02:20.682380 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:20.682354    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 22 13:02:20.682549 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:20.682418    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 22 13:02:20.682549 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:20.682473    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7hlsk\""
Jul 22 13:02:20.702894 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:20.702859    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-w55d9"]
Jul 22 13:02:20.765378 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:20.765340    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/514f6fc2-990c-414d-8c2e-035ae9bc9e08-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-w55d9\" (UID: \"514f6fc2-990c-414d-8c2e-035ae9bc9e08\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w55d9"
Jul 22 13:02:20.765378 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:20.765381    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7gb5\" (UniqueName: \"kubernetes.io/projected/514f6fc2-990c-414d-8c2e-035ae9bc9e08-kube-api-access-n7gb5\") pod \"kuadrant-console-plugin-66b5774985-w55d9\" (UID: \"514f6fc2-990c-414d-8c2e-035ae9bc9e08\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w55d9"
Jul 22 13:02:20.765611 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:20.765415    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/514f6fc2-990c-414d-8c2e-035ae9bc9e08-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-w55d9\" (UID: \"514f6fc2-990c-414d-8c2e-035ae9bc9e08\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w55d9"
Jul 22 13:02:20.865998 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:20.865962    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/514f6fc2-990c-414d-8c2e-035ae9bc9e08-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-w55d9\" (UID: \"514f6fc2-990c-414d-8c2e-035ae9bc9e08\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w55d9"
Jul 22 13:02:20.865998 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:20.865996    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7gb5\" (UniqueName: \"kubernetes.io/projected/514f6fc2-990c-414d-8c2e-035ae9bc9e08-kube-api-access-n7gb5\") pod \"kuadrant-console-plugin-66b5774985-w55d9\" (UID: \"514f6fc2-990c-414d-8c2e-035ae9bc9e08\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w55d9"
Jul 22 13:02:20.866224 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:20.866024    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/514f6fc2-990c-414d-8c2e-035ae9bc9e08-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-w55d9\" (UID: \"514f6fc2-990c-414d-8c2e-035ae9bc9e08\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w55d9"
Jul 22 13:02:20.866224 ip-10-0-141-162 kubenswrapper[2557]: E0722 13:02:20.866133    2557 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 22 13:02:20.866224 ip-10-0-141-162 kubenswrapper[2557]: E0722 13:02:20.866188    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/514f6fc2-990c-414d-8c2e-035ae9bc9e08-plugin-serving-cert podName:514f6fc2-990c-414d-8c2e-035ae9bc9e08 nodeName:}" failed. No retries permitted until 2026-07-22 13:02:21.366171524 +0000 UTC m=+489.130823128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/514f6fc2-990c-414d-8c2e-035ae9bc9e08-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-w55d9" (UID: "514f6fc2-990c-414d-8c2e-035ae9bc9e08") : secret "plugin-serving-cert" not found
Jul 22 13:02:20.866639 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:20.866618    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/514f6fc2-990c-414d-8c2e-035ae9bc9e08-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-w55d9\" (UID: \"514f6fc2-990c-414d-8c2e-035ae9bc9e08\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w55d9"
Jul 22 13:02:20.876480 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:20.876442    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7gb5\" (UniqueName: \"kubernetes.io/projected/514f6fc2-990c-414d-8c2e-035ae9bc9e08-kube-api-access-n7gb5\") pod \"kuadrant-console-plugin-66b5774985-w55d9\" (UID: \"514f6fc2-990c-414d-8c2e-035ae9bc9e08\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w55d9"
Jul 22 13:02:21.369442 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:21.369403    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/514f6fc2-990c-414d-8c2e-035ae9bc9e08-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-w55d9\" (UID: \"514f6fc2-990c-414d-8c2e-035ae9bc9e08\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w55d9"
Jul 22 13:02:21.371895 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:21.371864    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/514f6fc2-990c-414d-8c2e-035ae9bc9e08-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-w55d9\" (UID: \"514f6fc2-990c-414d-8c2e-035ae9bc9e08\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w55d9"
Jul 22 13:02:21.586995 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:21.586956    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w55d9"
Jul 22 13:02:21.728364 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:21.728338    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-w55d9"]
Jul 22 13:02:21.730804 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:02:21.730769    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod514f6fc2_990c_414d_8c2e_035ae9bc9e08.slice/crio-b62578c3483405d3e1dbbcaa9ededb43fb6d9dc22fb313dbe3ecbe35d02f3995 WatchSource:0}: Error finding container b62578c3483405d3e1dbbcaa9ededb43fb6d9dc22fb313dbe3ecbe35d02f3995: Status 404 returned error can't find the container with id b62578c3483405d3e1dbbcaa9ededb43fb6d9dc22fb313dbe3ecbe35d02f3995
Jul 22 13:02:22.705328 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:22.705288    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w55d9" event={"ID":"514f6fc2-990c-414d-8c2e-035ae9bc9e08","Type":"ContainerStarted","Data":"b62578c3483405d3e1dbbcaa9ededb43fb6d9dc22fb313dbe3ecbe35d02f3995"}
Jul 22 13:02:28.685064 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:28.685026    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-6mfdd"
Jul 22 13:02:29.803137 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:29.803067    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b9cff4d8f-zjfdk" podUID="4929bb38-bc70-4924-94de-d227a5e27bb0" containerName="console" containerID="cri-o://9a807fb08a09678db2eb91f1fb324a56db3138a15dbdec36f21b679bab9e0d4f" gracePeriod=15
Jul 22 13:02:36.695070 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:36.695023    2557 patch_prober.go:28] interesting pod/console-6b9cff4d8f-zjfdk container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" start-of-body=
Jul 22 13:02:36.695551 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:36.695083    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-6b9cff4d8f-zjfdk" podUID="4929bb38-bc70-4924-94de-d227a5e27bb0" containerName="console" probeResult="failure" output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused"
Jul 22 13:02:43.195460 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.195435    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 13:02:43.269502 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.269472    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9dp6\" (UniqueName: \"kubernetes.io/projected/4929bb38-bc70-4924-94de-d227a5e27bb0-kube-api-access-v9dp6\") pod \"4929bb38-bc70-4924-94de-d227a5e27bb0\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") "
Jul 22 13:02:43.269502 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.269505    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-console-config\") pod \"4929bb38-bc70-4924-94de-d227a5e27bb0\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") "
Jul 22 13:02:43.269802 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.269524    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-service-ca\") pod \"4929bb38-bc70-4924-94de-d227a5e27bb0\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") "
Jul 22 13:02:43.269802 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.269569    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4929bb38-bc70-4924-94de-d227a5e27bb0-console-serving-cert\") pod \"4929bb38-bc70-4924-94de-d227a5e27bb0\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") "
Jul 22 13:02:43.269802 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.269587    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4929bb38-bc70-4924-94de-d227a5e27bb0-console-oauth-config\") pod \"4929bb38-bc70-4924-94de-d227a5e27bb0\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") "
Jul 22 13:02:43.269802 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.269611    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-oauth-serving-cert\") pod \"4929bb38-bc70-4924-94de-d227a5e27bb0\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") "
Jul 22 13:02:43.270032 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.269995    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-trusted-ca-bundle\") pod \"4929bb38-bc70-4924-94de-d227a5e27bb0\" (UID: \"4929bb38-bc70-4924-94de-d227a5e27bb0\") "
Jul 22 13:02:43.270095 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.270036    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-service-ca" (OuterVolumeSpecName: "service-ca") pod "4929bb38-bc70-4924-94de-d227a5e27bb0" (UID: "4929bb38-bc70-4924-94de-d227a5e27bb0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:02:43.270347 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.270304    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-service-ca\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:02:43.270478 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.270352    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-console-config" (OuterVolumeSpecName: "console-config") pod "4929bb38-bc70-4924-94de-d227a5e27bb0" (UID: "4929bb38-bc70-4924-94de-d227a5e27bb0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:02:43.270547 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.270483    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4929bb38-bc70-4924-94de-d227a5e27bb0" (UID: "4929bb38-bc70-4924-94de-d227a5e27bb0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:02:43.270899 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.270875    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4929bb38-bc70-4924-94de-d227a5e27bb0" (UID: "4929bb38-bc70-4924-94de-d227a5e27bb0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:02:43.272060 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.272030    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4929bb38-bc70-4924-94de-d227a5e27bb0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4929bb38-bc70-4924-94de-d227a5e27bb0" (UID: "4929bb38-bc70-4924-94de-d227a5e27bb0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:02:43.272231 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.272211    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4929bb38-bc70-4924-94de-d227a5e27bb0-kube-api-access-v9dp6" (OuterVolumeSpecName: "kube-api-access-v9dp6") pod "4929bb38-bc70-4924-94de-d227a5e27bb0" (UID: "4929bb38-bc70-4924-94de-d227a5e27bb0"). InnerVolumeSpecName "kube-api-access-v9dp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:02:43.272298 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.272232    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4929bb38-bc70-4924-94de-d227a5e27bb0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4929bb38-bc70-4924-94de-d227a5e27bb0" (UID: "4929bb38-bc70-4924-94de-d227a5e27bb0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:02:43.371501 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.371468    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-oauth-serving-cert\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:02:43.371501 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.371497    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-trusted-ca-bundle\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:02:43.371698 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.371511    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9dp6\" (UniqueName: \"kubernetes.io/projected/4929bb38-bc70-4924-94de-d227a5e27bb0-kube-api-access-v9dp6\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:02:43.371698 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.371526    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4929bb38-bc70-4924-94de-d227a5e27bb0-console-config\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:02:43.371698 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.371539    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4929bb38-bc70-4924-94de-d227a5e27bb0-console-serving-cert\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:02:43.371698 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.371551    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4929bb38-bc70-4924-94de-d227a5e27bb0-console-oauth-config\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:02:43.812856 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.812759    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w55d9" event={"ID":"514f6fc2-990c-414d-8c2e-035ae9bc9e08","Type":"ContainerStarted","Data":"f6c8a040baa89b99beab00fa8484ea98e59d7e15b4013f211872e419cec148f1"}
Jul 22 13:02:43.814082 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.814055    2557 generic.go:356] "Generic (PLEG): container finished" podID="4929bb38-bc70-4924-94de-d227a5e27bb0" containerID="9a807fb08a09678db2eb91f1fb324a56db3138a15dbdec36f21b679bab9e0d4f" exitCode=0
Jul 22 13:02:43.814168 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.814105    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b9cff4d8f-zjfdk"
Jul 22 13:02:43.814168 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.814140    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9cff4d8f-zjfdk" event={"ID":"4929bb38-bc70-4924-94de-d227a5e27bb0","Type":"ContainerDied","Data":"9a807fb08a09678db2eb91f1fb324a56db3138a15dbdec36f21b679bab9e0d4f"}
Jul 22 13:02:43.814239 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.814201    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b9cff4d8f-zjfdk" event={"ID":"4929bb38-bc70-4924-94de-d227a5e27bb0","Type":"ContainerDied","Data":"d78f8c816d265010107c7d7dbaaf428530332d556b26cfbaa8a97bbece07753e"}
Jul 22 13:02:43.814239 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.814221    2557 scope.go:117] "RemoveContainer" containerID="9a807fb08a09678db2eb91f1fb324a56db3138a15dbdec36f21b679bab9e0d4f"
Jul 22 13:02:43.822883 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.822865    2557 scope.go:117] "RemoveContainer" containerID="9a807fb08a09678db2eb91f1fb324a56db3138a15dbdec36f21b679bab9e0d4f"
Jul 22 13:02:43.823108 ip-10-0-141-162 kubenswrapper[2557]: E0722 13:02:43.823088    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a807fb08a09678db2eb91f1fb324a56db3138a15dbdec36f21b679bab9e0d4f\": container with ID starting with 9a807fb08a09678db2eb91f1fb324a56db3138a15dbdec36f21b679bab9e0d4f not found: ID does not exist" containerID="9a807fb08a09678db2eb91f1fb324a56db3138a15dbdec36f21b679bab9e0d4f"
Jul 22 13:02:43.823167 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.823115    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a807fb08a09678db2eb91f1fb324a56db3138a15dbdec36f21b679bab9e0d4f"} err="failed to get container status \"9a807fb08a09678db2eb91f1fb324a56db3138a15dbdec36f21b679bab9e0d4f\": rpc error: code = NotFound desc = could not find container \"9a807fb08a09678db2eb91f1fb324a56db3138a15dbdec36f21b679bab9e0d4f\": container with ID starting with 9a807fb08a09678db2eb91f1fb324a56db3138a15dbdec36f21b679bab9e0d4f not found: ID does not exist"
Jul 22 13:02:43.831870 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.831831    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w55d9" podStartSLOduration=2.452496123 podStartE2EDuration="23.831818406s" totalImagesPullingTime="21.379322283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:02:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:02:43.830633341 +0000 UTC m=+511.595284968" watchObservedRunningTime="2026-07-22 13:02:43.831818406 +0000 UTC m=+511.596470085"
Jul 22 13:02:43.851360 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.851334    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b9cff4d8f-zjfdk"]
Jul 22 13:02:43.859660 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:43.859638    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b9cff4d8f-zjfdk"]
Jul 22 13:02:44.809144 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:02:44.809111    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4929bb38-bc70-4924-94de-d227a5e27bb0" path="/var/lib/kubelet/pods/4929bb38-bc70-4924-94de-d227a5e27bb0/volumes"
Jul 22 13:03:04.615430 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.615357    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"]
Jul 22 13:03:04.615808 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.615668    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4929bb38-bc70-4924-94de-d227a5e27bb0" containerName="console"
Jul 22 13:03:04.615808 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.615679    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4929bb38-bc70-4924-94de-d227a5e27bb0" containerName="console"
Jul 22 13:03:04.615808 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.615759    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4929bb38-bc70-4924-94de-d227a5e27bb0" containerName="console"
Jul 22 13:03:04.663757 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.663703    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"]
Jul 22 13:03:04.663898 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.663830    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.667925 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.667903    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-sjcrc\""
Jul 22 13:03:04.757642 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.757608    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b5193c6-f351-4535-88ed-eca577e6fa2e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.757642 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.757640    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b5193c6-f351-4535-88ed-eca577e6fa2e-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.757852 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.757665    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b5193c6-f351-4535-88ed-eca577e6fa2e-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.757852 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.757682    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b5193c6-f351-4535-88ed-eca577e6fa2e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.757852 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.757757    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b5193c6-f351-4535-88ed-eca577e6fa2e-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.757852 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.757814    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b5193c6-f351-4535-88ed-eca577e6fa2e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.758002 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.757871    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b65bf\" (UniqueName: \"kubernetes.io/projected/1b5193c6-f351-4535-88ed-eca577e6fa2e-kube-api-access-b65bf\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.758002 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.757909    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b5193c6-f351-4535-88ed-eca577e6fa2e-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.758002 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.757927    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b5193c6-f351-4535-88ed-eca577e6fa2e-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.858410 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.858381    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b65bf\" (UniqueName: \"kubernetes.io/projected/1b5193c6-f351-4535-88ed-eca577e6fa2e-kube-api-access-b65bf\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.858576 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.858421    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b5193c6-f351-4535-88ed-eca577e6fa2e-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.858576 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.858442    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b5193c6-f351-4535-88ed-eca577e6fa2e-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.858576 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.858473    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b5193c6-f351-4535-88ed-eca577e6fa2e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.858576 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.858498    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b5193c6-f351-4535-88ed-eca577e6fa2e-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.858576 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.858534    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b5193c6-f351-4535-88ed-eca577e6fa2e-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.858576 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.858556    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b5193c6-f351-4535-88ed-eca577e6fa2e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.858973 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.858591    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b5193c6-f351-4535-88ed-eca577e6fa2e-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.858973 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.858644    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b5193c6-f351-4535-88ed-eca577e6fa2e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.858973 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.858904    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b5193c6-f351-4535-88ed-eca577e6fa2e-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.858973 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.858966    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b5193c6-f351-4535-88ed-eca577e6fa2e-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.859172 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.859036    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b5193c6-f351-4535-88ed-eca577e6fa2e-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.859172 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.859093    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b5193c6-f351-4535-88ed-eca577e6fa2e-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.859341 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.859321    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b5193c6-f351-4535-88ed-eca577e6fa2e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.860982 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.860957    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b5193c6-f351-4535-88ed-eca577e6fa2e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.861143 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.861128    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b5193c6-f351-4535-88ed-eca577e6fa2e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.871428 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.871368    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b65bf\" (UniqueName: \"kubernetes.io/projected/1b5193c6-f351-4535-88ed-eca577e6fa2e-kube-api-access-b65bf\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.871564 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.871520    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b5193c6-f351-4535-88ed-eca577e6fa2e-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-7jglc\" (UID: \"1b5193c6-f351-4535-88ed-eca577e6fa2e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:04.974058 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:04.974022    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:05.149625 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:05.149597    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"]
Jul 22 13:03:05.151574 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:03:05.151548    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b5193c6_f351_4535_88ed_eca577e6fa2e.slice/crio-92b2c0ccafdde95239eae9db1eb10a396d20f54fe08549e8fc2b2964f688f420 WatchSource:0}: Error finding container 92b2c0ccafdde95239eae9db1eb10a396d20f54fe08549e8fc2b2964f688f420: Status 404 returned error can't find the container with id 92b2c0ccafdde95239eae9db1eb10a396d20f54fe08549e8fc2b2964f688f420
Jul 22 13:03:05.153781 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:05.153745    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:03:05.153853 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:05.153826    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:03:05.153891 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:05.153865    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:03:05.917651 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:05.917614    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc" event={"ID":"1b5193c6-f351-4535-88ed-eca577e6fa2e","Type":"ContainerStarted","Data":"03d9a3fe43bb553cc1b71a5d2f8977294b2a34c2e5bf7ff53de6e26ce1dade15"}
Jul 22 13:03:05.918059 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:05.917703    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc" event={"ID":"1b5193c6-f351-4535-88ed-eca577e6fa2e","Type":"ContainerStarted","Data":"92b2c0ccafdde95239eae9db1eb10a396d20f54fe08549e8fc2b2964f688f420"}
Jul 22 13:03:05.944928 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:05.944791    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc" podStartSLOduration=1.944757568 podStartE2EDuration="1.944757568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:03:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:03:05.943950385 +0000 UTC m=+533.708602010" watchObservedRunningTime="2026-07-22 13:03:05.944757568 +0000 UTC m=+533.709409194"
Jul 22 13:03:05.974456 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:05.974419    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:06.979517 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:06.979488    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:07.691122 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:07.691092    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:03:08.058539 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:08.058443    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:03:08.058539 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:08.058535    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:08.059049 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:08.058562    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:03:08.059049 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:08.058625    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:03:08.059049 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:08.058731    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"
Jul 22 13:03:08.061008 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:08.060984    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 22 13:03:08.189168 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:08.189129    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5dc83eba-59e3-40a0-ad71-4e9e14f135e1-config-file\") pod \"limitador-limitador-54d6d988d5-xh9qq\" (UID: \"5dc83eba-59e3-40a0-ad71-4e9e14f135e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"
Jul 22 13:03:08.189344 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:08.189282    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qzsn\" (UniqueName: \"kubernetes.io/projected/5dc83eba-59e3-40a0-ad71-4e9e14f135e1-kube-api-access-4qzsn\") pod \"limitador-limitador-54d6d988d5-xh9qq\" (UID: \"5dc83eba-59e3-40a0-ad71-4e9e14f135e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"
Jul 22 13:03:08.290449 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:08.290413    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5dc83eba-59e3-40a0-ad71-4e9e14f135e1-config-file\") pod \"limitador-limitador-54d6d988d5-xh9qq\" (UID: \"5dc83eba-59e3-40a0-ad71-4e9e14f135e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"
Jul 22 13:03:08.290620 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:08.290485    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qzsn\" (UniqueName: \"kubernetes.io/projected/5dc83eba-59e3-40a0-ad71-4e9e14f135e1-kube-api-access-4qzsn\") pod \"limitador-limitador-54d6d988d5-xh9qq\" (UID: \"5dc83eba-59e3-40a0-ad71-4e9e14f135e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"
Jul 22 13:03:08.291086 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:08.291068    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5dc83eba-59e3-40a0-ad71-4e9e14f135e1-config-file\") pod \"limitador-limitador-54d6d988d5-xh9qq\" (UID: \"5dc83eba-59e3-40a0-ad71-4e9e14f135e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"
Jul 22 13:03:08.301315 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:08.301287    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qzsn\" (UniqueName: \"kubernetes.io/projected/5dc83eba-59e3-40a0-ad71-4e9e14f135e1-kube-api-access-4qzsn\") pod \"limitador-limitador-54d6d988d5-xh9qq\" (UID: \"5dc83eba-59e3-40a0-ad71-4e9e14f135e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"
Jul 22 13:03:08.369219 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:08.369181    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"
Jul 22 13:03:08.736010 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:08.735979    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:03:08.739924 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:03:08.739898    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dc83eba_59e3_40a0_ad71_4e9e14f135e1.slice/crio-cb3b1462992ea11308063465d527ce7a9e3fb86e008dfcf974ae25c4dad05721 WatchSource:0}: Error finding container cb3b1462992ea11308063465d527ce7a9e3fb86e008dfcf974ae25c4dad05721: Status 404 returned error can't find the container with id cb3b1462992ea11308063465d527ce7a9e3fb86e008dfcf974ae25c4dad05721
Jul 22 13:03:08.930946 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:08.930860    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-xh9qq" event={"ID":"5dc83eba-59e3-40a0-ad71-4e9e14f135e1","Type":"ContainerStarted","Data":"cb3b1462992ea11308063465d527ce7a9e3fb86e008dfcf974ae25c4dad05721"}
Jul 22 13:03:15.964701 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:15.964668    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-xh9qq" event={"ID":"5dc83eba-59e3-40a0-ad71-4e9e14f135e1","Type":"ContainerStarted","Data":"d1cd6ba1db6f6d019fe5f0640072208f112def8e450f4ad3c22772b41f7fe135"}
Jul 22 13:03:15.965138 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:15.964768    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"
Jul 22 13:03:15.985123 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:15.985067    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-xh9qq" podStartSLOduration=2.318849004 podStartE2EDuration="8.985045293s" totalImagesPullingTime="6.666196289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:03:15.98440872 +0000 UTC m=+543.749060345" watchObservedRunningTime="2026-07-22 13:03:15.985045293 +0000 UTC m=+543.749696917"
Jul 22 13:03:26.972321 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:03:26.972289    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"
Jul 22 13:04:24.493897 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:04:24.493853    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:04:32.306058 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:04:32.305970    2557 generic.go:356] "Generic (PLEG): container finished" podID="1b5193c6-f351-4535-88ed-eca577e6fa2e" containerID="03d9a3fe43bb553cc1b71a5d2f8977294b2a34c2e5bf7ff53de6e26ce1dade15" exitCode=0
Jul 22 13:04:32.306058 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:04:32.306035    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc" event={"ID":"1b5193c6-f351-4535-88ed-eca577e6fa2e","Type":"ContainerDied","Data":"03d9a3fe43bb553cc1b71a5d2f8977294b2a34c2e5bf7ff53de6e26ce1dade15"}
Jul 22 13:04:32.306483 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:04:32.306429    2557 scope.go:117] "RemoveContainer" containerID="03d9a3fe43bb553cc1b71a5d2f8977294b2a34c2e5bf7ff53de6e26ce1dade15"
Jul 22 13:04:32.307511 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:04:32.307487    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:04:32.307572 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:04:32.307554    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:04:32.307613 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:04:32.307588    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:04:33.311934 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:04:33.311901    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc" event={"ID":"1b5193c6-f351-4535-88ed-eca577e6fa2e","Type":"ContainerStarted","Data":"636ad2c1baaa649e572ce304227db17a9bb2258c23ce2235bbbf5a1f152be842"}
Jul 22 13:04:33.974948 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:04:33.974852    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:04:33.976002 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:04:33.975966    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-7jglc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 22 13:04:33.976130 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:04:33.976066    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc" podUID="1b5193c6-f351-4535-88ed-eca577e6fa2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 22 13:04:34.975178 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:04:34.975132    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-7jglc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 22 13:04:34.975698 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:04:34.975208    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc" podUID="1b5193c6-f351-4535-88ed-eca577e6fa2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 22 13:04:35.974898 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:04:35.974856    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-7jglc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 22 13:04:35.975202 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:04:35.975170    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc" podUID="1b5193c6-f351-4535-88ed-eca577e6fa2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 22 13:04:36.974464 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:04:36.974419    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-7jglc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 22 13:04:36.974673 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:04:36.974487    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc" podUID="1b5193c6-f351-4535-88ed-eca577e6fa2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 22 13:04:37.925403 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:04:37.925363    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:04:37.978481 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:04:37.978448    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:04:38.340172 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:04:38.340077    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-7jglc"
Jul 22 13:04:48.195695 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:04:48.195660    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:04:57.490830 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:04:57.490794    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:05:11.500976 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:11.500938    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:05:21.945494 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:21.945459    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"]
Jul 22 13:05:21.947962 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:21.947938    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:21.950134 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:21.950108    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 13:05:21.950950 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:21.950928    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 22 13:05:21.951071 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:21.951033    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vvhw8\""
Jul 22 13:05:21.951208 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:21.951192    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 13:05:21.960010 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:21.959981    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"]
Jul 22 13:05:22.057436 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:22.057393    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f472e569-ca69-44ec-a8df-56bf4cf92586-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9\" (UID: \"f472e569-ca69-44ec-a8df-56bf4cf92586\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:22.057436 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:22.057440    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f472e569-ca69-44ec-a8df-56bf4cf92586-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9\" (UID: \"f472e569-ca69-44ec-a8df-56bf4cf92586\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:22.057651 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:22.057509    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f472e569-ca69-44ec-a8df-56bf4cf92586-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9\" (UID: \"f472e569-ca69-44ec-a8df-56bf4cf92586\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:22.057651 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:22.057561    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f472e569-ca69-44ec-a8df-56bf4cf92586-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9\" (UID: \"f472e569-ca69-44ec-a8df-56bf4cf92586\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:22.057651 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:22.057578    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f472e569-ca69-44ec-a8df-56bf4cf92586-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9\" (UID: \"f472e569-ca69-44ec-a8df-56bf4cf92586\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:22.057651 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:22.057597    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn9x4\" (UniqueName: \"kubernetes.io/projected/f472e569-ca69-44ec-a8df-56bf4cf92586-kube-api-access-zn9x4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9\" (UID: \"f472e569-ca69-44ec-a8df-56bf4cf92586\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:22.158284 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:22.158244    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f472e569-ca69-44ec-a8df-56bf4cf92586-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9\" (UID: \"f472e569-ca69-44ec-a8df-56bf4cf92586\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:22.158284 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:22.158291    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f472e569-ca69-44ec-a8df-56bf4cf92586-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9\" (UID: \"f472e569-ca69-44ec-a8df-56bf4cf92586\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:22.158496 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:22.158421    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f472e569-ca69-44ec-a8df-56bf4cf92586-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9\" (UID: \"f472e569-ca69-44ec-a8df-56bf4cf92586\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:22.158496 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:22.158471    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f472e569-ca69-44ec-a8df-56bf4cf92586-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9\" (UID: \"f472e569-ca69-44ec-a8df-56bf4cf92586\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:22.158561 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:22.158497    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f472e569-ca69-44ec-a8df-56bf4cf92586-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9\" (UID: \"f472e569-ca69-44ec-a8df-56bf4cf92586\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:22.158561 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:22.158529    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn9x4\" (UniqueName: \"kubernetes.io/projected/f472e569-ca69-44ec-a8df-56bf4cf92586-kube-api-access-zn9x4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9\" (UID: \"f472e569-ca69-44ec-a8df-56bf4cf92586\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:22.158693 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:22.158674    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f472e569-ca69-44ec-a8df-56bf4cf92586-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9\" (UID: \"f472e569-ca69-44ec-a8df-56bf4cf92586\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:22.158771 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:22.158745    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f472e569-ca69-44ec-a8df-56bf4cf92586-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9\" (UID: \"f472e569-ca69-44ec-a8df-56bf4cf92586\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:22.158808 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:22.158796    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f472e569-ca69-44ec-a8df-56bf4cf92586-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9\" (UID: \"f472e569-ca69-44ec-a8df-56bf4cf92586\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:22.160735 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:22.160677    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f472e569-ca69-44ec-a8df-56bf4cf92586-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9\" (UID: \"f472e569-ca69-44ec-a8df-56bf4cf92586\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:22.160884 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:22.160865    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f472e569-ca69-44ec-a8df-56bf4cf92586-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9\" (UID: \"f472e569-ca69-44ec-a8df-56bf4cf92586\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:22.167086 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:22.167056    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn9x4\" (UniqueName: \"kubernetes.io/projected/f472e569-ca69-44ec-a8df-56bf4cf92586-kube-api-access-zn9x4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9\" (UID: \"f472e569-ca69-44ec-a8df-56bf4cf92586\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:22.260267 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:22.260162    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:22.395689 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:22.395664    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"]
Jul 22 13:05:22.398390 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:05:22.398363    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf472e569_ca69_44ec_a8df_56bf4cf92586.slice/crio-5131c99835ba8a18e7d0e9390ee0eb53b93e20da5ef453005c18023b2d5414f0 WatchSource:0}: Error finding container 5131c99835ba8a18e7d0e9390ee0eb53b93e20da5ef453005c18023b2d5414f0: Status 404 returned error can't find the container with id 5131c99835ba8a18e7d0e9390ee0eb53b93e20da5ef453005c18023b2d5414f0
Jul 22 13:05:22.399690 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:22.399671    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 13:05:22.546099 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:22.546019    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9" event={"ID":"f472e569-ca69-44ec-a8df-56bf4cf92586","Type":"ContainerStarted","Data":"5131c99835ba8a18e7d0e9390ee0eb53b93e20da5ef453005c18023b2d5414f0"}
Jul 22 13:05:23.490825 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:23.490786    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:05:24.559615 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:24.559575    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9" event={"ID":"f472e569-ca69-44ec-a8df-56bf4cf92586","Type":"ContainerStarted","Data":"8c4e7a62fea8570485492db71b039393b3ea110bb6a20122d14a1be275bcf654"}
Jul 22 13:05:24.578048 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:24.577998    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9" podStartSLOduration=2.337796792 podStartE2EDuration="3.577980051s" totalImagesPullingTime="1.240183259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:05:24.577031111 +0000 UTC m=+672.341682748" watchObservedRunningTime="2026-07-22 13:05:24.577980051 +0000 UTC m=+672.342631676"
Jul 22 13:05:32.261246 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:32.261202    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:32.261869 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:32.261266    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:32.274063 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:32.274036    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:32.605503 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:32.605421    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9"
Jul 22 13:05:56.280603 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:05:56.280561    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:06:00.544854 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.544811    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"]
Jul 22 13:06:00.547492 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.547468    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:00.549403 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.549382    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 22 13:06:00.557702 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.557660    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"]
Jul 22 13:06:00.602506 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.602469    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3321fa11-007d-4176-a3c2-899a7fab22d5-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc\" (UID: \"3321fa11-007d-4176-a3c2-899a7fab22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:00.602506 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.602510    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jwjt\" (UniqueName: \"kubernetes.io/projected/3321fa11-007d-4176-a3c2-899a7fab22d5-kube-api-access-7jwjt\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc\" (UID: \"3321fa11-007d-4176-a3c2-899a7fab22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:00.602760 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.602549    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3321fa11-007d-4176-a3c2-899a7fab22d5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc\" (UID: \"3321fa11-007d-4176-a3c2-899a7fab22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:00.602760 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.602594    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3321fa11-007d-4176-a3c2-899a7fab22d5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc\" (UID: \"3321fa11-007d-4176-a3c2-899a7fab22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:00.602760 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.602630    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3321fa11-007d-4176-a3c2-899a7fab22d5-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc\" (UID: \"3321fa11-007d-4176-a3c2-899a7fab22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:00.602760 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.602668    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3321fa11-007d-4176-a3c2-899a7fab22d5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc\" (UID: \"3321fa11-007d-4176-a3c2-899a7fab22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:00.703921 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.703873    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3321fa11-007d-4176-a3c2-899a7fab22d5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc\" (UID: \"3321fa11-007d-4176-a3c2-899a7fab22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:00.703921 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.703932    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3321fa11-007d-4176-a3c2-899a7fab22d5-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc\" (UID: \"3321fa11-007d-4176-a3c2-899a7fab22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:00.704142 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.703954    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jwjt\" (UniqueName: \"kubernetes.io/projected/3321fa11-007d-4176-a3c2-899a7fab22d5-kube-api-access-7jwjt\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc\" (UID: \"3321fa11-007d-4176-a3c2-899a7fab22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:00.704142 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.703982    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3321fa11-007d-4176-a3c2-899a7fab22d5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc\" (UID: \"3321fa11-007d-4176-a3c2-899a7fab22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:00.704142 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.704011    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3321fa11-007d-4176-a3c2-899a7fab22d5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc\" (UID: \"3321fa11-007d-4176-a3c2-899a7fab22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:00.704142 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.704035    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3321fa11-007d-4176-a3c2-899a7fab22d5-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc\" (UID: \"3321fa11-007d-4176-a3c2-899a7fab22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:00.704535 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.704511    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3321fa11-007d-4176-a3c2-899a7fab22d5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc\" (UID: \"3321fa11-007d-4176-a3c2-899a7fab22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:00.704622 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.704555    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3321fa11-007d-4176-a3c2-899a7fab22d5-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc\" (UID: \"3321fa11-007d-4176-a3c2-899a7fab22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:00.704622 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.704587    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3321fa11-007d-4176-a3c2-899a7fab22d5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc\" (UID: \"3321fa11-007d-4176-a3c2-899a7fab22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:00.706311 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.706287    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3321fa11-007d-4176-a3c2-899a7fab22d5-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc\" (UID: \"3321fa11-007d-4176-a3c2-899a7fab22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:00.706569 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.706550    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3321fa11-007d-4176-a3c2-899a7fab22d5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc\" (UID: \"3321fa11-007d-4176-a3c2-899a7fab22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:00.716595 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.716567    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jwjt\" (UniqueName: \"kubernetes.io/projected/3321fa11-007d-4176-a3c2-899a7fab22d5-kube-api-access-7jwjt\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc\" (UID: \"3321fa11-007d-4176-a3c2-899a7fab22d5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:00.857607 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.857515    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:00.997807 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:00.997779    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"]
Jul 22 13:06:01.000443 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:06:01.000410    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3321fa11_007d_4176_a3c2_899a7fab22d5.slice/crio-cecddb4f4b0405255dee3912a8018cab710083eea0a24c54e044a136fdf02eee WatchSource:0}: Error finding container cecddb4f4b0405255dee3912a8018cab710083eea0a24c54e044a136fdf02eee: Status 404 returned error can't find the container with id cecddb4f4b0405255dee3912a8018cab710083eea0a24c54e044a136fdf02eee
Jul 22 13:06:01.724344 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:01.724306    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc" event={"ID":"3321fa11-007d-4176-a3c2-899a7fab22d5","Type":"ContainerStarted","Data":"e3c9eab1c684ffba92c9e5e756432a28e70181fc10cb8efb4627369448f34720"}
Jul 22 13:06:01.724774 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:01.724355    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc" event={"ID":"3321fa11-007d-4176-a3c2-899a7fab22d5","Type":"ContainerStarted","Data":"cecddb4f4b0405255dee3912a8018cab710083eea0a24c54e044a136fdf02eee"}
Jul 22 13:06:01.740868 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:01.740811    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc" podStartSLOduration=1.533435244 podStartE2EDuration="1.740790347s" totalImagesPullingTime="207.355103ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:06:01.740460999 +0000 UTC m=+709.505112627" watchObservedRunningTime="2026-07-22 13:06:01.740790347 +0000 UTC m=+709.505441973"
Jul 22 13:06:10.858145 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:10.858044    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:10.858145 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:10.858096    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:10.870760 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:10.870692    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:06:11.284928 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:11.284886    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:06:11.782897 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:06:11.782853    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc"
Jul 22 13:08:26.398123 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:08:26.398083    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:08:36.088277 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:08:36.088237    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:08:46.596617 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:08:46.596586    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:10:30.489860 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:10:30.489809    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:10:39.628512 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:10:39.628425    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:11:11.499243 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:11:11.499206    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:11:21.078936 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:11:21.078900    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:11:30.682001 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:11:30.681965    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:11:38.983070 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:11:38.983031    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:11:50.820617 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:11:50.820580    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:12:01.883981 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:12:01.883941    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:12:12.887518 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:12:12.887443    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:12:22.982989 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:12:22.982949    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:12:48.177551 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:12:48.177513    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:12:59.382060 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:12:59.382024    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:13:23.792870 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:13:23.792831    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:13:34.787481 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:13:34.787399    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:13:49.593092 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:13:49.593058    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:14:01.283022 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:14:01.282982    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:14:10.686532 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:14:10.686500    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:14:22.788902 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:14:22.788868    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:16:19.041360 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:16:19.041316    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:16:28.347579 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:16:28.347538    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:16:41.145400 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:16:41.145312    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:16:52.646147 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:16:52.646110    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:17:02.242105 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:17:02.242059    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:17:13.441298 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:17:13.441264    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:17:23.349890 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:17:23.349860    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:17:33.457395 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:17:33.457357    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:17:45.043029 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:17:45.042989    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:17:53.949205 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:17:53.949173    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:18:04.547010 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:04.546930    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:18:26.052695 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:26.052660    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:18:35.646538 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:35.646503    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:18:45.346369 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:45.346333    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:18:53.136445 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.136409    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"]
Jul 22 13:18:53.140056 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.140032    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:18:53.142473 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.142454    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-213a9139-kserve-self-signed-certs\""
Jul 22 13:18:53.152002 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.151981    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"]
Jul 22 13:18:53.258801 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.258770    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-tmp-dir\") pod \"e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") " pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:18:53.258945 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.258808    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-model-cache\") pod \"e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") " pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:18:53.258945 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.258838    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73aa42c2-89e4-4c64-ac04-aa907b7617f7-tls-certs\") pod \"e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") " pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:18:53.258945 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.258909    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-home\") pod \"e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") " pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:18:53.258945 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.258940    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-dshm\") pod \"e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") " pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:18:53.259088 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.258959    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thw55\" (UniqueName: \"kubernetes.io/projected/73aa42c2-89e4-4c64-ac04-aa907b7617f7-kube-api-access-thw55\") pod \"e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") " pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:18:53.360294 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.360264    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-dshm\") pod \"e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") " pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:18:53.360294 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.360295    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thw55\" (UniqueName: \"kubernetes.io/projected/73aa42c2-89e4-4c64-ac04-aa907b7617f7-kube-api-access-thw55\") pod \"e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") " pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:18:53.360486 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.360352    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-tmp-dir\") pod \"e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") " pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:18:53.360486 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.360369    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-model-cache\") pod \"e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") " pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:18:53.360486 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.360388    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73aa42c2-89e4-4c64-ac04-aa907b7617f7-tls-certs\") pod \"e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") " pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:18:53.360486 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.360416    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-home\") pod \"e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") " pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:18:53.360775 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.360744    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-tmp-dir\") pod \"e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") " pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:18:53.360891 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.360791    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-model-cache\") pod \"e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") " pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:18:53.360891 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.360831    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-home\") pod \"e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") " pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:18:53.362654 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.362630    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-dshm\") pod \"e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") " pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:18:53.362812 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.362795    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73aa42c2-89e4-4c64-ac04-aa907b7617f7-tls-certs\") pod \"e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") " pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:18:53.368743 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.368698    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thw55\" (UniqueName: \"kubernetes.io/projected/73aa42c2-89e4-4c64-ac04-aa907b7617f7-kube-api-access-thw55\") pod \"e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") " pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:18:53.449415 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.449361    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:18:53.584874 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:53.584850    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"]
Jul 22 13:18:53.586943 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:18:53.586916    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73aa42c2_89e4_4c64_ac04_aa907b7617f7.slice/crio-600d608879c7867ca1483f0cb8c08a504f0b38b68e7c2a2dcac67a64229a995e WatchSource:0}: Error finding container 600d608879c7867ca1483f0cb8c08a504f0b38b68e7c2a2dcac67a64229a995e: Status 404 returned error can't find the container with id 600d608879c7867ca1483f0cb8c08a504f0b38b68e7c2a2dcac67a64229a995e
Jul 22 13:18:54.141975 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:54.141941    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp" event={"ID":"73aa42c2-89e4-4c64-ac04-aa907b7617f7","Type":"ContainerStarted","Data":"007a8a276d62a1066ebd58deb211d7b40d0ca9a647e39c748241ba071005b0e9"}
Jul 22 13:18:54.142361 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:54.141984    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp" event={"ID":"73aa42c2-89e4-4c64-ac04-aa907b7617f7","Type":"ContainerStarted","Data":"600d608879c7867ca1483f0cb8c08a504f0b38b68e7c2a2dcac67a64229a995e"}
Jul 22 13:18:54.161150 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:54.161107    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp" podStartSLOduration=1.161089663 podStartE2EDuration="1.161089663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:18:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:18:54.160155634 +0000 UTC m=+1481.924807261" watchObservedRunningTime="2026-07-22 13:18:54.161089663 +0000 UTC m=+1481.925741289"
Jul 22 13:18:56.941763 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:18:56.941726    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:19:03.449942 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:03.449907    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:19:03.450369 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:03.449970    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:19:03.462221 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:03.462191    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:19:04.196384 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:04.196355    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:19:12.528999 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:12.528965    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"]
Jul 22 13:19:13.647918 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:13.647877    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:19:25.741120 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:25.741080    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:19:27.551261 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:27.551196    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp" podUID="73aa42c2-89e4-4c64-ac04-aa907b7617f7" containerName="main" containerID="cri-o://007a8a276d62a1066ebd58deb211d7b40d0ca9a647e39c748241ba071005b0e9" gracePeriod=45
Jul 22 13:19:27.801688 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:27.801610    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:19:27.867672 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:27.867635    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-model-cache\") pod \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") "
Jul 22 13:19:27.867894 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:27.867687    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thw55\" (UniqueName: \"kubernetes.io/projected/73aa42c2-89e4-4c64-ac04-aa907b7617f7-kube-api-access-thw55\") pod \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") "
Jul 22 13:19:27.868753 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:27.868078    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-dshm\") pod \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") "
Jul 22 13:19:27.868753 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:27.868155    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-tmp-dir\") pod \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") "
Jul 22 13:19:27.868753 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:27.868189    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-home\") pod \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") "
Jul 22 13:19:27.868753 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:27.868236    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73aa42c2-89e4-4c64-ac04-aa907b7617f7-tls-certs\") pod \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\" (UID: \"73aa42c2-89e4-4c64-ac04-aa907b7617f7\") "
Jul 22 13:19:27.868753 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:27.868265    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-model-cache" (OuterVolumeSpecName: "model-cache") pod "73aa42c2-89e4-4c64-ac04-aa907b7617f7" (UID: "73aa42c2-89e4-4c64-ac04-aa907b7617f7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:19:27.868753 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:27.868500    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "73aa42c2-89e4-4c64-ac04-aa907b7617f7" (UID: "73aa42c2-89e4-4c64-ac04-aa907b7617f7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:19:27.868753 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:27.868689    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-home" (OuterVolumeSpecName: "home") pod "73aa42c2-89e4-4c64-ac04-aa907b7617f7" (UID: "73aa42c2-89e4-4c64-ac04-aa907b7617f7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:19:27.869780 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:27.869633    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-tmp-dir\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:19:27.869780 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:27.869665    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-home\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:19:27.869780 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:27.869678    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-model-cache\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:19:27.873755 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:27.871093    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73aa42c2-89e4-4c64-ac04-aa907b7617f7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "73aa42c2-89e4-4c64-ac04-aa907b7617f7" (UID: "73aa42c2-89e4-4c64-ac04-aa907b7617f7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:19:27.873755 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:27.871309    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-dshm" (OuterVolumeSpecName: "dshm") pod "73aa42c2-89e4-4c64-ac04-aa907b7617f7" (UID: "73aa42c2-89e4-4c64-ac04-aa907b7617f7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:19:27.875217 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:27.875037    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73aa42c2-89e4-4c64-ac04-aa907b7617f7-kube-api-access-thw55" (OuterVolumeSpecName: "kube-api-access-thw55") pod "73aa42c2-89e4-4c64-ac04-aa907b7617f7" (UID: "73aa42c2-89e4-4c64-ac04-aa907b7617f7"). InnerVolumeSpecName "kube-api-access-thw55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:19:27.970440 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:27.970405    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73aa42c2-89e4-4c64-ac04-aa907b7617f7-tls-certs\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:19:27.970440 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:27.970434    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thw55\" (UniqueName: \"kubernetes.io/projected/73aa42c2-89e4-4c64-ac04-aa907b7617f7-kube-api-access-thw55\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:19:27.970440 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:27.970445    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73aa42c2-89e4-4c64-ac04-aa907b7617f7-dshm\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:19:28.294475 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:28.294436    2557 generic.go:356] "Generic (PLEG): container finished" podID="73aa42c2-89e4-4c64-ac04-aa907b7617f7" containerID="007a8a276d62a1066ebd58deb211d7b40d0ca9a647e39c748241ba071005b0e9" exitCode=0
Jul 22 13:19:28.294689 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:28.294497    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"
Jul 22 13:19:28.294689 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:28.294501    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp" event={"ID":"73aa42c2-89e4-4c64-ac04-aa907b7617f7","Type":"ContainerDied","Data":"007a8a276d62a1066ebd58deb211d7b40d0ca9a647e39c748241ba071005b0e9"}
Jul 22 13:19:28.294689 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:28.294542    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp" event={"ID":"73aa42c2-89e4-4c64-ac04-aa907b7617f7","Type":"ContainerDied","Data":"600d608879c7867ca1483f0cb8c08a504f0b38b68e7c2a2dcac67a64229a995e"}
Jul 22 13:19:28.294689 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:28.294564    2557 scope.go:117] "RemoveContainer" containerID="007a8a276d62a1066ebd58deb211d7b40d0ca9a647e39c748241ba071005b0e9"
Jul 22 13:19:28.304247 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:28.304226    2557 scope.go:117] "RemoveContainer" containerID="007a8a276d62a1066ebd58deb211d7b40d0ca9a647e39c748241ba071005b0e9"
Jul 22 13:19:28.304538 ip-10-0-141-162 kubenswrapper[2557]: E0722 13:19:28.304519    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"007a8a276d62a1066ebd58deb211d7b40d0ca9a647e39c748241ba071005b0e9\": container with ID starting with 007a8a276d62a1066ebd58deb211d7b40d0ca9a647e39c748241ba071005b0e9 not found: ID does not exist" containerID="007a8a276d62a1066ebd58deb211d7b40d0ca9a647e39c748241ba071005b0e9"
Jul 22 13:19:28.304584 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:28.304546    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"007a8a276d62a1066ebd58deb211d7b40d0ca9a647e39c748241ba071005b0e9"} err="failed to get container status \"007a8a276d62a1066ebd58deb211d7b40d0ca9a647e39c748241ba071005b0e9\": rpc error: code = NotFound desc = could not find container \"007a8a276d62a1066ebd58deb211d7b40d0ca9a647e39c748241ba071005b0e9\": container with ID starting with 007a8a276d62a1066ebd58deb211d7b40d0ca9a647e39c748241ba071005b0e9 not found: ID does not exist"
Jul 22 13:19:28.318310 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:28.318277    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"]
Jul 22 13:19:28.322535 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:28.322504    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-213a9139-kserve-5db8b895f9-m2ngp"]
Jul 22 13:19:28.808864 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:28.808832    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73aa42c2-89e4-4c64-ac04-aa907b7617f7" path="/var/lib/kubelet/pods/73aa42c2-89e4-4c64-ac04-aa907b7617f7/volumes"
Jul 22 13:19:35.749470 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:35.749384    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:19:44.848891 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:44.848853    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:19:58.263389 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:19:58.263350    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:20:07.254684 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:20:07.254646    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:20:15.437602 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:20:15.437567    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:20:24.449648 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:20:24.449602    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:20:33.752916 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:20:33.752880    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:20:47.841228 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:20:47.841191    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:20:56.946147 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:20:56.946117    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:21:06.744770 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:21:06.744686    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:21:19.137258 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:21:19.137223    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:21:28.148632 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:21:28.148591    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:21:35.237693 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:21:35.237658    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:21:44.644543 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:21:44.644511    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:21:52.847364 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:21:52.847332    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:22:05.151293 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:05.151249    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:22:14.637984 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:14.637948    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:22:25.541281 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:25.541237    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:22:41.852559 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:41.852477    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:22:48.046317 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.046284    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"]
Jul 22 13:22:48.046689 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.046619    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73aa42c2-89e4-4c64-ac04-aa907b7617f7" containerName="main"
Jul 22 13:22:48.046689 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.046629    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="73aa42c2-89e4-4c64-ac04-aa907b7617f7" containerName="main"
Jul 22 13:22:48.046689 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.046679    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="73aa42c2-89e4-4c64-ac04-aa907b7617f7" containerName="main"
Jul 22 13:22:48.049436 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.049418    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.051731 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.051692    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2db37d05-openshift-default-dockercfg-9btpn\""
Jul 22 13:22:48.068300 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.068269    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"]
Jul 22 13:22:48.215871 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.215827    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-data\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.215871 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.215871    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-workload-socket\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.216120 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.215889    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-token\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.216120 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.215906    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-credential-socket\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.216120 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.216031    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-envoy\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.216120 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.216071    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-workload-certs\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.216120 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.216104    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-podinfo\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.216368 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.216154    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjtfj\" (UniqueName: \"kubernetes.io/projected/ed630fe9-34ab-42fe-889a-86bff4bc84a9-kube-api-access-qjtfj\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.216368 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.216186    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istiod-ca-cert\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.317310 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.317218    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjtfj\" (UniqueName: \"kubernetes.io/projected/ed630fe9-34ab-42fe-889a-86bff4bc84a9-kube-api-access-qjtfj\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.317310 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.317259    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istiod-ca-cert\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.317514 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.317312    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-data\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.317514 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.317339    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-workload-socket\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.317514 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.317362    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-token\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.317666 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.317532    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-credential-socket\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.317666 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.317628    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-envoy\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.317804 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.317665    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-workload-certs\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.317804 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.317693    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-podinfo\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.317804 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.317753    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-data\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.317804 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.317795    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-workload-socket\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.318008 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.317917    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-credential-socket\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.318089 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.318069    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-workload-certs\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.318133 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.318088    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istiod-ca-cert\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.319789 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.319766    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-envoy\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.320076 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.320055    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-podinfo\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.325829 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.325803    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjtfj\" (UniqueName: \"kubernetes.io/projected/ed630fe9-34ab-42fe-889a-86bff4bc84a9-kube-api-access-qjtfj\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.325829 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.325815    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-token\") pod \"e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") " pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.359909 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.359873    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:48.509407 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.509363    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"]
Jul 22 13:22:48.512490 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:22:48.512459    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded630fe9_34ab_42fe_889a_86bff4bc84a9.slice/crio-4c212eb3cbc05502f945eb2d7088bb0139b7e48cf139496bd4d482373d73560e WatchSource:0}: Error finding container 4c212eb3cbc05502f945eb2d7088bb0139b7e48cf139496bd4d482373d73560e: Status 404 returned error can't find the container with id 4c212eb3cbc05502f945eb2d7088bb0139b7e48cf139496bd4d482373d73560e
Jul 22 13:22:48.514670 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.514639    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:22:48.514751 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.514723    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:22:48.514797 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:48.514755    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:22:49.191656 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:49.191626    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv" event={"ID":"ed630fe9-34ab-42fe-889a-86bff4bc84a9","Type":"ContainerStarted","Data":"bbbd19794bfb5aeb873921b6dcbcc5295b62a4a8743849f008bc6c8b06ebd01a"}
Jul 22 13:22:49.192074 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:49.191675    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv" event={"ID":"ed630fe9-34ab-42fe-889a-86bff4bc84a9","Type":"ContainerStarted","Data":"4c212eb3cbc05502f945eb2d7088bb0139b7e48cf139496bd4d482373d73560e"}
Jul 22 13:22:49.218442 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:49.218386    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv" podStartSLOduration=1.218370191 podStartE2EDuration="1.218370191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:22:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:22:49.215964257 +0000 UTC m=+1716.980615874" watchObservedRunningTime="2026-07-22 13:22:49.218370191 +0000 UTC m=+1716.983021795"
Jul 22 13:22:49.360903 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:49.360869    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:49.365548 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:49.365523    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:50.197385 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:50.197357    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:50.198199 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:50.198181    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:22:57.849225 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:22:57.849187    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:23:05.881648 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:05.881616    2557 patch_prober.go:28] interesting pod/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": read tcp 10.134.0.2:35024->10.134.0.31:15021: read: connection reset by peer" start-of-body=
Jul 22 13:23:05.882062 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:05.881699    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv" podUID="ed630fe9-34ab-42fe-889a-86bff4bc84a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": read tcp 10.134.0.2:35024->10.134.0.31:15021: read: connection reset by peer"
Jul 22 13:23:06.272720 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:06.272594    2557 generic.go:356] "Generic (PLEG): container finished" podID="ed630fe9-34ab-42fe-889a-86bff4bc84a9" containerID="bbbd19794bfb5aeb873921b6dcbcc5295b62a4a8743849f008bc6c8b06ebd01a" exitCode=0
Jul 22 13:23:06.272720 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:06.272648    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv" event={"ID":"ed630fe9-34ab-42fe-889a-86bff4bc84a9","Type":"ContainerDied","Data":"bbbd19794bfb5aeb873921b6dcbcc5295b62a4a8743849f008bc6c8b06ebd01a"}
Jul 22 13:23:06.273154 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:06.273134    2557 scope.go:117] "RemoveContainer" containerID="bbbd19794bfb5aeb873921b6dcbcc5295b62a4a8743849f008bc6c8b06ebd01a"
Jul 22 13:23:06.274185 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:06.274157    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:23:06.274277 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:06.274246    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:23:06.274348 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:06.274330    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:23:07.281080 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:07.281048    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv" event={"ID":"ed630fe9-34ab-42fe-889a-86bff4bc84a9","Type":"ContainerStarted","Data":"de7e4fd9b367ad8fa7b47366a68c195931b3e8a584c4aa4e95698979268f83cb"}
Jul 22 13:23:07.368735 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:07.368164    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:23:07.368735 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:07.368338    2557 patch_prober.go:28] interesting pod/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 22 13:23:07.368735 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:07.368386    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv" podUID="ed630fe9-34ab-42fe-889a-86bff4bc84a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 22 13:23:08.360327 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:08.360284    2557 patch_prober.go:28] interesting pod/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 22 13:23:08.360983 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:08.360949    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv" podUID="ed630fe9-34ab-42fe-889a-86bff4bc84a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 22 13:23:09.360654 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:09.360613    2557 patch_prober.go:28] interesting pod/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 22 13:23:09.361333 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:09.361299    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv" podUID="ed630fe9-34ab-42fe-889a-86bff4bc84a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 22 13:23:10.360699 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:10.360647    2557 patch_prober.go:28] interesting pod/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 22 13:23:10.361223 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:10.360766    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv" podUID="ed630fe9-34ab-42fe-889a-86bff4bc84a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 22 13:23:11.360814 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:11.360762    2557 patch_prober.go:28] interesting pod/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 22 13:23:11.361219 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:11.360858    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv" podUID="ed630fe9-34ab-42fe-889a-86bff4bc84a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 22 13:23:12.364107 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:12.364073    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:23:12.364567 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:12.364549    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:23:12.365294 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:12.365272    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:23:29.341933 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:29.341895    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:23:31.367790 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:31.367751    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"]
Jul 22 13:23:31.368285 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:31.367992    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv" podUID="ed630fe9-34ab-42fe-889a-86bff4bc84a9" containerName="istio-proxy" containerID="cri-o://de7e4fd9b367ad8fa7b47366a68c195931b3e8a584c4aa4e95698979268f83cb" gracePeriod=30
Jul 22 13:23:36.617413 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.617391    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:23:36.757227 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.757145    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-credential-socket\") pod \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") "
Jul 22 13:23:36.757227 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.757196    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-workload-socket\") pod \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") "
Jul 22 13:23:36.757227 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.757220    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-envoy\") pod \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") "
Jul 22 13:23:36.757497 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.757240    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-token\") pod \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") "
Jul 22 13:23:36.757497 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.757262    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-workload-certs\") pod \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") "
Jul 22 13:23:36.757497 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.757283    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istiod-ca-cert\") pod \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") "
Jul 22 13:23:36.757497 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.757308    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-podinfo\") pod \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") "
Jul 22 13:23:36.757497 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.757362    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-data\") pod \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") "
Jul 22 13:23:36.757497 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.757389    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjtfj\" (UniqueName: \"kubernetes.io/projected/ed630fe9-34ab-42fe-889a-86bff4bc84a9-kube-api-access-qjtfj\") pod \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\" (UID: \"ed630fe9-34ab-42fe-889a-86bff4bc84a9\") "
Jul 22 13:23:36.757497 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.757430    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ed630fe9-34ab-42fe-889a-86bff4bc84a9" (UID: "ed630fe9-34ab-42fe-889a-86bff4bc84a9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:23:36.757888 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.757591    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ed630fe9-34ab-42fe-889a-86bff4bc84a9" (UID: "ed630fe9-34ab-42fe-889a-86bff4bc84a9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:23:36.757888 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.757608    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ed630fe9-34ab-42fe-889a-86bff4bc84a9" (UID: "ed630fe9-34ab-42fe-889a-86bff4bc84a9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:23:36.757888 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.757705    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-credential-socket\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:23:36.757888 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.757752    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-workload-socket\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:23:36.757888 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.757746    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ed630fe9-34ab-42fe-889a-86bff4bc84a9" (UID: "ed630fe9-34ab-42fe-889a-86bff4bc84a9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:23:36.757888 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.757767    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-workload-certs\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:23:36.758432 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.758410    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-data" (OuterVolumeSpecName: "istio-data") pod "ed630fe9-34ab-42fe-889a-86bff4bc84a9" (UID: "ed630fe9-34ab-42fe-889a-86bff4bc84a9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:23:36.759607 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.759580    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed630fe9-34ab-42fe-889a-86bff4bc84a9-kube-api-access-qjtfj" (OuterVolumeSpecName: "kube-api-access-qjtfj") pod "ed630fe9-34ab-42fe-889a-86bff4bc84a9" (UID: "ed630fe9-34ab-42fe-889a-86bff4bc84a9"). InnerVolumeSpecName "kube-api-access-qjtfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:23:36.759673 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.759635    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-token" (OuterVolumeSpecName: "istio-token") pod "ed630fe9-34ab-42fe-889a-86bff4bc84a9" (UID: "ed630fe9-34ab-42fe-889a-86bff4bc84a9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:23:36.759883 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.759867    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ed630fe9-34ab-42fe-889a-86bff4bc84a9" (UID: "ed630fe9-34ab-42fe-889a-86bff4bc84a9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:23:36.759950 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.759869    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ed630fe9-34ab-42fe-889a-86bff4bc84a9" (UID: "ed630fe9-34ab-42fe-889a-86bff4bc84a9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 13:23:36.858344 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.858317    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-envoy\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:23:36.858344 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.858341    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-token\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:23:36.858344 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.858350    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istiod-ca-cert\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:23:36.858542 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.858360    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-podinfo\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:23:36.858542 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.858368    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed630fe9-34ab-42fe-889a-86bff4bc84a9-istio-data\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:23:36.858542 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:36.858376    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjtfj\" (UniqueName: \"kubernetes.io/projected/ed630fe9-34ab-42fe-889a-86bff4bc84a9-kube-api-access-qjtfj\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:23:37.420697 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:37.420658    2557 generic.go:356] "Generic (PLEG): container finished" podID="ed630fe9-34ab-42fe-889a-86bff4bc84a9" containerID="de7e4fd9b367ad8fa7b47366a68c195931b3e8a584c4aa4e95698979268f83cb" exitCode=0
Jul 22 13:23:37.420697 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:37.420701    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv" event={"ID":"ed630fe9-34ab-42fe-889a-86bff4bc84a9","Type":"ContainerDied","Data":"de7e4fd9b367ad8fa7b47366a68c195931b3e8a584c4aa4e95698979268f83cb"}
Jul 22 13:23:37.420927 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:37.420733    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"
Jul 22 13:23:37.420927 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:37.420782    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv" event={"ID":"ed630fe9-34ab-42fe-889a-86bff4bc84a9","Type":"ContainerDied","Data":"4c212eb3cbc05502f945eb2d7088bb0139b7e48cf139496bd4d482373d73560e"}
Jul 22 13:23:37.420927 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:37.420805    2557 scope.go:117] "RemoveContainer" containerID="de7e4fd9b367ad8fa7b47366a68c195931b3e8a584c4aa4e95698979268f83cb"
Jul 22 13:23:37.429588 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:37.429572    2557 scope.go:117] "RemoveContainer" containerID="bbbd19794bfb5aeb873921b6dcbcc5295b62a4a8743849f008bc6c8b06ebd01a"
Jul 22 13:23:37.437085 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:37.437067    2557 scope.go:117] "RemoveContainer" containerID="de7e4fd9b367ad8fa7b47366a68c195931b3e8a584c4aa4e95698979268f83cb"
Jul 22 13:23:37.437332 ip-10-0-141-162 kubenswrapper[2557]: E0722 13:23:37.437310    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de7e4fd9b367ad8fa7b47366a68c195931b3e8a584c4aa4e95698979268f83cb\": container with ID starting with de7e4fd9b367ad8fa7b47366a68c195931b3e8a584c4aa4e95698979268f83cb not found: ID does not exist" containerID="de7e4fd9b367ad8fa7b47366a68c195931b3e8a584c4aa4e95698979268f83cb"
Jul 22 13:23:37.437402 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:37.437339    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de7e4fd9b367ad8fa7b47366a68c195931b3e8a584c4aa4e95698979268f83cb"} err="failed to get container status \"de7e4fd9b367ad8fa7b47366a68c195931b3e8a584c4aa4e95698979268f83cb\": rpc error: code = NotFound desc = could not find container \"de7e4fd9b367ad8fa7b47366a68c195931b3e8a584c4aa4e95698979268f83cb\": container with ID starting with de7e4fd9b367ad8fa7b47366a68c195931b3e8a584c4aa4e95698979268f83cb not found: ID does not exist"
Jul 22 13:23:37.437402 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:37.437356    2557 scope.go:117] "RemoveContainer" containerID="bbbd19794bfb5aeb873921b6dcbcc5295b62a4a8743849f008bc6c8b06ebd01a"
Jul 22 13:23:37.437582 ip-10-0-141-162 kubenswrapper[2557]: E0722 13:23:37.437566    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbbd19794bfb5aeb873921b6dcbcc5295b62a4a8743849f008bc6c8b06ebd01a\": container with ID starting with bbbd19794bfb5aeb873921b6dcbcc5295b62a4a8743849f008bc6c8b06ebd01a not found: ID does not exist" containerID="bbbd19794bfb5aeb873921b6dcbcc5295b62a4a8743849f008bc6c8b06ebd01a"
Jul 22 13:23:37.437637 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:37.437588    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbbd19794bfb5aeb873921b6dcbcc5295b62a4a8743849f008bc6c8b06ebd01a"} err="failed to get container status \"bbbd19794bfb5aeb873921b6dcbcc5295b62a4a8743849f008bc6c8b06ebd01a\": rpc error: code = NotFound desc = could not find container \"bbbd19794bfb5aeb873921b6dcbcc5295b62a4a8743849f008bc6c8b06ebd01a\": container with ID starting with bbbd19794bfb5aeb873921b6dcbcc5295b62a4a8743849f008bc6c8b06ebd01a not found: ID does not exist"
Jul 22 13:23:37.440770 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:37.440750    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"]
Jul 22 13:23:37.442968 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:37.442946    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2db37d05-openshift-default-cf96f5d9-8jzhv"]
Jul 22 13:23:38.808723 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:38.808682    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed630fe9-34ab-42fe-889a-86bff4bc84a9" path="/var/lib/kubelet/pods/ed630fe9-34ab-42fe-889a-86bff4bc84a9/volumes"
Jul 22 13:23:41.549607 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:23:41.549570    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:24:15.841198 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:15.841160    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:24:18.615114 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.615079    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"]
Jul 22 13:24:18.615535 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.615519    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed630fe9-34ab-42fe-889a-86bff4bc84a9" containerName="istio-proxy"
Jul 22 13:24:18.615582 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.615539    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed630fe9-34ab-42fe-889a-86bff4bc84a9" containerName="istio-proxy"
Jul 22 13:24:18.615582 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.615559    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed630fe9-34ab-42fe-889a-86bff4bc84a9" containerName="istio-proxy"
Jul 22 13:24:18.615582 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.615568    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed630fe9-34ab-42fe-889a-86bff4bc84a9" containerName="istio-proxy"
Jul 22 13:24:18.615688 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.615677    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed630fe9-34ab-42fe-889a-86bff4bc84a9" containerName="istio-proxy"
Jul 22 13:24:18.615741 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.615691    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed630fe9-34ab-42fe-889a-86bff4bc84a9" containerName="istio-proxy"
Jul 22 13:24:18.619033 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.619009    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.621023 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.621004    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4cedc07b-openshift-default-dockercfg-6m8cr\""
Jul 22 13:24:18.627871 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.627847    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"]
Jul 22 13:24:18.705549 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.705520    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-envoy\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.705705 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.705558    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-workload-socket\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.705705 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.705576    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-data\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.705705 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.705646    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-workload-certs\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.705705 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.705699    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/773cffa4-9422-40c1-a3df-583cd8b51ee4-istiod-ca-cert\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.705879 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.705778    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv8rl\" (UniqueName: \"kubernetes.io/projected/773cffa4-9422-40c1-a3df-583cd8b51ee4-kube-api-access-cv8rl\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.705879 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.705799    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-credential-socket\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.705879 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.705817    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-podinfo\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.705879 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.705834    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-token\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.806826 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.806786    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-credential-socket\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.807013 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.806837    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-podinfo\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.807013 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.806861    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-token\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.807134 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.807029    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-envoy\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.807134 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.807101    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-workload-socket\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.807240 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.807131    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-data\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.807240 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.807162    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-credential-socket\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.807240 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.807182    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-workload-certs\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.807240 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.807214    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/773cffa4-9422-40c1-a3df-583cd8b51ee4-istiod-ca-cert\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.807455 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.807288    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv8rl\" (UniqueName: \"kubernetes.io/projected/773cffa4-9422-40c1-a3df-583cd8b51ee4-kube-api-access-cv8rl\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.807517 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.807452    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-workload-socket\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.807577 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.807560    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-workload-certs\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.807880 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.807862    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-data\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.808130 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.808107    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/773cffa4-9422-40c1-a3df-583cd8b51ee4-istiod-ca-cert\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.809925 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.809898    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-envoy\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.810677 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.810658    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-podinfo\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.815416 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.815391    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-token\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.815600 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.815582    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv8rl\" (UniqueName: \"kubernetes.io/projected/773cffa4-9422-40c1-a3df-583cd8b51ee4-kube-api-access-cv8rl\") pod \"e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") " pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:18.930429 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:18.930346    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:19.068306 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:19.068283    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"]
Jul 22 13:24:19.070813 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:24:19.070785    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod773cffa4_9422_40c1_a3df_583cd8b51ee4.slice/crio-024c7a9021837e69a34a235d0df838dc59bacccd248a4a39861ecb6fef20f31c WatchSource:0}: Error finding container 024c7a9021837e69a34a235d0df838dc59bacccd248a4a39861ecb6fef20f31c: Status 404 returned error can't find the container with id 024c7a9021837e69a34a235d0df838dc59bacccd248a4a39861ecb6fef20f31c
Jul 22 13:24:19.072968 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:19.072938    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:24:19.073061 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:19.073002    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:24:19.073061 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:19.073030    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:24:19.623597 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:19.623561    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8" event={"ID":"773cffa4-9422-40c1-a3df-583cd8b51ee4","Type":"ContainerStarted","Data":"29d82e6284a3e120c3944f356c17afbcddce55fff984c16adbbf24d85916d339"}
Jul 22 13:24:19.624095 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:19.623649    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8" event={"ID":"773cffa4-9422-40c1-a3df-583cd8b51ee4","Type":"ContainerStarted","Data":"024c7a9021837e69a34a235d0df838dc59bacccd248a4a39861ecb6fef20f31c"}
Jul 22 13:24:19.647490 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:19.647440    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8" podStartSLOduration=1.647425686 podStartE2EDuration="1.647425686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:24:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:24:19.646072602 +0000 UTC m=+1807.410724234" watchObservedRunningTime="2026-07-22 13:24:19.647425686 +0000 UTC m=+1807.412077312"
Jul 22 13:24:19.931177 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:19.931089    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:20.935411 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:20.935380    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:21.633102 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:21.633072    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:21.634057 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:21.634041    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:26.844387 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:26.844354    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:24:34.698427 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:34.698386    2557 generic.go:356] "Generic (PLEG): container finished" podID="773cffa4-9422-40c1-a3df-583cd8b51ee4" containerID="29d82e6284a3e120c3944f356c17afbcddce55fff984c16adbbf24d85916d339" exitCode=0
Jul 22 13:24:34.698986 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:34.698444    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8" event={"ID":"773cffa4-9422-40c1-a3df-583cd8b51ee4","Type":"ContainerDied","Data":"29d82e6284a3e120c3944f356c17afbcddce55fff984c16adbbf24d85916d339"}
Jul 22 13:24:34.699098 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:34.698984    2557 scope.go:117] "RemoveContainer" containerID="29d82e6284a3e120c3944f356c17afbcddce55fff984c16adbbf24d85916d339"
Jul 22 13:24:34.700080 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:34.700053    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:24:34.700141 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:34.700122    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:24:34.700180 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:34.700151    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:24:35.704435 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:35.704401    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8" event={"ID":"773cffa4-9422-40c1-a3df-583cd8b51ee4","Type":"ContainerStarted","Data":"ad2f3176d3aa45eddaae3bb809d4900ad39186f694ad767d22dececee5f97f5a"}
Jul 22 13:24:35.930822 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:35.930770    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:35.931885 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:35.931861    2557 patch_prober.go:28] interesting pod/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 22 13:24:35.931991 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:35.931907    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8" podUID="773cffa4-9422-40c1-a3df-583cd8b51ee4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 22 13:24:36.633590 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:36.633550    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:36.931841 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:36.931755    2557 patch_prober.go:28] interesting pod/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 22 13:24:36.931841 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:36.931810    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8" podUID="773cffa4-9422-40c1-a3df-583cd8b51ee4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 22 13:24:37.931618 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:37.931578    2557 patch_prober.go:28] interesting pod/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 22 13:24:37.931827 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:37.931639    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8" podUID="773cffa4-9422-40c1-a3df-583cd8b51ee4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 22 13:24:38.931131 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:38.931092    2557 patch_prober.go:28] interesting pod/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 22 13:24:38.931526 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:38.931166    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8" podUID="773cffa4-9422-40c1-a3df-583cd8b51ee4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 22 13:24:39.934762 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:39.934726    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:24:39.935660 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:24:39.935639    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:25:00.447073 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:00.447037    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:25:03.105546 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:03.105504    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"]
Jul 22 13:25:03.105982 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:03.105783    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8" podUID="773cffa4-9422-40c1-a3df-583cd8b51ee4" containerName="istio-proxy" containerID="cri-o://ad2f3176d3aa45eddaae3bb809d4900ad39186f694ad767d22dececee5f97f5a" gracePeriod=30
Jul 22 13:25:08.350507 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.350483    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:25:08.440432 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.440366    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-workload-socket\") pod \"773cffa4-9422-40c1-a3df-583cd8b51ee4\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") "
Jul 22 13:25:08.440432 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.440399    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-token\") pod \"773cffa4-9422-40c1-a3df-583cd8b51ee4\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") "
Jul 22 13:25:08.440620 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.440435    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-workload-certs\") pod \"773cffa4-9422-40c1-a3df-583cd8b51ee4\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") "
Jul 22 13:25:08.440620 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.440458    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-data\") pod \"773cffa4-9422-40c1-a3df-583cd8b51ee4\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") "
Jul 22 13:25:08.440620 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.440478    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-podinfo\") pod \"773cffa4-9422-40c1-a3df-583cd8b51ee4\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") "
Jul 22 13:25:08.440620 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.440499    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/773cffa4-9422-40c1-a3df-583cd8b51ee4-istiod-ca-cert\") pod \"773cffa4-9422-40c1-a3df-583cd8b51ee4\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") "
Jul 22 13:25:08.440620 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.440520    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-credential-socket\") pod \"773cffa4-9422-40c1-a3df-583cd8b51ee4\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") "
Jul 22 13:25:08.440620 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.440534    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cv8rl\" (UniqueName: \"kubernetes.io/projected/773cffa4-9422-40c1-a3df-583cd8b51ee4-kube-api-access-cv8rl\") pod \"773cffa4-9422-40c1-a3df-583cd8b51ee4\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") "
Jul 22 13:25:08.440620 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.440555    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-envoy\") pod \"773cffa4-9422-40c1-a3df-583cd8b51ee4\" (UID: \"773cffa4-9422-40c1-a3df-583cd8b51ee4\") "
Jul 22 13:25:08.440984 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.440674    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "773cffa4-9422-40c1-a3df-583cd8b51ee4" (UID: "773cffa4-9422-40c1-a3df-583cd8b51ee4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:25:08.440984 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.440784    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "773cffa4-9422-40c1-a3df-583cd8b51ee4" (UID: "773cffa4-9422-40c1-a3df-583cd8b51ee4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:25:08.440984 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.440834    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "773cffa4-9422-40c1-a3df-583cd8b51ee4" (UID: "773cffa4-9422-40c1-a3df-583cd8b51ee4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:25:08.440984 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.440947    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-workload-socket\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:25:08.440984 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.440967    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-workload-certs\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:25:08.440984 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.440981    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-credential-socket\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:25:08.441198 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.441040    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/773cffa4-9422-40c1-a3df-583cd8b51ee4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "773cffa4-9422-40c1-a3df-583cd8b51ee4" (UID: "773cffa4-9422-40c1-a3df-583cd8b51ee4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:25:08.441376 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.441355    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-data" (OuterVolumeSpecName: "istio-data") pod "773cffa4-9422-40c1-a3df-583cd8b51ee4" (UID: "773cffa4-9422-40c1-a3df-583cd8b51ee4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:25:08.442724 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.442688    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "773cffa4-9422-40c1-a3df-583cd8b51ee4" (UID: "773cffa4-9422-40c1-a3df-583cd8b51ee4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 13:25:08.442884 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.442870    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "773cffa4-9422-40c1-a3df-583cd8b51ee4" (UID: "773cffa4-9422-40c1-a3df-583cd8b51ee4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:25:08.443041 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.443027    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-token" (OuterVolumeSpecName: "istio-token") pod "773cffa4-9422-40c1-a3df-583cd8b51ee4" (UID: "773cffa4-9422-40c1-a3df-583cd8b51ee4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:25:08.443252 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.443224    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/773cffa4-9422-40c1-a3df-583cd8b51ee4-kube-api-access-cv8rl" (OuterVolumeSpecName: "kube-api-access-cv8rl") pod "773cffa4-9422-40c1-a3df-583cd8b51ee4" (UID: "773cffa4-9422-40c1-a3df-583cd8b51ee4"). InnerVolumeSpecName "kube-api-access-cv8rl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:25:08.542058 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.542026    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-token\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:25:08.542058 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.542053    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-data\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:25:08.542058 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.542062    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-podinfo\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:25:08.542058 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.542070    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/773cffa4-9422-40c1-a3df-583cd8b51ee4-istiod-ca-cert\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:25:08.542354 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.542080    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cv8rl\" (UniqueName: \"kubernetes.io/projected/773cffa4-9422-40c1-a3df-583cd8b51ee4-kube-api-access-cv8rl\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:25:08.542354 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.542089    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/773cffa4-9422-40c1-a3df-583cd8b51ee4-istio-envoy\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:25:08.856390 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.856359    2557 generic.go:356] "Generic (PLEG): container finished" podID="773cffa4-9422-40c1-a3df-583cd8b51ee4" containerID="ad2f3176d3aa45eddaae3bb809d4900ad39186f694ad767d22dececee5f97f5a" exitCode=0
Jul 22 13:25:08.856533 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.856404    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"
Jul 22 13:25:08.856533 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.856442    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8" event={"ID":"773cffa4-9422-40c1-a3df-583cd8b51ee4","Type":"ContainerDied","Data":"ad2f3176d3aa45eddaae3bb809d4900ad39186f694ad767d22dececee5f97f5a"}
Jul 22 13:25:08.856533 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.856500    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8" event={"ID":"773cffa4-9422-40c1-a3df-583cd8b51ee4","Type":"ContainerDied","Data":"024c7a9021837e69a34a235d0df838dc59bacccd248a4a39861ecb6fef20f31c"}
Jul 22 13:25:08.856533 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.856523    2557 scope.go:117] "RemoveContainer" containerID="ad2f3176d3aa45eddaae3bb809d4900ad39186f694ad767d22dececee5f97f5a"
Jul 22 13:25:08.864732 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.864702    2557 scope.go:117] "RemoveContainer" containerID="29d82e6284a3e120c3944f356c17afbcddce55fff984c16adbbf24d85916d339"
Jul 22 13:25:08.872159 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.872144    2557 scope.go:117] "RemoveContainer" containerID="ad2f3176d3aa45eddaae3bb809d4900ad39186f694ad767d22dececee5f97f5a"
Jul 22 13:25:08.872412 ip-10-0-141-162 kubenswrapper[2557]: E0722 13:25:08.872395    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad2f3176d3aa45eddaae3bb809d4900ad39186f694ad767d22dececee5f97f5a\": container with ID starting with ad2f3176d3aa45eddaae3bb809d4900ad39186f694ad767d22dececee5f97f5a not found: ID does not exist" containerID="ad2f3176d3aa45eddaae3bb809d4900ad39186f694ad767d22dececee5f97f5a"
Jul 22 13:25:08.872500 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.872424    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad2f3176d3aa45eddaae3bb809d4900ad39186f694ad767d22dececee5f97f5a"} err="failed to get container status \"ad2f3176d3aa45eddaae3bb809d4900ad39186f694ad767d22dececee5f97f5a\": rpc error: code = NotFound desc = could not find container \"ad2f3176d3aa45eddaae3bb809d4900ad39186f694ad767d22dececee5f97f5a\": container with ID starting with ad2f3176d3aa45eddaae3bb809d4900ad39186f694ad767d22dececee5f97f5a not found: ID does not exist"
Jul 22 13:25:08.872500 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.872447    2557 scope.go:117] "RemoveContainer" containerID="29d82e6284a3e120c3944f356c17afbcddce55fff984c16adbbf24d85916d339"
Jul 22 13:25:08.872693 ip-10-0-141-162 kubenswrapper[2557]: E0722 13:25:08.872676    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29d82e6284a3e120c3944f356c17afbcddce55fff984c16adbbf24d85916d339\": container with ID starting with 29d82e6284a3e120c3944f356c17afbcddce55fff984c16adbbf24d85916d339 not found: ID does not exist" containerID="29d82e6284a3e120c3944f356c17afbcddce55fff984c16adbbf24d85916d339"
Jul 22 13:25:08.872764 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.872699    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29d82e6284a3e120c3944f356c17afbcddce55fff984c16adbbf24d85916d339"} err="failed to get container status \"29d82e6284a3e120c3944f356c17afbcddce55fff984c16adbbf24d85916d339\": rpc error: code = NotFound desc = could not find container \"29d82e6284a3e120c3944f356c17afbcddce55fff984c16adbbf24d85916d339\": container with ID starting with 29d82e6284a3e120c3944f356c17afbcddce55fff984c16adbbf24d85916d339 not found: ID does not exist"
Jul 22 13:25:08.877390 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.877369    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"]
Jul 22 13:25:08.886203 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:08.886182    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4cedc07b-openshift-default-77b47fcf75-86cm8"]
Jul 22 13:25:10.808770 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:10.808734    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="773cffa4-9422-40c1-a3df-583cd8b51ee4" path="/var/lib/kubelet/pods/773cffa4-9422-40c1-a3df-583cd8b51ee4/volumes"
Jul 22 13:25:11.743134 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:11.743099    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:25:44.244682 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:25:44.244594    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:27:13.446606 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:27:13.446521    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:27:25.742793 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:27:25.742750    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:27:39.134561 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:27:39.134525    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:27:55.051085 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:27:55.051049    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:28:34.448430 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:34.448347    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:28:40.744444 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.744407    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"]
Jul 22 13:28:40.744812 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.744704    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773cffa4-9422-40c1-a3df-583cd8b51ee4" containerName="istio-proxy"
Jul 22 13:28:40.744812 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.744732    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="773cffa4-9422-40c1-a3df-583cd8b51ee4" containerName="istio-proxy"
Jul 22 13:28:40.744812 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.744748    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773cffa4-9422-40c1-a3df-583cd8b51ee4" containerName="istio-proxy"
Jul 22 13:28:40.744812 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.744754    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="773cffa4-9422-40c1-a3df-583cd8b51ee4" containerName="istio-proxy"
Jul 22 13:28:40.744812 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.744813    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="773cffa4-9422-40c1-a3df-583cd8b51ee4" containerName="istio-proxy"
Jul 22 13:28:40.747642 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.747621    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:40.750460 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.750440    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-2b3e367f\"/\"default-dockercfg-74fw4\""
Jul 22 13:28:40.750594 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.750441    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-2b3e367f\"/\"openshift-service-ca.crt\""
Jul 22 13:28:40.750594 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.750493    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-2b3e367f\"/\"e2e-lifecycle-model-2b3e367f-kserve-self-signed-certs\""
Jul 22 13:28:40.750594 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.750497    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-2b3e367f\"/\"kube-root-ca.crt\""
Jul 22 13:28:40.757569 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.757549    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"]
Jul 22 13:28:40.816172 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.816142    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-dshm\") pod \"e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") " pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:40.816172 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.816172    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m258\" (UniqueName: \"kubernetes.io/projected/2664c65e-e66b-40f0-bef8-468a1f3b4c15-kube-api-access-8m258\") pod \"e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") " pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:40.816364 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.816202    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2664c65e-e66b-40f0-bef8-468a1f3b4c15-tls-certs\") pod \"e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") " pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:40.816364 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.816266    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-home\") pod \"e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") " pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:40.816364 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.816293    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-tmp-dir\") pod \"e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") " pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:40.816364 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.816319    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-model-cache\") pod \"e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") " pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:40.916968 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.916917    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2664c65e-e66b-40f0-bef8-468a1f3b4c15-tls-certs\") pod \"e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") " pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:40.917157 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.916978    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-home\") pod \"e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") " pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:40.917157 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.917012    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-tmp-dir\") pod \"e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") " pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:40.917351 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.917330    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-model-cache\") pod \"e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") " pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:40.917444 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.917426    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-dshm\") pod \"e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") " pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:40.917504 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.917460    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m258\" (UniqueName: \"kubernetes.io/projected/2664c65e-e66b-40f0-bef8-468a1f3b4c15-kube-api-access-8m258\") pod \"e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") " pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:40.917837 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.917813    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-home\") pod \"e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") " pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:40.918010 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.917917    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-model-cache\") pod \"e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") " pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:40.918010 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.917928    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-tmp-dir\") pod \"e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") " pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:40.920028 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.919997    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-dshm\") pod \"e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") " pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:40.920474 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.920442    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2664c65e-e66b-40f0-bef8-468a1f3b4c15-tls-certs\") pod \"e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") " pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:40.929195 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:40.929177    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m258\" (UniqueName: \"kubernetes.io/projected/2664c65e-e66b-40f0-bef8-468a1f3b4c15-kube-api-access-8m258\") pod \"e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") " pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:41.057283 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:41.057189    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:41.199527 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:41.199502    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"]
Jul 22 13:28:41.202093 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:28:41.202054    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2664c65e_e66b_40f0_bef8_468a1f3b4c15.slice/crio-89639ea72208e2a9ed5a4ab144bb232a36384564bded0d212ce69cc94bd4c3da WatchSource:0}: Error finding container 89639ea72208e2a9ed5a4ab144bb232a36384564bded0d212ce69cc94bd4c3da: Status 404 returned error can't find the container with id 89639ea72208e2a9ed5a4ab144bb232a36384564bded0d212ce69cc94bd4c3da
Jul 22 13:28:41.774987 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:41.774950    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp" event={"ID":"2664c65e-e66b-40f0-bef8-468a1f3b4c15","Type":"ContainerStarted","Data":"acabd4482e2c181d1b17a8850e19d70ce90bbbe61096c23eeea06df973372c1b"}
Jul 22 13:28:41.775333 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:41.775001    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp" event={"ID":"2664c65e-e66b-40f0-bef8-468a1f3b4c15","Type":"ContainerStarted","Data":"89639ea72208e2a9ed5a4ab144bb232a36384564bded0d212ce69cc94bd4c3da"}
Jul 22 13:28:41.794300 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:41.794259    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp" podStartSLOduration=1.794243547 podStartE2EDuration="1.794243547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:28:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:28:41.793223732 +0000 UTC m=+2069.557875359" watchObservedRunningTime="2026-07-22 13:28:41.794243547 +0000 UTC m=+2069.558895174"
Jul 22 13:28:46.451857 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:46.451822    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:28:51.057859 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:51.057803    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:51.058268 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:51.057880    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:51.070286 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:51.070260    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:51.836629 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:51.836603    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:28:58.569998 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:28:58.569962    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:29:19.550040 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:19.550003    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:29:28.442416 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:28.442382    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:29:32.967903 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:32.967865    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"]
Jul 22 13:29:47.987920 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:47.987874    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp" podUID="2664c65e-e66b-40f0-bef8-468a1f3b4c15" containerName="main" containerID="cri-o://acabd4482e2c181d1b17a8850e19d70ce90bbbe61096c23eeea06df973372c1b" gracePeriod=45
Jul 22 13:29:48.245503 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:48.245447    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:29:48.392693 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:48.392662    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8m258\" (UniqueName: \"kubernetes.io/projected/2664c65e-e66b-40f0-bef8-468a1f3b4c15-kube-api-access-8m258\") pod \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") "
Jul 22 13:29:48.392910 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:48.392703    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2664c65e-e66b-40f0-bef8-468a1f3b4c15-tls-certs\") pod \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") "
Jul 22 13:29:48.392910 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:48.392850    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-dshm\") pod \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") "
Jul 22 13:29:48.393029 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:48.392916    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-tmp-dir\") pod \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") "
Jul 22 13:29:48.393029 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:48.392997    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-model-cache\") pod \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") "
Jul 22 13:29:48.393029 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:48.393026    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-home\") pod \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\" (UID: \"2664c65e-e66b-40f0-bef8-468a1f3b4c15\") "
Jul 22 13:29:48.393288 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:48.393195    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2664c65e-e66b-40f0-bef8-468a1f3b4c15" (UID: "2664c65e-e66b-40f0-bef8-468a1f3b4c15"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:29:48.393288 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:48.393254    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-model-cache" (OuterVolumeSpecName: "model-cache") pod "2664c65e-e66b-40f0-bef8-468a1f3b4c15" (UID: "2664c65e-e66b-40f0-bef8-468a1f3b4c15"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:29:48.393483 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:48.393372    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-tmp-dir\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:29:48.393483 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:48.393388    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-model-cache\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:29:48.393483 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:48.393383    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-home" (OuterVolumeSpecName: "home") pod "2664c65e-e66b-40f0-bef8-468a1f3b4c15" (UID: "2664c65e-e66b-40f0-bef8-468a1f3b4c15"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:29:48.394993 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:48.394968    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-dshm" (OuterVolumeSpecName: "dshm") pod "2664c65e-e66b-40f0-bef8-468a1f3b4c15" (UID: "2664c65e-e66b-40f0-bef8-468a1f3b4c15"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:29:48.394993 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:48.394975    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2664c65e-e66b-40f0-bef8-468a1f3b4c15-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2664c65e-e66b-40f0-bef8-468a1f3b4c15" (UID: "2664c65e-e66b-40f0-bef8-468a1f3b4c15"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:29:48.395155 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:48.395040    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2664c65e-e66b-40f0-bef8-468a1f3b4c15-kube-api-access-8m258" (OuterVolumeSpecName: "kube-api-access-8m258") pod "2664c65e-e66b-40f0-bef8-468a1f3b4c15" (UID: "2664c65e-e66b-40f0-bef8-468a1f3b4c15"). InnerVolumeSpecName "kube-api-access-8m258". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:29:48.493834 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:48.493799    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-home\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:29:48.493834 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:48.493826    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8m258\" (UniqueName: \"kubernetes.io/projected/2664c65e-e66b-40f0-bef8-468a1f3b4c15-kube-api-access-8m258\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:29:48.493834 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:48.493838    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2664c65e-e66b-40f0-bef8-468a1f3b4c15-tls-certs\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:29:48.493834 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:48.493846    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2664c65e-e66b-40f0-bef8-468a1f3b4c15-dshm\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:29:49.076071 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:49.075988    2557 generic.go:356] "Generic (PLEG): container finished" podID="2664c65e-e66b-40f0-bef8-468a1f3b4c15" containerID="acabd4482e2c181d1b17a8850e19d70ce90bbbe61096c23eeea06df973372c1b" exitCode=0
Jul 22 13:29:49.076071 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:49.076032    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"
Jul 22 13:29:49.076495 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:49.076076    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp" event={"ID":"2664c65e-e66b-40f0-bef8-468a1f3b4c15","Type":"ContainerDied","Data":"acabd4482e2c181d1b17a8850e19d70ce90bbbe61096c23eeea06df973372c1b"}
Jul 22 13:29:49.076495 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:49.076117    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp" event={"ID":"2664c65e-e66b-40f0-bef8-468a1f3b4c15","Type":"ContainerDied","Data":"89639ea72208e2a9ed5a4ab144bb232a36384564bded0d212ce69cc94bd4c3da"}
Jul 22 13:29:49.076495 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:49.076138    2557 scope.go:117] "RemoveContainer" containerID="acabd4482e2c181d1b17a8850e19d70ce90bbbe61096c23eeea06df973372c1b"
Jul 22 13:29:49.084176 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:49.084162    2557 scope.go:117] "RemoveContainer" containerID="acabd4482e2c181d1b17a8850e19d70ce90bbbe61096c23eeea06df973372c1b"
Jul 22 13:29:49.084421 ip-10-0-141-162 kubenswrapper[2557]: E0722 13:29:49.084403    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acabd4482e2c181d1b17a8850e19d70ce90bbbe61096c23eeea06df973372c1b\": container with ID starting with acabd4482e2c181d1b17a8850e19d70ce90bbbe61096c23eeea06df973372c1b not found: ID does not exist" containerID="acabd4482e2c181d1b17a8850e19d70ce90bbbe61096c23eeea06df973372c1b"
Jul 22 13:29:49.084533 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:49.084427    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acabd4482e2c181d1b17a8850e19d70ce90bbbe61096c23eeea06df973372c1b"} err="failed to get container status \"acabd4482e2c181d1b17a8850e19d70ce90bbbe61096c23eeea06df973372c1b\": rpc error: code = NotFound desc = could not find container \"acabd4482e2c181d1b17a8850e19d70ce90bbbe61096c23eeea06df973372c1b\": container with ID starting with acabd4482e2c181d1b17a8850e19d70ce90bbbe61096c23eeea06df973372c1b not found: ID does not exist"
Jul 22 13:29:49.093562 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:49.093540    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"]
Jul 22 13:29:49.098125 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:49.098105    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-2b3e367f/e2e-lifecycle-model-2b3e367f-kserve-6ff48fb68c-z5cqp"]
Jul 22 13:29:50.808885 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:29:50.808851    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2664c65e-e66b-40f0-bef8-468a1f3b4c15" path="/var/lib/kubelet/pods/2664c65e-e66b-40f0-bef8-468a1f3b4c15/volumes"
Jul 22 13:30:19.646535 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:30:19.646496    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:30:30.362566 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:30:30.362529    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:31:24.081551 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:24.081518    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:31:37.159314 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:37.159274    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:31:38.347752 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.347697    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"]
Jul 22 13:31:38.348210 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.348176    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2664c65e-e66b-40f0-bef8-468a1f3b4c15" containerName="main"
Jul 22 13:31:38.348210 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.348194    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2664c65e-e66b-40f0-bef8-468a1f3b4c15" containerName="main"
Jul 22 13:31:38.348329 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.348281    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="773cffa4-9422-40c1-a3df-583cd8b51ee4" containerName="istio-proxy"
Jul 22 13:31:38.348329 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.348296    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2664c65e-e66b-40f0-bef8-468a1f3b4c15" containerName="main"
Jul 22 13:31:38.351096 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.351075    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:38.353276 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.353252    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-cc03a6\"/\"test-model-cc03a6-kserve-self-signed-certs\""
Jul 22 13:31:38.353807 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.353791    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-cc03a6\"/\"openshift-service-ca.crt\""
Jul 22 13:31:38.353884 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.353794    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-cc03a6\"/\"kube-root-ca.crt\""
Jul 22 13:31:38.353936 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.353892    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-cc03a6\"/\"default-dockercfg-n2zqw\""
Jul 22 13:31:38.359898 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.359871    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"]
Jul 22 13:31:38.426591 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.426553    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-home\") pod \"test-model-cc03a6-kserve-5dbffb555c-kk698\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") " pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:38.426817 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.426611    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3038ab97-8e86-4945-ace6-00e78aef7680-tls-certs\") pod \"test-model-cc03a6-kserve-5dbffb555c-kk698\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") " pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:38.426817 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.426630    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-model-cache\") pod \"test-model-cc03a6-kserve-5dbffb555c-kk698\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") " pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:38.426817 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.426653    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-tmp-dir\") pod \"test-model-cc03a6-kserve-5dbffb555c-kk698\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") " pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:38.426817 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.426683    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-dshm\") pod \"test-model-cc03a6-kserve-5dbffb555c-kk698\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") " pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:38.426817 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.426768    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgfb5\" (UniqueName: \"kubernetes.io/projected/3038ab97-8e86-4945-ace6-00e78aef7680-kube-api-access-sgfb5\") pod \"test-model-cc03a6-kserve-5dbffb555c-kk698\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") " pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:38.527488 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.527450    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgfb5\" (UniqueName: \"kubernetes.io/projected/3038ab97-8e86-4945-ace6-00e78aef7680-kube-api-access-sgfb5\") pod \"test-model-cc03a6-kserve-5dbffb555c-kk698\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") " pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:38.527752 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.527509    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-home\") pod \"test-model-cc03a6-kserve-5dbffb555c-kk698\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") " pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:38.527752 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.527575    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3038ab97-8e86-4945-ace6-00e78aef7680-tls-certs\") pod \"test-model-cc03a6-kserve-5dbffb555c-kk698\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") " pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:38.527752 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.527601    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-model-cache\") pod \"test-model-cc03a6-kserve-5dbffb555c-kk698\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") " pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:38.527752 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.527636    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-tmp-dir\") pod \"test-model-cc03a6-kserve-5dbffb555c-kk698\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") " pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:38.527752 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.527686    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-dshm\") pod \"test-model-cc03a6-kserve-5dbffb555c-kk698\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") " pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:38.528067 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.528038    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-model-cache\") pod \"test-model-cc03a6-kserve-5dbffb555c-kk698\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") " pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:38.528067 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.528056    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-home\") pod \"test-model-cc03a6-kserve-5dbffb555c-kk698\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") " pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:38.528169 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.528088    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-tmp-dir\") pod \"test-model-cc03a6-kserve-5dbffb555c-kk698\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") " pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:38.530050 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.530020    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-dshm\") pod \"test-model-cc03a6-kserve-5dbffb555c-kk698\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") " pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:38.530173 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.530155    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3038ab97-8e86-4945-ace6-00e78aef7680-tls-certs\") pod \"test-model-cc03a6-kserve-5dbffb555c-kk698\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") " pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:38.537033 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.537010    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgfb5\" (UniqueName: \"kubernetes.io/projected/3038ab97-8e86-4945-ace6-00e78aef7680-kube-api-access-sgfb5\") pod \"test-model-cc03a6-kserve-5dbffb555c-kk698\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") " pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:38.662074 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.662036    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:38.808229 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:31:38.808199    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3038ab97_8e86_4945_ace6_00e78aef7680.slice/crio-3b81aaf97bcc4cecf17b1168abb773c1cb0b352ea3fbdd2c6079afd9a3b25e42 WatchSource:0}: Error finding container 3b81aaf97bcc4cecf17b1168abb773c1cb0b352ea3fbdd2c6079afd9a3b25e42: Status 404 returned error can't find the container with id 3b81aaf97bcc4cecf17b1168abb773c1cb0b352ea3fbdd2c6079afd9a3b25e42
Jul 22 13:31:38.810036 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:38.810013    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"]
Jul 22 13:31:39.568884 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:39.568847    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698" event={"ID":"3038ab97-8e86-4945-ace6-00e78aef7680","Type":"ContainerStarted","Data":"c0a447260f37df5e8e74e301ec182f42d38b19f01bc862d70970c8719f10d4e6"}
Jul 22 13:31:39.569275 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:39.568895    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698" event={"ID":"3038ab97-8e86-4945-ace6-00e78aef7680","Type":"ContainerStarted","Data":"3b81aaf97bcc4cecf17b1168abb773c1cb0b352ea3fbdd2c6079afd9a3b25e42"}
Jul 22 13:31:39.590308 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:39.590256    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698" podStartSLOduration=1.590237602 podStartE2EDuration="1.590237602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:31:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:31:39.588558209 +0000 UTC m=+2247.353209847" watchObservedRunningTime="2026-07-22 13:31:39.590237602 +0000 UTC m=+2247.354889206"
Jul 22 13:31:46.943007 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:46.942969    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:31:48.662203 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:48.662171    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:48.662574 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:48.662216    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:48.674575 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:48.674553    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:31:49.623175 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:31:49.623146    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:32:10.196838 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.196805    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"]
Jul 22 13:32:10.200394 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.200378    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:10.207388 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.207015    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-aa3ea2\"/\"default-dockercfg-5wgb8\""
Jul 22 13:32:10.207388 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.207032    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-aa3ea2\"/\"test-model-aa3ea2-kserve-self-signed-certs\""
Jul 22 13:32:10.207388 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.207041    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-aa3ea2\"/\"openshift-service-ca.crt\""
Jul 22 13:32:10.207388 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.207329    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-aa3ea2\"/\"kube-root-ca.crt\""
Jul 22 13:32:10.210884 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.210865    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-dshm\") pod \"test-model-aa3ea2-kserve-5b85fc96cf-kp6tr\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") " pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:10.210995 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.210889    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-model-cache\") pod \"test-model-aa3ea2-kserve-5b85fc96cf-kp6tr\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") " pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:10.210995 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.210913    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-home\") pod \"test-model-aa3ea2-kserve-5b85fc96cf-kp6tr\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") " pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:10.210995 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.210937    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-tmp-dir\") pod \"test-model-aa3ea2-kserve-5b85fc96cf-kp6tr\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") " pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:10.211100 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.211027    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwdzr\" (UniqueName: \"kubernetes.io/projected/275e7261-e19c-4e1c-90ed-24c1930ca606-kube-api-access-qwdzr\") pod \"test-model-aa3ea2-kserve-5b85fc96cf-kp6tr\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") " pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:10.211134 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.211105    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/275e7261-e19c-4e1c-90ed-24c1930ca606-tls-certs\") pod \"test-model-aa3ea2-kserve-5b85fc96cf-kp6tr\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") " pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:10.221528 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.221507    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"]
Jul 22 13:32:10.311730 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.311686    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwdzr\" (UniqueName: \"kubernetes.io/projected/275e7261-e19c-4e1c-90ed-24c1930ca606-kube-api-access-qwdzr\") pod \"test-model-aa3ea2-kserve-5b85fc96cf-kp6tr\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") " pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:10.311887 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.311761    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/275e7261-e19c-4e1c-90ed-24c1930ca606-tls-certs\") pod \"test-model-aa3ea2-kserve-5b85fc96cf-kp6tr\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") " pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:10.311887 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.311814    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-dshm\") pod \"test-model-aa3ea2-kserve-5b85fc96cf-kp6tr\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") " pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:10.311887 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.311831    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-model-cache\") pod \"test-model-aa3ea2-kserve-5b85fc96cf-kp6tr\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") " pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:10.311887 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.311849    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-home\") pod \"test-model-aa3ea2-kserve-5b85fc96cf-kp6tr\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") " pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:10.311887 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.311867    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-tmp-dir\") pod \"test-model-aa3ea2-kserve-5b85fc96cf-kp6tr\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") " pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:10.312241 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.312222    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-home\") pod \"test-model-aa3ea2-kserve-5b85fc96cf-kp6tr\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") " pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:10.312319 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.312285    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-tmp-dir\") pod \"test-model-aa3ea2-kserve-5b85fc96cf-kp6tr\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") " pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:10.312368 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.312314    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-model-cache\") pod \"test-model-aa3ea2-kserve-5b85fc96cf-kp6tr\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") " pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:10.314053 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.314031    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-dshm\") pod \"test-model-aa3ea2-kserve-5b85fc96cf-kp6tr\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") " pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:10.314199 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.314182    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/275e7261-e19c-4e1c-90ed-24c1930ca606-tls-certs\") pod \"test-model-aa3ea2-kserve-5b85fc96cf-kp6tr\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") " pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:10.322194 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.322173    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwdzr\" (UniqueName: \"kubernetes.io/projected/275e7261-e19c-4e1c-90ed-24c1930ca606-kube-api-access-qwdzr\") pod \"test-model-aa3ea2-kserve-5b85fc96cf-kp6tr\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") " pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:10.510039 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.509947    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:10.661568 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.661536    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"]
Jul 22 13:32:10.664539 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:32:10.664515    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod275e7261_e19c_4e1c_90ed_24c1930ca606.slice/crio-b4f2cdf681b8d79747c18f312c3b65fc7a4741d3cffcadd682d1543fd30f827e WatchSource:0}: Error finding container b4f2cdf681b8d79747c18f312c3b65fc7a4741d3cffcadd682d1543fd30f827e: Status 404 returned error can't find the container with id b4f2cdf681b8d79747c18f312c3b65fc7a4741d3cffcadd682d1543fd30f827e
Jul 22 13:32:10.702746 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:10.702694    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr" event={"ID":"275e7261-e19c-4e1c-90ed-24c1930ca606","Type":"ContainerStarted","Data":"b4f2cdf681b8d79747c18f312c3b65fc7a4741d3cffcadd682d1543fd30f827e"}
Jul 22 13:32:11.708911 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:11.708873    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr" event={"ID":"275e7261-e19c-4e1c-90ed-24c1930ca606","Type":"ContainerStarted","Data":"f3739e2872e5dd74714496cbe9925d53bbfdfdbe254bb0007497c5a8ece8f28c"}
Jul 22 13:32:11.734050 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:11.733997    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr" podStartSLOduration=1.733981947 podStartE2EDuration="1.733981947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:32:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:32:11.732551715 +0000 UTC m=+2279.497203340" watchObservedRunningTime="2026-07-22 13:32:11.733981947 +0000 UTC m=+2279.498633573"
Jul 22 13:32:14.659218 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:14.659185    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:32:20.510209 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:20.510148    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:20.510209 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:20.510224    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:20.522747 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:20.522704    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:20.760859 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:20.760762    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:32:28.055132 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:28.055095    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:32:56.298301 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:56.298262    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"]
Jul 22 13:32:57.199733 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:32:57.199688    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"]
Jul 22 13:33:01.636287 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:01.636249    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:33:11.317976 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.317866    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698" podUID="3038ab97-8e86-4945-ace6-00e78aef7680" containerName="main" containerID="cri-o://c0a447260f37df5e8e74e301ec182f42d38b19f01bc862d70970c8719f10d4e6" gracePeriod=45
Jul 22 13:33:11.562367 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.562346    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:33:11.639173 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.639140    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgfb5\" (UniqueName: \"kubernetes.io/projected/3038ab97-8e86-4945-ace6-00e78aef7680-kube-api-access-sgfb5\") pod \"3038ab97-8e86-4945-ace6-00e78aef7680\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") "
Jul 22 13:33:11.639349 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.639185    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-home\") pod \"3038ab97-8e86-4945-ace6-00e78aef7680\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") "
Jul 22 13:33:11.639349 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.639219    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-model-cache\") pod \"3038ab97-8e86-4945-ace6-00e78aef7680\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") "
Jul 22 13:33:11.639349 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.639235    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-tmp-dir\") pod \"3038ab97-8e86-4945-ace6-00e78aef7680\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") "
Jul 22 13:33:11.639349 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.639270    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-dshm\") pod \"3038ab97-8e86-4945-ace6-00e78aef7680\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") "
Jul 22 13:33:11.639349 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.639288    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3038ab97-8e86-4945-ace6-00e78aef7680-tls-certs\") pod \"3038ab97-8e86-4945-ace6-00e78aef7680\" (UID: \"3038ab97-8e86-4945-ace6-00e78aef7680\") "
Jul 22 13:33:11.639606 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.639499    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-model-cache" (OuterVolumeSpecName: "model-cache") pod "3038ab97-8e86-4945-ace6-00e78aef7680" (UID: "3038ab97-8e86-4945-ace6-00e78aef7680"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:33:11.639606 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.639540    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-home" (OuterVolumeSpecName: "home") pod "3038ab97-8e86-4945-ace6-00e78aef7680" (UID: "3038ab97-8e86-4945-ace6-00e78aef7680"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:33:11.639606 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.639557    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3038ab97-8e86-4945-ace6-00e78aef7680" (UID: "3038ab97-8e86-4945-ace6-00e78aef7680"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:33:11.641411 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.641385    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-dshm" (OuterVolumeSpecName: "dshm") pod "3038ab97-8e86-4945-ace6-00e78aef7680" (UID: "3038ab97-8e86-4945-ace6-00e78aef7680"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:33:11.641523 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.641428    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3038ab97-8e86-4945-ace6-00e78aef7680-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3038ab97-8e86-4945-ace6-00e78aef7680" (UID: "3038ab97-8e86-4945-ace6-00e78aef7680"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:33:11.641523 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.641448    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3038ab97-8e86-4945-ace6-00e78aef7680-kube-api-access-sgfb5" (OuterVolumeSpecName: "kube-api-access-sgfb5") pod "3038ab97-8e86-4945-ace6-00e78aef7680" (UID: "3038ab97-8e86-4945-ace6-00e78aef7680"). InnerVolumeSpecName "kube-api-access-sgfb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:33:11.740673 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.740633    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-model-cache\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:33:11.740673 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.740663    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-tmp-dir\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:33:11.740673 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.740676    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-dshm\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:33:11.740936 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.740686    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3038ab97-8e86-4945-ace6-00e78aef7680-tls-certs\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:33:11.740936 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.740699    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgfb5\" (UniqueName: \"kubernetes.io/projected/3038ab97-8e86-4945-ace6-00e78aef7680-kube-api-access-sgfb5\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:33:11.740936 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.740734    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3038ab97-8e86-4945-ace6-00e78aef7680-home\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:33:11.976950 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.976860    2557 generic.go:356] "Generic (PLEG): container finished" podID="3038ab97-8e86-4945-ace6-00e78aef7680" containerID="c0a447260f37df5e8e74e301ec182f42d38b19f01bc862d70970c8719f10d4e6" exitCode=0
Jul 22 13:33:11.976950 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.976898    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"
Jul 22 13:33:11.977113 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.976939    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698" event={"ID":"3038ab97-8e86-4945-ace6-00e78aef7680","Type":"ContainerDied","Data":"c0a447260f37df5e8e74e301ec182f42d38b19f01bc862d70970c8719f10d4e6"}
Jul 22 13:33:11.977113 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.977000    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698" event={"ID":"3038ab97-8e86-4945-ace6-00e78aef7680","Type":"ContainerDied","Data":"3b81aaf97bcc4cecf17b1168abb773c1cb0b352ea3fbdd2c6079afd9a3b25e42"}
Jul 22 13:33:11.977113 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.977023    2557 scope.go:117] "RemoveContainer" containerID="c0a447260f37df5e8e74e301ec182f42d38b19f01bc862d70970c8719f10d4e6"
Jul 22 13:33:11.988300 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.988275    2557 scope.go:117] "RemoveContainer" containerID="c0a447260f37df5e8e74e301ec182f42d38b19f01bc862d70970c8719f10d4e6"
Jul 22 13:33:11.988818 ip-10-0-141-162 kubenswrapper[2557]: E0722 13:33:11.988791    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0a447260f37df5e8e74e301ec182f42d38b19f01bc862d70970c8719f10d4e6\": container with ID starting with c0a447260f37df5e8e74e301ec182f42d38b19f01bc862d70970c8719f10d4e6 not found: ID does not exist" containerID="c0a447260f37df5e8e74e301ec182f42d38b19f01bc862d70970c8719f10d4e6"
Jul 22 13:33:11.988924 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:11.988829    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0a447260f37df5e8e74e301ec182f42d38b19f01bc862d70970c8719f10d4e6"} err="failed to get container status \"c0a447260f37df5e8e74e301ec182f42d38b19f01bc862d70970c8719f10d4e6\": rpc error: code = NotFound desc = could not find container \"c0a447260f37df5e8e74e301ec182f42d38b19f01bc862d70970c8719f10d4e6\": container with ID starting with c0a447260f37df5e8e74e301ec182f42d38b19f01bc862d70970c8719f10d4e6 not found: ID does not exist"
Jul 22 13:33:12.000353 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.000325    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"]
Jul 22 13:33:12.008118 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.008094    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-cc03a6/test-model-cc03a6-kserve-5dbffb555c-kk698"]
Jul 22 13:33:12.219850 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.219808    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr" podUID="275e7261-e19c-4e1c-90ed-24c1930ca606" containerName="main" containerID="cri-o://f3739e2872e5dd74714496cbe9925d53bbfdfdbe254bb0007497c5a8ece8f28c" gracePeriod=45
Jul 22 13:33:12.460022 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.459999    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:33:12.547005 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.546932    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwdzr\" (UniqueName: \"kubernetes.io/projected/275e7261-e19c-4e1c-90ed-24c1930ca606-kube-api-access-qwdzr\") pod \"275e7261-e19c-4e1c-90ed-24c1930ca606\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") "
Jul 22 13:33:12.547005 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.546970    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-home\") pod \"275e7261-e19c-4e1c-90ed-24c1930ca606\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") "
Jul 22 13:33:12.547005 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.546995    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/275e7261-e19c-4e1c-90ed-24c1930ca606-tls-certs\") pod \"275e7261-e19c-4e1c-90ed-24c1930ca606\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") "
Jul 22 13:33:12.547270 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.547085    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-model-cache\") pod \"275e7261-e19c-4e1c-90ed-24c1930ca606\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") "
Jul 22 13:33:12.547270 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.547153    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-tmp-dir\") pod \"275e7261-e19c-4e1c-90ed-24c1930ca606\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") "
Jul 22 13:33:12.547270 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.547185    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-dshm\") pod \"275e7261-e19c-4e1c-90ed-24c1930ca606\" (UID: \"275e7261-e19c-4e1c-90ed-24c1930ca606\") "
Jul 22 13:33:12.547431 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.547253    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-home" (OuterVolumeSpecName: "home") pod "275e7261-e19c-4e1c-90ed-24c1930ca606" (UID: "275e7261-e19c-4e1c-90ed-24c1930ca606"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:33:12.547431 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.547333    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-model-cache" (OuterVolumeSpecName: "model-cache") pod "275e7261-e19c-4e1c-90ed-24c1930ca606" (UID: "275e7261-e19c-4e1c-90ed-24c1930ca606"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:33:12.547431 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.547359    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "275e7261-e19c-4e1c-90ed-24c1930ca606" (UID: "275e7261-e19c-4e1c-90ed-24c1930ca606"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:33:12.547580 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.547471    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-tmp-dir\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:33:12.547580 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.547484    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-home\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:33:12.547580 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.547493    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-model-cache\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:33:12.549149 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.549124    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-dshm" (OuterVolumeSpecName: "dshm") pod "275e7261-e19c-4e1c-90ed-24c1930ca606" (UID: "275e7261-e19c-4e1c-90ed-24c1930ca606"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:33:12.549245 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.549228    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/275e7261-e19c-4e1c-90ed-24c1930ca606-kube-api-access-qwdzr" (OuterVolumeSpecName: "kube-api-access-qwdzr") pod "275e7261-e19c-4e1c-90ed-24c1930ca606" (UID: "275e7261-e19c-4e1c-90ed-24c1930ca606"). InnerVolumeSpecName "kube-api-access-qwdzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:33:12.549281 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.549228    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/275e7261-e19c-4e1c-90ed-24c1930ca606-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "275e7261-e19c-4e1c-90ed-24c1930ca606" (UID: "275e7261-e19c-4e1c-90ed-24c1930ca606"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:33:12.648354 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.648315    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/275e7261-e19c-4e1c-90ed-24c1930ca606-dshm\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:33:12.648354 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.648347    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwdzr\" (UniqueName: \"kubernetes.io/projected/275e7261-e19c-4e1c-90ed-24c1930ca606-kube-api-access-qwdzr\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:33:12.648354 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.648359    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/275e7261-e19c-4e1c-90ed-24c1930ca606-tls-certs\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:33:12.809296 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.809226    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3038ab97-8e86-4945-ace6-00e78aef7680" path="/var/lib/kubelet/pods/3038ab97-8e86-4945-ace6-00e78aef7680/volumes"
Jul 22 13:33:12.982423 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.982391    2557 generic.go:356] "Generic (PLEG): container finished" podID="275e7261-e19c-4e1c-90ed-24c1930ca606" containerID="f3739e2872e5dd74714496cbe9925d53bbfdfdbe254bb0007497c5a8ece8f28c" exitCode=0
Jul 22 13:33:12.982557 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.982435    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"
Jul 22 13:33:12.982557 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.982458    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr" event={"ID":"275e7261-e19c-4e1c-90ed-24c1930ca606","Type":"ContainerDied","Data":"f3739e2872e5dd74714496cbe9925d53bbfdfdbe254bb0007497c5a8ece8f28c"}
Jul 22 13:33:12.982557 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.982496    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr" event={"ID":"275e7261-e19c-4e1c-90ed-24c1930ca606","Type":"ContainerDied","Data":"b4f2cdf681b8d79747c18f312c3b65fc7a4741d3cffcadd682d1543fd30f827e"}
Jul 22 13:33:12.982557 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.982520    2557 scope.go:117] "RemoveContainer" containerID="f3739e2872e5dd74714496cbe9925d53bbfdfdbe254bb0007497c5a8ece8f28c"
Jul 22 13:33:12.990420 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.990402    2557 scope.go:117] "RemoveContainer" containerID="f3739e2872e5dd74714496cbe9925d53bbfdfdbe254bb0007497c5a8ece8f28c"
Jul 22 13:33:12.990674 ip-10-0-141-162 kubenswrapper[2557]: E0722 13:33:12.990653    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3739e2872e5dd74714496cbe9925d53bbfdfdbe254bb0007497c5a8ece8f28c\": container with ID starting with f3739e2872e5dd74714496cbe9925d53bbfdfdbe254bb0007497c5a8ece8f28c not found: ID does not exist" containerID="f3739e2872e5dd74714496cbe9925d53bbfdfdbe254bb0007497c5a8ece8f28c"
Jul 22 13:33:12.990750 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:12.990683    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3739e2872e5dd74714496cbe9925d53bbfdfdbe254bb0007497c5a8ece8f28c"} err="failed to get container status \"f3739e2872e5dd74714496cbe9925d53bbfdfdbe254bb0007497c5a8ece8f28c\": rpc error: code = NotFound desc = could not find container \"f3739e2872e5dd74714496cbe9925d53bbfdfdbe254bb0007497c5a8ece8f28c\": container with ID starting with f3739e2872e5dd74714496cbe9925d53bbfdfdbe254bb0007497c5a8ece8f28c not found: ID does not exist"
Jul 22 13:33:13.000117 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:13.000095    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"]
Jul 22 13:33:13.005402 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:13.005383    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-aa3ea2/test-model-aa3ea2-kserve-5b85fc96cf-kp6tr"]
Jul 22 13:33:14.808769 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:14.808727    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="275e7261-e19c-4e1c-90ed-24c1930ca606" path="/var/lib/kubelet/pods/275e7261-e19c-4e1c-90ed-24c1930ca606/volumes"
Jul 22 13:33:16.853529 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:16.853496    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:33:33.339137 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:33.339102    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:33:43.209945 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.209916    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"]
Jul 22 13:33:43.210322 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.210220    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3038ab97-8e86-4945-ace6-00e78aef7680" containerName="main"
Jul 22 13:33:43.210322 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.210231    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3038ab97-8e86-4945-ace6-00e78aef7680" containerName="main"
Jul 22 13:33:43.210322 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.210240    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="275e7261-e19c-4e1c-90ed-24c1930ca606" containerName="main"
Jul 22 13:33:43.210322 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.210245    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="275e7261-e19c-4e1c-90ed-24c1930ca606" containerName="main"
Jul 22 13:33:43.210322 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.210316    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3038ab97-8e86-4945-ace6-00e78aef7680" containerName="main"
Jul 22 13:33:43.210479 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.210327    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="275e7261-e19c-4e1c-90ed-24c1930ca606" containerName="main"
Jul 22 13:33:43.213308 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.213290    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.215298 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.215280    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-609ebe-openshift-default-dockercfg-hhsjw\""
Jul 22 13:33:43.222695 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.222669    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"]
Jul 22 13:33:43.301128 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.301101    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efb3ce44-8f8c-403a-8c9f-0405940fb653-istiod-ca-cert\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.301290 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.301140    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-workload-certs\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.301290 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.301230    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-workload-socket\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.301290 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.301257    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-credential-socket\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.301290 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.301281    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l76fk\" (UniqueName: \"kubernetes.io/projected/efb3ce44-8f8c-403a-8c9f-0405940fb653-kube-api-access-l76fk\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.301517 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.301350    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-podinfo\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.301517 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.301379    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-envoy\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.301517 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.301403    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-data\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.301517 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.301432    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-token\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.402555 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.402526    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l76fk\" (UniqueName: \"kubernetes.io/projected/efb3ce44-8f8c-403a-8c9f-0405940fb653-kube-api-access-l76fk\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.402743 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.402565    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-podinfo\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.402743 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.402587    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-envoy\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.402884 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.402745    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-data\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.402884 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.402804    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-token\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.402996 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.402880    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efb3ce44-8f8c-403a-8c9f-0405940fb653-istiod-ca-cert\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.402996 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.402920    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-workload-certs\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.402996 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.402988    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-workload-socket\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.403142 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.403020    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-credential-socket\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.403142 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.403119    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-data\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.403334 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.403312    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-workload-certs\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.403406 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.403373    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-workload-socket\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.403463 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.403429    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-credential-socket\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.403647 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.403629    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efb3ce44-8f8c-403a-8c9f-0405940fb653-istiod-ca-cert\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.404920 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.404895    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-envoy\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.405039 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.405023    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-podinfo\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.411124 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.411104    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-token\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.411944 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.411919    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l76fk\" (UniqueName: \"kubernetes.io/projected/efb3ce44-8f8c-403a-8c9f-0405940fb653-kube-api-access-l76fk\") pod \"e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") " pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.524152 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.524075    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:43.659317 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.659295    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"]
Jul 22 13:33:43.664666 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:33:43.664595    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefb3ce44_8f8c_403a_8c9f_0405940fb653.slice/crio-839ba76d0903f8a05bbde338193bee788b9fcf973ad97ff5cf55845bb76a17a2 WatchSource:0}: Error finding container 839ba76d0903f8a05bbde338193bee788b9fcf973ad97ff5cf55845bb76a17a2: Status 404 returned error can't find the container with id 839ba76d0903f8a05bbde338193bee788b9fcf973ad97ff5cf55845bb76a17a2
Jul 22 13:33:43.666547 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.666517    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:33:43.666634 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.666588    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:33:43.666634 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:43.666620    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:33:44.125855 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:44.125818    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm" event={"ID":"efb3ce44-8f8c-403a-8c9f-0405940fb653","Type":"ContainerStarted","Data":"6e0b4ce270d590133ce4eaec69a9935e71da7393965cdcf149b7287876ecb050"}
Jul 22 13:33:44.126003 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:44.125873    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm" event={"ID":"efb3ce44-8f8c-403a-8c9f-0405940fb653","Type":"ContainerStarted","Data":"839ba76d0903f8a05bbde338193bee788b9fcf973ad97ff5cf55845bb76a17a2"}
Jul 22 13:33:44.149432 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:44.149390    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm" podStartSLOduration=1.1493744320000001 podStartE2EDuration="1.149374432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:33:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:33:44.148193966 +0000 UTC m=+2371.912845632" watchObservedRunningTime="2026-07-22 13:33:44.149374432 +0000 UTC m=+2371.914026035"
Jul 22 13:33:44.525061 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:44.524986    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:44.530057 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:44.530036    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:45.130568 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:45.130534    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:45.131590 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:45.131571    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:33:53.156813 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:33:53.156779    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:34:00.970068 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:00.969779    2557 patch_prober.go:28] interesting pod/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": read tcp 10.134.0.2:46062->10.134.0.36:15021: read: connection reset by peer" start-of-body=
Jul 22 13:34:00.970068 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:00.969861    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm" podUID="efb3ce44-8f8c-403a-8c9f-0405940fb653" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": read tcp 10.134.0.2:46062->10.134.0.36:15021: read: connection reset by peer"
Jul 22 13:34:01.205741 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:01.205643    2557 generic.go:356] "Generic (PLEG): container finished" podID="efb3ce44-8f8c-403a-8c9f-0405940fb653" containerID="6e0b4ce270d590133ce4eaec69a9935e71da7393965cdcf149b7287876ecb050" exitCode=0
Jul 22 13:34:01.205741 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:01.205695    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm" event={"ID":"efb3ce44-8f8c-403a-8c9f-0405940fb653","Type":"ContainerDied","Data":"6e0b4ce270d590133ce4eaec69a9935e71da7393965cdcf149b7287876ecb050"}
Jul 22 13:34:01.206076 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:01.206063    2557 scope.go:117] "RemoveContainer" containerID="6e0b4ce270d590133ce4eaec69a9935e71da7393965cdcf149b7287876ecb050"
Jul 22 13:34:01.207009 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:01.206984    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:34:01.207066 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:01.207048    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:34:01.207104 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:01.207079    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 22 13:34:02.211516 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:02.211483    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm" event={"ID":"efb3ce44-8f8c-403a-8c9f-0405940fb653","Type":"ContainerStarted","Data":"5c12848b9fdd8b25e900388c4d17a3ff251af3a7cfd10afd07bcbaea2a2c0b2a"}
Jul 22 13:34:02.525029 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:02.524933    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:34:02.525170 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:02.525101    2557 patch_prober.go:28] interesting pod/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 22 13:34:02.525213 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:02.525172    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm" podUID="efb3ce44-8f8c-403a-8c9f-0405940fb653" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 22 13:34:03.525320 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:03.525280    2557 patch_prober.go:28] interesting pod/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 22 13:34:03.525693 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:03.525350    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm" podUID="efb3ce44-8f8c-403a-8c9f-0405940fb653" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 22 13:34:04.524800 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:04.524762    2557 patch_prober.go:28] interesting pod/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 22 13:34:04.525092 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:04.524825    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm" podUID="efb3ce44-8f8c-403a-8c9f-0405940fb653" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 22 13:34:05.525274 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:05.525238    2557 patch_prober.go:28] interesting pod/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 22 13:34:05.525647 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:05.525299    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm" podUID="efb3ce44-8f8c-403a-8c9f-0405940fb653" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 22 13:34:05.842686 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:05.842603    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:34:06.527540 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:06.527510    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:34:06.527967 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:06.527894    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:34:06.528512 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:06.528495    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:34:29.443368 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:29.443333    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:34:34.514963 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:34.514889    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"]
Jul 22 13:34:34.515353 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:34.515079    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm" podUID="efb3ce44-8f8c-403a-8c9f-0405940fb653" containerName="istio-proxy" containerID="cri-o://5c12848b9fdd8b25e900388c4d17a3ff251af3a7cfd10afd07bcbaea2a2c0b2a" gracePeriod=30
Jul 22 13:34:36.529951 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:36.529910    2557 patch_prober.go:28] interesting pod/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 13:34:36.530380 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:36.529973    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm" podUID="efb3ce44-8f8c-403a-8c9f-0405940fb653" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 13:34:39.765605 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.765575    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:34:39.890701 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.890672    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-envoy\") pod \"efb3ce44-8f8c-403a-8c9f-0405940fb653\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") "
Jul 22 13:34:39.890917 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.890734    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-workload-certs\") pod \"efb3ce44-8f8c-403a-8c9f-0405940fb653\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") "
Jul 22 13:34:39.890917 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.890749    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-data\") pod \"efb3ce44-8f8c-403a-8c9f-0405940fb653\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") "
Jul 22 13:34:39.890917 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.890779    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l76fk\" (UniqueName: \"kubernetes.io/projected/efb3ce44-8f8c-403a-8c9f-0405940fb653-kube-api-access-l76fk\") pod \"efb3ce44-8f8c-403a-8c9f-0405940fb653\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") "
Jul 22 13:34:39.890917 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.890810    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efb3ce44-8f8c-403a-8c9f-0405940fb653-istiod-ca-cert\") pod \"efb3ce44-8f8c-403a-8c9f-0405940fb653\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") "
Jul 22 13:34:39.890917 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.890846    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-podinfo\") pod \"efb3ce44-8f8c-403a-8c9f-0405940fb653\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") "
Jul 22 13:34:39.890917 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.890909    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-credential-socket\") pod \"efb3ce44-8f8c-403a-8c9f-0405940fb653\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") "
Jul 22 13:34:39.891237 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.890968    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-workload-socket\") pod \"efb3ce44-8f8c-403a-8c9f-0405940fb653\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") "
Jul 22 13:34:39.891237 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.890991    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-token\") pod \"efb3ce44-8f8c-403a-8c9f-0405940fb653\" (UID: \"efb3ce44-8f8c-403a-8c9f-0405940fb653\") "
Jul 22 13:34:39.891237 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.891067    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "efb3ce44-8f8c-403a-8c9f-0405940fb653" (UID: "efb3ce44-8f8c-403a-8c9f-0405940fb653"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:34:39.891237 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.891188    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "efb3ce44-8f8c-403a-8c9f-0405940fb653" (UID: "efb3ce44-8f8c-403a-8c9f-0405940fb653"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:34:39.891453 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.891286    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "efb3ce44-8f8c-403a-8c9f-0405940fb653" (UID: "efb3ce44-8f8c-403a-8c9f-0405940fb653"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:34:39.891453 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.891347    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-workload-certs\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:34:39.891453 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.891367    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-credential-socket\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:34:39.891639 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.891478    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efb3ce44-8f8c-403a-8c9f-0405940fb653-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "efb3ce44-8f8c-403a-8c9f-0405940fb653" (UID: "efb3ce44-8f8c-403a-8c9f-0405940fb653"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 13:34:39.891639 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.891621    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-data" (OuterVolumeSpecName: "istio-data") pod "efb3ce44-8f8c-403a-8c9f-0405940fb653" (UID: "efb3ce44-8f8c-403a-8c9f-0405940fb653"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:34:39.893038 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.893004    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "efb3ce44-8f8c-403a-8c9f-0405940fb653" (UID: "efb3ce44-8f8c-403a-8c9f-0405940fb653"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:34:39.893139 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.893092    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "efb3ce44-8f8c-403a-8c9f-0405940fb653" (UID: "efb3ce44-8f8c-403a-8c9f-0405940fb653"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 13:34:39.893139 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.893106    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efb3ce44-8f8c-403a-8c9f-0405940fb653-kube-api-access-l76fk" (OuterVolumeSpecName: "kube-api-access-l76fk") pod "efb3ce44-8f8c-403a-8c9f-0405940fb653" (UID: "efb3ce44-8f8c-403a-8c9f-0405940fb653"). InnerVolumeSpecName "kube-api-access-l76fk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:34:39.893238 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.893222    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-token" (OuterVolumeSpecName: "istio-token") pod "efb3ce44-8f8c-403a-8c9f-0405940fb653" (UID: "efb3ce44-8f8c-403a-8c9f-0405940fb653"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:34:39.992607 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.992573    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-workload-socket\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:34:39.992607 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.992600    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-token\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:34:39.992607 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.992609    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-envoy\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:34:39.992607 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.992617    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-data\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:34:39.992915 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.992625    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l76fk\" (UniqueName: \"kubernetes.io/projected/efb3ce44-8f8c-403a-8c9f-0405940fb653-kube-api-access-l76fk\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:34:39.992915 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.992635    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efb3ce44-8f8c-403a-8c9f-0405940fb653-istiod-ca-cert\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:34:39.992915 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:39.992644    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efb3ce44-8f8c-403a-8c9f-0405940fb653-istio-podinfo\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:34:40.383048 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:40.383013    2557 generic.go:356] "Generic (PLEG): container finished" podID="efb3ce44-8f8c-403a-8c9f-0405940fb653" containerID="5c12848b9fdd8b25e900388c4d17a3ff251af3a7cfd10afd07bcbaea2a2c0b2a" exitCode=0
Jul 22 13:34:40.383220 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:40.383069    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"
Jul 22 13:34:40.383220 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:40.383096    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm" event={"ID":"efb3ce44-8f8c-403a-8c9f-0405940fb653","Type":"ContainerDied","Data":"5c12848b9fdd8b25e900388c4d17a3ff251af3a7cfd10afd07bcbaea2a2c0b2a"}
Jul 22 13:34:40.383220 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:40.383149    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm" event={"ID":"efb3ce44-8f8c-403a-8c9f-0405940fb653","Type":"ContainerDied","Data":"839ba76d0903f8a05bbde338193bee788b9fcf973ad97ff5cf55845bb76a17a2"}
Jul 22 13:34:40.383220 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:40.383172    2557 scope.go:117] "RemoveContainer" containerID="5c12848b9fdd8b25e900388c4d17a3ff251af3a7cfd10afd07bcbaea2a2c0b2a"
Jul 22 13:34:40.392048 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:40.392027    2557 scope.go:117] "RemoveContainer" containerID="6e0b4ce270d590133ce4eaec69a9935e71da7393965cdcf149b7287876ecb050"
Jul 22 13:34:40.399722 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:40.399689    2557 scope.go:117] "RemoveContainer" containerID="5c12848b9fdd8b25e900388c4d17a3ff251af3a7cfd10afd07bcbaea2a2c0b2a"
Jul 22 13:34:40.399993 ip-10-0-141-162 kubenswrapper[2557]: E0722 13:34:40.399975    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c12848b9fdd8b25e900388c4d17a3ff251af3a7cfd10afd07bcbaea2a2c0b2a\": container with ID starting with 5c12848b9fdd8b25e900388c4d17a3ff251af3a7cfd10afd07bcbaea2a2c0b2a not found: ID does not exist" containerID="5c12848b9fdd8b25e900388c4d17a3ff251af3a7cfd10afd07bcbaea2a2c0b2a"
Jul 22 13:34:40.400040 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:40.400002    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c12848b9fdd8b25e900388c4d17a3ff251af3a7cfd10afd07bcbaea2a2c0b2a"} err="failed to get container status \"5c12848b9fdd8b25e900388c4d17a3ff251af3a7cfd10afd07bcbaea2a2c0b2a\": rpc error: code = NotFound desc = could not find container \"5c12848b9fdd8b25e900388c4d17a3ff251af3a7cfd10afd07bcbaea2a2c0b2a\": container with ID starting with 5c12848b9fdd8b25e900388c4d17a3ff251af3a7cfd10afd07bcbaea2a2c0b2a not found: ID does not exist"
Jul 22 13:34:40.400040 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:40.400023    2557 scope.go:117] "RemoveContainer" containerID="6e0b4ce270d590133ce4eaec69a9935e71da7393965cdcf149b7287876ecb050"
Jul 22 13:34:40.400269 ip-10-0-141-162 kubenswrapper[2557]: E0722 13:34:40.400252    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e0b4ce270d590133ce4eaec69a9935e71da7393965cdcf149b7287876ecb050\": container with ID starting with 6e0b4ce270d590133ce4eaec69a9935e71da7393965cdcf149b7287876ecb050 not found: ID does not exist" containerID="6e0b4ce270d590133ce4eaec69a9935e71da7393965cdcf149b7287876ecb050"
Jul 22 13:34:40.400326 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:40.400274    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e0b4ce270d590133ce4eaec69a9935e71da7393965cdcf149b7287876ecb050"} err="failed to get container status \"6e0b4ce270d590133ce4eaec69a9935e71da7393965cdcf149b7287876ecb050\": rpc error: code = NotFound desc = could not find container \"6e0b4ce270d590133ce4eaec69a9935e71da7393965cdcf149b7287876ecb050\": container with ID starting with 6e0b4ce270d590133ce4eaec69a9935e71da7393965cdcf149b7287876ecb050 not found: ID does not exist"
Jul 22 13:34:40.404692 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:40.404659    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"]
Jul 22 13:34:40.406947 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:40.406927    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-609ebe-openshift-default-6746fbf4f7-6h4xm"]
Jul 22 13:34:40.809072 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:40.808997    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efb3ce44-8f8c-403a-8c9f-0405940fb653" path="/var/lib/kubelet/pods/efb3ce44-8f8c-403a-8c9f-0405940fb653/volumes"
Jul 22 13:34:55.239028 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:34:55.238992    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:35:10.454657 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:10.454624    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:35:19.680042 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:19.680005    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:35:30.639883 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.639851    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"]
Jul 22 13:35:30.640258 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.640173    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efb3ce44-8f8c-403a-8c9f-0405940fb653" containerName="istio-proxy"
Jul 22 13:35:30.640258 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.640184    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="efb3ce44-8f8c-403a-8c9f-0405940fb653" containerName="istio-proxy"
Jul 22 13:35:30.640258 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.640197    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efb3ce44-8f8c-403a-8c9f-0405940fb653" containerName="istio-proxy"
Jul 22 13:35:30.640258 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.640203    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="efb3ce44-8f8c-403a-8c9f-0405940fb653" containerName="istio-proxy"
Jul 22 13:35:30.640382 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.640263    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="efb3ce44-8f8c-403a-8c9f-0405940fb653" containerName="istio-proxy"
Jul 22 13:35:30.640382 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.640270    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="efb3ce44-8f8c-403a-8c9f-0405940fb653" containerName="istio-proxy"
Jul 22 13:35:30.642592 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.642575    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:30.645385 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.645363    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-15ce38\"/\"default-dockercfg-9hckg\""
Jul 22 13:35:30.645528 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.645405    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-15ce38\"/\"auth-test-model-15ce38-kserve-self-signed-certs\""
Jul 22 13:35:30.645528 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.645416    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-15ce38\"/\"openshift-service-ca.crt\""
Jul 22 13:35:30.645528 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.645406    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-15ce38\"/\"kube-root-ca.crt\""
Jul 22 13:35:30.651529 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.651473    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"]
Jul 22 13:35:30.731112 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.731067    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqmnn\" (UniqueName: \"kubernetes.io/projected/38e0afd6-f6a4-4ef7-ace1-54efd051310e-kube-api-access-pqmnn\") pod \"auth-test-model-15ce38-kserve-8499d79c7f-zplgp\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") " pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:30.731112 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.731121    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38e0afd6-f6a4-4ef7-ace1-54efd051310e-tls-certs\") pod \"auth-test-model-15ce38-kserve-8499d79c7f-zplgp\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") " pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:30.731364 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.731149    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-home\") pod \"auth-test-model-15ce38-kserve-8499d79c7f-zplgp\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") " pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:30.731364 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.731177    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-tmp-dir\") pod \"auth-test-model-15ce38-kserve-8499d79c7f-zplgp\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") " pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:30.731364 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.731193    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-model-cache\") pod \"auth-test-model-15ce38-kserve-8499d79c7f-zplgp\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") " pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:30.731364 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.731321    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-dshm\") pod \"auth-test-model-15ce38-kserve-8499d79c7f-zplgp\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") " pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:30.832113 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.832068    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-dshm\") pod \"auth-test-model-15ce38-kserve-8499d79c7f-zplgp\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") " pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:30.832324 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.832145    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqmnn\" (UniqueName: \"kubernetes.io/projected/38e0afd6-f6a4-4ef7-ace1-54efd051310e-kube-api-access-pqmnn\") pod \"auth-test-model-15ce38-kserve-8499d79c7f-zplgp\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") " pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:30.832324 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.832177    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38e0afd6-f6a4-4ef7-ace1-54efd051310e-tls-certs\") pod \"auth-test-model-15ce38-kserve-8499d79c7f-zplgp\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") " pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:30.832324 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.832205    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-home\") pod \"auth-test-model-15ce38-kserve-8499d79c7f-zplgp\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") " pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:30.832324 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.832235    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-tmp-dir\") pod \"auth-test-model-15ce38-kserve-8499d79c7f-zplgp\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") " pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:30.832324 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.832260    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-model-cache\") pod \"auth-test-model-15ce38-kserve-8499d79c7f-zplgp\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") " pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:30.832594 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.832574    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-home\") pod \"auth-test-model-15ce38-kserve-8499d79c7f-zplgp\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") " pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:30.832658 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.832610    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-tmp-dir\") pod \"auth-test-model-15ce38-kserve-8499d79c7f-zplgp\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") " pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:30.832744 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.832665    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-model-cache\") pod \"auth-test-model-15ce38-kserve-8499d79c7f-zplgp\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") " pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:30.834442 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.834381    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-dshm\") pod \"auth-test-model-15ce38-kserve-8499d79c7f-zplgp\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") " pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:30.834739 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.834689    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38e0afd6-f6a4-4ef7-ace1-54efd051310e-tls-certs\") pod \"auth-test-model-15ce38-kserve-8499d79c7f-zplgp\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") " pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:30.840532 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.840511    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqmnn\" (UniqueName: \"kubernetes.io/projected/38e0afd6-f6a4-4ef7-ace1-54efd051310e-kube-api-access-pqmnn\") pod \"auth-test-model-15ce38-kserve-8499d79c7f-zplgp\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") " pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:30.954292 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:30.954192    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:31.095129 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:31.095100    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"]
Jul 22 13:35:31.097464 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:35:31.097432    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38e0afd6_f6a4_4ef7_ace1_54efd051310e.slice/crio-42d96d68005cc4a2dfb4bfbec95bbf1bb63a696ed6bc3537460227baa5165478 WatchSource:0}: Error finding container 42d96d68005cc4a2dfb4bfbec95bbf1bb63a696ed6bc3537460227baa5165478: Status 404 returned error can't find the container with id 42d96d68005cc4a2dfb4bfbec95bbf1bb63a696ed6bc3537460227baa5165478
Jul 22 13:35:31.611896 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:31.611855    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp" event={"ID":"38e0afd6-f6a4-4ef7-ace1-54efd051310e","Type":"ContainerStarted","Data":"1a3ab719509b7633af2fe265935767a0198b141f0422a895be08ce32afe2ec18"}
Jul 22 13:35:31.611896 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:31.611899    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp" event={"ID":"38e0afd6-f6a4-4ef7-ace1-54efd051310e","Type":"ContainerStarted","Data":"42d96d68005cc4a2dfb4bfbec95bbf1bb63a696ed6bc3537460227baa5165478"}
Jul 22 13:35:31.630358 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:31.630298    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp" podStartSLOduration=1.63028147 podStartE2EDuration="1.63028147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:35:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:35:31.628387012 +0000 UTC m=+2479.393038637" watchObservedRunningTime="2026-07-22 13:35:31.63028147 +0000 UTC m=+2479.394933096"
Jul 22 13:35:33.938754 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:33.938702    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:35:40.954912 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:40.954853    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:40.955333 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:40.954932    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:40.967646 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:40.967615    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:41.668511 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:41.668482    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:35:53.460570 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.460537    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"]
Jul 22 13:35:53.463488 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.463466    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:35:53.466397 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.466378    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-19e216\"/\"openshift-service-ca.crt\""
Jul 22 13:35:53.466549 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.466527    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-19e216\"/\"kube-root-ca.crt\""
Jul 22 13:35:53.466671 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.466587    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-19e216\"/\"default-dockercfg-ckwkg\""
Jul 22 13:35:53.466671 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.466654    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-19e216\"/\"auth-test-model-19e216-kserve-self-signed-certs\""
Jul 22 13:35:53.474383 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.474360    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"]
Jul 22 13:35:53.523646 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.523614    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-dshm\") pod \"auth-test-model-19e216-kserve-749f95f5f-4jxf7\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") " pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:35:53.523646 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.523647    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e1afa7a-7317-4cd3-938b-3a2e08944870-tls-certs\") pod \"auth-test-model-19e216-kserve-749f95f5f-4jxf7\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") " pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:35:53.523873 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.523666    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-home\") pod \"auth-test-model-19e216-kserve-749f95f5f-4jxf7\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") " pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:35:53.523873 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.523682    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-tmp-dir\") pod \"auth-test-model-19e216-kserve-749f95f5f-4jxf7\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") " pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:35:53.523873 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.523844    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq982\" (UniqueName: \"kubernetes.io/projected/1e1afa7a-7317-4cd3-938b-3a2e08944870-kube-api-access-kq982\") pod \"auth-test-model-19e216-kserve-749f95f5f-4jxf7\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") " pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:35:53.524007 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.523904    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-model-cache\") pod \"auth-test-model-19e216-kserve-749f95f5f-4jxf7\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") " pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:35:53.624820 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.624783    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-dshm\") pod \"auth-test-model-19e216-kserve-749f95f5f-4jxf7\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") " pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:35:53.624820 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.624819    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e1afa7a-7317-4cd3-938b-3a2e08944870-tls-certs\") pod \"auth-test-model-19e216-kserve-749f95f5f-4jxf7\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") " pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:35:53.625144 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.624845    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-home\") pod \"auth-test-model-19e216-kserve-749f95f5f-4jxf7\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") " pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:35:53.625144 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.624867    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-tmp-dir\") pod \"auth-test-model-19e216-kserve-749f95f5f-4jxf7\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") " pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:35:53.625144 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.624945    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq982\" (UniqueName: \"kubernetes.io/projected/1e1afa7a-7317-4cd3-938b-3a2e08944870-kube-api-access-kq982\") pod \"auth-test-model-19e216-kserve-749f95f5f-4jxf7\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") " pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:35:53.625144 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.624992    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-model-cache\") pod \"auth-test-model-19e216-kserve-749f95f5f-4jxf7\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") " pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:35:53.625375 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.625237    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-home\") pod \"auth-test-model-19e216-kserve-749f95f5f-4jxf7\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") " pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:35:53.625375 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.625291    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-tmp-dir\") pod \"auth-test-model-19e216-kserve-749f95f5f-4jxf7\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") " pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:35:53.625375 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.625355    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-model-cache\") pod \"auth-test-model-19e216-kserve-749f95f5f-4jxf7\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") " pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:35:53.627166 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.627140    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-dshm\") pod \"auth-test-model-19e216-kserve-749f95f5f-4jxf7\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") " pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:35:53.627302 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.627283    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e1afa7a-7317-4cd3-938b-3a2e08944870-tls-certs\") pod \"auth-test-model-19e216-kserve-749f95f5f-4jxf7\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") " pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:35:53.635021 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.635001    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq982\" (UniqueName: \"kubernetes.io/projected/1e1afa7a-7317-4cd3-938b-3a2e08944870-kube-api-access-kq982\") pod \"auth-test-model-19e216-kserve-749f95f5f-4jxf7\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") " pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:35:53.773451 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.773366    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:35:53.905072 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:53.905047    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"]
Jul 22 13:35:53.907580 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:35:53.907542    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e1afa7a_7317_4cd3_938b_3a2e08944870.slice/crio-ee44332ca3bfd1426de90b88412525f9d3e46f76cbfc1704ff0928b873985503 WatchSource:0}: Error finding container ee44332ca3bfd1426de90b88412525f9d3e46f76cbfc1704ff0928b873985503: Status 404 returned error can't find the container with id ee44332ca3bfd1426de90b88412525f9d3e46f76cbfc1704ff0928b873985503
Jul 22 13:35:54.720067 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:54.720025    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7" event={"ID":"1e1afa7a-7317-4cd3-938b-3a2e08944870","Type":"ContainerStarted","Data":"4569c735a87432c7882111469692e17c7cf54003e449d2d5b030068ad5139bf8"}
Jul 22 13:35:54.720067 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:54.720068    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7" event={"ID":"1e1afa7a-7317-4cd3-938b-3a2e08944870","Type":"ContainerStarted","Data":"ee44332ca3bfd1426de90b88412525f9d3e46f76cbfc1704ff0928b873985503"}
Jul 22 13:35:54.747036 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:54.746989    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7" podStartSLOduration=1.746974469 podStartE2EDuration="1.746974469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:35:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:35:54.745057658 +0000 UTC m=+2502.509709283" watchObservedRunningTime="2026-07-22 13:35:54.746974469 +0000 UTC m=+2502.511626089"
Jul 22 13:35:56.956089 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:35:56.956060    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:36:03.773781 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:36:03.773676    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:36:03.773781 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:36:03.773744    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:36:03.786114 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:36:03.786090    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:36:04.775745 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:36:04.775717    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:36:11.444517 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:36:11.444483    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:36:30.645661 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:36:30.645624    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:36:46.141648 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:36:46.141613    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:37:04.746366 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:37:04.746331    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:37:22.349102 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:37:22.349069    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:37:36.960590 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:37:36.960511    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:37:48.985282 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:37:48.985240    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"]
Jul 22 13:37:49.877886 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:37:49.877854    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"]
Jul 22 13:37:52.857612 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:37:52.857579    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:38:03.048292 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:03.048254    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:38:04.005087 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.005049    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp" podUID="38e0afd6-f6a4-4ef7-ace1-54efd051310e" containerName="main" containerID="cri-o://1a3ab719509b7633af2fe265935767a0198b141f0422a895be08ce32afe2ec18" gracePeriod=45
Jul 22 13:38:04.252243 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.252217    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:38:04.302928 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.302853    2557 generic.go:356] "Generic (PLEG): container finished" podID="38e0afd6-f6a4-4ef7-ace1-54efd051310e" containerID="1a3ab719509b7633af2fe265935767a0198b141f0422a895be08ce32afe2ec18" exitCode=0
Jul 22 13:38:04.302928 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.302892    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"
Jul 22 13:38:04.302928 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.302914    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp" event={"ID":"38e0afd6-f6a4-4ef7-ace1-54efd051310e","Type":"ContainerDied","Data":"1a3ab719509b7633af2fe265935767a0198b141f0422a895be08ce32afe2ec18"}
Jul 22 13:38:04.303200 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.302947    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp" event={"ID":"38e0afd6-f6a4-4ef7-ace1-54efd051310e","Type":"ContainerDied","Data":"42d96d68005cc4a2dfb4bfbec95bbf1bb63a696ed6bc3537460227baa5165478"}
Jul 22 13:38:04.303200 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.302964    2557 scope.go:117] "RemoveContainer" containerID="1a3ab719509b7633af2fe265935767a0198b141f0422a895be08ce32afe2ec18"
Jul 22 13:38:04.310963 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.310948    2557 scope.go:117] "RemoveContainer" containerID="1a3ab719509b7633af2fe265935767a0198b141f0422a895be08ce32afe2ec18"
Jul 22 13:38:04.311201 ip-10-0-141-162 kubenswrapper[2557]: E0722 13:38:04.311186    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a3ab719509b7633af2fe265935767a0198b141f0422a895be08ce32afe2ec18\": container with ID starting with 1a3ab719509b7633af2fe265935767a0198b141f0422a895be08ce32afe2ec18 not found: ID does not exist" containerID="1a3ab719509b7633af2fe265935767a0198b141f0422a895be08ce32afe2ec18"
Jul 22 13:38:04.311247 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.311211    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a3ab719509b7633af2fe265935767a0198b141f0422a895be08ce32afe2ec18"} err="failed to get container status \"1a3ab719509b7633af2fe265935767a0198b141f0422a895be08ce32afe2ec18\": rpc error: code = NotFound desc = could not find container \"1a3ab719509b7633af2fe265935767a0198b141f0422a895be08ce32afe2ec18\": container with ID starting with 1a3ab719509b7633af2fe265935767a0198b141f0422a895be08ce32afe2ec18 not found: ID does not exist"
Jul 22 13:38:04.347513 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.347492    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-home\") pod \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") "
Jul 22 13:38:04.347606 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.347519    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-dshm\") pod \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") "
Jul 22 13:38:04.347606 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.347545    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-tmp-dir\") pod \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") "
Jul 22 13:38:04.347606 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.347589    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqmnn\" (UniqueName: \"kubernetes.io/projected/38e0afd6-f6a4-4ef7-ace1-54efd051310e-kube-api-access-pqmnn\") pod \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") "
Jul 22 13:38:04.347791 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.347632    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-model-cache\") pod \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") "
Jul 22 13:38:04.347791 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.347660    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38e0afd6-f6a4-4ef7-ace1-54efd051310e-tls-certs\") pod \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\" (UID: \"38e0afd6-f6a4-4ef7-ace1-54efd051310e\") "
Jul 22 13:38:04.347889 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.347806    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-home" (OuterVolumeSpecName: "home") pod "38e0afd6-f6a4-4ef7-ace1-54efd051310e" (UID: "38e0afd6-f6a4-4ef7-ace1-54efd051310e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:38:04.347889 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.347853    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "38e0afd6-f6a4-4ef7-ace1-54efd051310e" (UID: "38e0afd6-f6a4-4ef7-ace1-54efd051310e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:38:04.348004 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.347932    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-model-cache" (OuterVolumeSpecName: "model-cache") pod "38e0afd6-f6a4-4ef7-ace1-54efd051310e" (UID: "38e0afd6-f6a4-4ef7-ace1-54efd051310e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:38:04.348004 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.347953    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-home\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:38:04.348004 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.347975    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-tmp-dir\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:38:04.349730 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.349677    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-dshm" (OuterVolumeSpecName: "dshm") pod "38e0afd6-f6a4-4ef7-ace1-54efd051310e" (UID: "38e0afd6-f6a4-4ef7-ace1-54efd051310e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:38:04.349826 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.349738    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38e0afd6-f6a4-4ef7-ace1-54efd051310e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "38e0afd6-f6a4-4ef7-ace1-54efd051310e" (UID: "38e0afd6-f6a4-4ef7-ace1-54efd051310e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:38:04.349826 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.349800    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38e0afd6-f6a4-4ef7-ace1-54efd051310e-kube-api-access-pqmnn" (OuterVolumeSpecName: "kube-api-access-pqmnn") pod "38e0afd6-f6a4-4ef7-ace1-54efd051310e" (UID: "38e0afd6-f6a4-4ef7-ace1-54efd051310e"). InnerVolumeSpecName "kube-api-access-pqmnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:38:04.449319 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.449290    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqmnn\" (UniqueName: \"kubernetes.io/projected/38e0afd6-f6a4-4ef7-ace1-54efd051310e-kube-api-access-pqmnn\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:38:04.449319 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.449314    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-model-cache\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:38:04.449319 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.449324    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38e0afd6-f6a4-4ef7-ace1-54efd051310e-tls-certs\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:38:04.449523 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.449332    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38e0afd6-f6a4-4ef7-ace1-54efd051310e-dshm\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:38:04.624956 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.624930    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"]
Jul 22 13:38:04.637897 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.637870    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-15ce38/auth-test-model-15ce38-kserve-8499d79c7f-zplgp"]
Jul 22 13:38:04.808266 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.808235    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38e0afd6-f6a4-4ef7-ace1-54efd051310e" path="/var/lib/kubelet/pods/38e0afd6-f6a4-4ef7-ace1-54efd051310e/volumes"
Jul 22 13:38:04.897791 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:04.897761    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7" podUID="1e1afa7a-7317-4cd3-938b-3a2e08944870" containerName="main" containerID="cri-o://4569c735a87432c7882111469692e17c7cf54003e449d2d5b030068ad5139bf8" gracePeriod=45
Jul 22 13:38:05.153380 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.153327    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:38:05.256024 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.255997    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-tmp-dir\") pod \"1e1afa7a-7317-4cd3-938b-3a2e08944870\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") "
Jul 22 13:38:05.256458 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.256033    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-model-cache\") pod \"1e1afa7a-7317-4cd3-938b-3a2e08944870\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") "
Jul 22 13:38:05.256458 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.256056    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-home\") pod \"1e1afa7a-7317-4cd3-938b-3a2e08944870\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") "
Jul 22 13:38:05.256458 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.256110    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e1afa7a-7317-4cd3-938b-3a2e08944870-tls-certs\") pod \"1e1afa7a-7317-4cd3-938b-3a2e08944870\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") "
Jul 22 13:38:05.256458 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.256129    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kq982\" (UniqueName: \"kubernetes.io/projected/1e1afa7a-7317-4cd3-938b-3a2e08944870-kube-api-access-kq982\") pod \"1e1afa7a-7317-4cd3-938b-3a2e08944870\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") "
Jul 22 13:38:05.256458 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.256154    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-dshm\") pod \"1e1afa7a-7317-4cd3-938b-3a2e08944870\" (UID: \"1e1afa7a-7317-4cd3-938b-3a2e08944870\") "
Jul 22 13:38:05.256458 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.256280    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1e1afa7a-7317-4cd3-938b-3a2e08944870" (UID: "1e1afa7a-7317-4cd3-938b-3a2e08944870"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:38:05.256458 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.256295    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-model-cache" (OuterVolumeSpecName: "model-cache") pod "1e1afa7a-7317-4cd3-938b-3a2e08944870" (UID: "1e1afa7a-7317-4cd3-938b-3a2e08944870"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:38:05.256458 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.256359    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-home" (OuterVolumeSpecName: "home") pod "1e1afa7a-7317-4cd3-938b-3a2e08944870" (UID: "1e1afa7a-7317-4cd3-938b-3a2e08944870"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:38:05.256458 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.256434    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-tmp-dir\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:38:05.256458 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.256448    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-model-cache\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:38:05.256458 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.256456    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-home\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:38:05.258448 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.258427    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e1afa7a-7317-4cd3-938b-3a2e08944870-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1e1afa7a-7317-4cd3-938b-3a2e08944870" (UID: "1e1afa7a-7317-4cd3-938b-3a2e08944870"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:38:05.258448 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.258440    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-dshm" (OuterVolumeSpecName: "dshm") pod "1e1afa7a-7317-4cd3-938b-3a2e08944870" (UID: "1e1afa7a-7317-4cd3-938b-3a2e08944870"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:38:05.258557 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.258476    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e1afa7a-7317-4cd3-938b-3a2e08944870-kube-api-access-kq982" (OuterVolumeSpecName: "kube-api-access-kq982") pod "1e1afa7a-7317-4cd3-938b-3a2e08944870" (UID: "1e1afa7a-7317-4cd3-938b-3a2e08944870"). InnerVolumeSpecName "kube-api-access-kq982". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:38:05.309052 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.309022    2557 generic.go:356] "Generic (PLEG): container finished" podID="1e1afa7a-7317-4cd3-938b-3a2e08944870" containerID="4569c735a87432c7882111469692e17c7cf54003e449d2d5b030068ad5139bf8" exitCode=0
Jul 22 13:38:05.309164 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.309059    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7" event={"ID":"1e1afa7a-7317-4cd3-938b-3a2e08944870","Type":"ContainerDied","Data":"4569c735a87432c7882111469692e17c7cf54003e449d2d5b030068ad5139bf8"}
Jul 22 13:38:05.309164 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.309065    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"
Jul 22 13:38:05.309164 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.309091    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7" event={"ID":"1e1afa7a-7317-4cd3-938b-3a2e08944870","Type":"ContainerDied","Data":"ee44332ca3bfd1426de90b88412525f9d3e46f76cbfc1704ff0928b873985503"}
Jul 22 13:38:05.309164 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.309112    2557 scope.go:117] "RemoveContainer" containerID="4569c735a87432c7882111469692e17c7cf54003e449d2d5b030068ad5139bf8"
Jul 22 13:38:05.317154 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.317139    2557 scope.go:117] "RemoveContainer" containerID="4569c735a87432c7882111469692e17c7cf54003e449d2d5b030068ad5139bf8"
Jul 22 13:38:05.317402 ip-10-0-141-162 kubenswrapper[2557]: E0722 13:38:05.317387    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4569c735a87432c7882111469692e17c7cf54003e449d2d5b030068ad5139bf8\": container with ID starting with 4569c735a87432c7882111469692e17c7cf54003e449d2d5b030068ad5139bf8 not found: ID does not exist" containerID="4569c735a87432c7882111469692e17c7cf54003e449d2d5b030068ad5139bf8"
Jul 22 13:38:05.317444 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.317409    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4569c735a87432c7882111469692e17c7cf54003e449d2d5b030068ad5139bf8"} err="failed to get container status \"4569c735a87432c7882111469692e17c7cf54003e449d2d5b030068ad5139bf8\": rpc error: code = NotFound desc = could not find container \"4569c735a87432c7882111469692e17c7cf54003e449d2d5b030068ad5139bf8\": container with ID starting with 4569c735a87432c7882111469692e17c7cf54003e449d2d5b030068ad5139bf8 not found: ID does not exist"
Jul 22 13:38:05.332118 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.332091    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"]
Jul 22 13:38:05.337612 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.337593    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-19e216/auth-test-model-19e216-kserve-749f95f5f-4jxf7"]
Jul 22 13:38:05.357274 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.357243    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e1afa7a-7317-4cd3-938b-3a2e08944870-tls-certs\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:38:05.357274 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.357274    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq982\" (UniqueName: \"kubernetes.io/projected/1e1afa7a-7317-4cd3-938b-3a2e08944870-kube-api-access-kq982\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:38:05.357386 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:05.357285    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e1afa7a-7317-4cd3-938b-3a2e08944870-dshm\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:38:06.808167 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:06.808136    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e1afa7a-7317-4cd3-938b-3a2e08944870" path="/var/lib/kubelet/pods/1e1afa7a-7317-4cd3-938b-3a2e08944870/volumes"
Jul 22 13:38:48.649995 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.649965    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"]
Jul 22 13:38:48.650578 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.650466    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38e0afd6-f6a4-4ef7-ace1-54efd051310e" containerName="main"
Jul 22 13:38:48.650578 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.650485    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="38e0afd6-f6a4-4ef7-ace1-54efd051310e" containerName="main"
Jul 22 13:38:48.650578 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.650498    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e1afa7a-7317-4cd3-938b-3a2e08944870" containerName="main"
Jul 22 13:38:48.650578 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.650507    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e1afa7a-7317-4cd3-938b-3a2e08944870" containerName="main"
Jul 22 13:38:48.650845 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.650584    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="38e0afd6-f6a4-4ef7-ace1-54efd051310e" containerName="main"
Jul 22 13:38:48.650845 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.650594    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e1afa7a-7317-4cd3-938b-3a2e08944870" containerName="main"
Jul 22 13:38:48.653581 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.653561    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:48.656440 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.656417    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-19e216\"/\"openshift-service-ca.crt\""
Jul 22 13:38:48.656440 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.656434    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-19e216\"/\"sub-test-model-19e216-kserve-self-signed-certs\""
Jul 22 13:38:48.656629 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.656482    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-19e216\"/\"default-dockercfg-ckwkg\""
Jul 22 13:38:48.656629 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.656533    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-19e216\"/\"kube-root-ca.crt\""
Jul 22 13:38:48.662057 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.662029    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"]
Jul 22 13:38:48.697705 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.697679    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-home\") pod \"sub-test-model-19e216-kserve-84df687795-p8bgt\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") " pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:48.697843 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.697730    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-model-cache\") pod \"sub-test-model-19e216-kserve-84df687795-p8bgt\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") " pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:48.697843 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.697749    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-dshm\") pod \"sub-test-model-19e216-kserve-84df687795-p8bgt\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") " pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:48.697843 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.697764    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86588f91-3ea5-4822-8abf-37e9c138a662-tls-certs\") pod \"sub-test-model-19e216-kserve-84df687795-p8bgt\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") " pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:48.697843 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.697804    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9lr4\" (UniqueName: \"kubernetes.io/projected/86588f91-3ea5-4822-8abf-37e9c138a662-kube-api-access-s9lr4\") pod \"sub-test-model-19e216-kserve-84df687795-p8bgt\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") " pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:48.697980 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.697852    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-tmp-dir\") pod \"sub-test-model-19e216-kserve-84df687795-p8bgt\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") " pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:48.798973 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.798945    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-home\") pod \"sub-test-model-19e216-kserve-84df687795-p8bgt\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") " pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:48.799097 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.798981    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-model-cache\") pod \"sub-test-model-19e216-kserve-84df687795-p8bgt\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") " pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:48.799097 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.799002    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-dshm\") pod \"sub-test-model-19e216-kserve-84df687795-p8bgt\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") " pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:48.799189 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.799115    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86588f91-3ea5-4822-8abf-37e9c138a662-tls-certs\") pod \"sub-test-model-19e216-kserve-84df687795-p8bgt\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") " pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:48.799189 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.799143    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9lr4\" (UniqueName: \"kubernetes.io/projected/86588f91-3ea5-4822-8abf-37e9c138a662-kube-api-access-s9lr4\") pod \"sub-test-model-19e216-kserve-84df687795-p8bgt\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") " pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:48.799189 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.799167    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-tmp-dir\") pod \"sub-test-model-19e216-kserve-84df687795-p8bgt\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") " pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:48.799439 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.799412    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-model-cache\") pod \"sub-test-model-19e216-kserve-84df687795-p8bgt\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") " pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:48.799439 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.799429    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-home\") pod \"sub-test-model-19e216-kserve-84df687795-p8bgt\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") " pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:48.799623 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.799594    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-tmp-dir\") pod \"sub-test-model-19e216-kserve-84df687795-p8bgt\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") " pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:48.801017 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.800991    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-dshm\") pod \"sub-test-model-19e216-kserve-84df687795-p8bgt\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") " pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:48.801387 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.801370    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86588f91-3ea5-4822-8abf-37e9c138a662-tls-certs\") pod \"sub-test-model-19e216-kserve-84df687795-p8bgt\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") " pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:48.809194 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.809166    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9lr4\" (UniqueName: \"kubernetes.io/projected/86588f91-3ea5-4822-8abf-37e9c138a662-kube-api-access-s9lr4\") pod \"sub-test-model-19e216-kserve-84df687795-p8bgt\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") " pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:48.963925 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:48.963849    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:49.098763 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:49.098740    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"]
Jul 22 13:38:49.101168 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:38:49.101144    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86588f91_3ea5_4822_8abf_37e9c138a662.slice/crio-707ad5d682fe2fa1f519721a8f075ad8619b9858ca8fd8be37475968cc2253e1 WatchSource:0}: Error finding container 707ad5d682fe2fa1f519721a8f075ad8619b9858ca8fd8be37475968cc2253e1: Status 404 returned error can't find the container with id 707ad5d682fe2fa1f519721a8f075ad8619b9858ca8fd8be37475968cc2253e1
Jul 22 13:38:49.509597 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:49.509561    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt" event={"ID":"86588f91-3ea5-4822-8abf-37e9c138a662","Type":"ContainerStarted","Data":"b814a188946668d1f56051b2fc74c5a7d933e4875ad40c43ee03e18045584b15"}
Jul 22 13:38:49.509800 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:49.509604    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt" event={"ID":"86588f91-3ea5-4822-8abf-37e9c138a662","Type":"ContainerStarted","Data":"707ad5d682fe2fa1f519721a8f075ad8619b9858ca8fd8be37475968cc2253e1"}
Jul 22 13:38:49.534335 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:49.534282    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt" podStartSLOduration=1.534266867 podStartE2EDuration="1.534266867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:38:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:38:49.533102791 +0000 UTC m=+2677.297754426" watchObservedRunningTime="2026-07-22 13:38:49.534266867 +0000 UTC m=+2677.298918491"
Jul 22 13:38:52.549113 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:52.549081    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:38:58.964499 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:58.964468    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:58.964926 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:58.964539    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:58.976854 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:58.976832    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:38:59.567094 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:38:59.567063    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:39:07.127418 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:07.127342    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:39:27.158538 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:27.158494    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:39:33.978891 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:33.978853    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"]
Jul 22 13:39:42.357066 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.357034    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"]
Jul 22 13:39:42.360458 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.360439    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:42.362688 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.362667    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-15ce38\"/\"openshift-service-ca.crt\""
Jul 22 13:39:42.363376 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.363360    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-15ce38\"/\"kube-root-ca.crt\""
Jul 22 13:39:42.363480 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.363374    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-15ce38\"/\"default-dockercfg-9hckg\""
Jul 22 13:39:42.363480 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.363374    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-15ce38\"/\"rate-test-model-15ce38-kserve-self-signed-certs\""
Jul 22 13:39:42.370159 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.370139    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"]
Jul 22 13:39:42.446863 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.446833    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-model-cache\") pod \"rate-test-model-15ce38-kserve-7cdd9457f-76qqg\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") " pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:42.447031 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.446885    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62c55e6c-60ca-4c63-9b16-e2aa26432077-tls-certs\") pod \"rate-test-model-15ce38-kserve-7cdd9457f-76qqg\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") " pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:42.447031 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.446988    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-dshm\") pod \"rate-test-model-15ce38-kserve-7cdd9457f-76qqg\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") " pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:42.447031 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.447015    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-tmp-dir\") pod \"rate-test-model-15ce38-kserve-7cdd9457f-76qqg\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") " pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:42.447161 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.447063    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l689b\" (UniqueName: \"kubernetes.io/projected/62c55e6c-60ca-4c63-9b16-e2aa26432077-kube-api-access-l689b\") pod \"rate-test-model-15ce38-kserve-7cdd9457f-76qqg\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") " pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:42.447161 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.447092    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-home\") pod \"rate-test-model-15ce38-kserve-7cdd9457f-76qqg\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") " pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:42.547655 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.547625    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l689b\" (UniqueName: \"kubernetes.io/projected/62c55e6c-60ca-4c63-9b16-e2aa26432077-kube-api-access-l689b\") pod \"rate-test-model-15ce38-kserve-7cdd9457f-76qqg\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") " pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:42.547851 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.547666    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-home\") pod \"rate-test-model-15ce38-kserve-7cdd9457f-76qqg\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") " pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:42.547851 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.547688    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-model-cache\") pod \"rate-test-model-15ce38-kserve-7cdd9457f-76qqg\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") " pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:42.547851 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.547732    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62c55e6c-60ca-4c63-9b16-e2aa26432077-tls-certs\") pod \"rate-test-model-15ce38-kserve-7cdd9457f-76qqg\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") " pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:42.547851 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.547778    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-dshm\") pod \"rate-test-model-15ce38-kserve-7cdd9457f-76qqg\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") " pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:42.548087 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.547888    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-tmp-dir\") pod \"rate-test-model-15ce38-kserve-7cdd9457f-76qqg\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") " pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:42.548146 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.548125    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-home\") pod \"rate-test-model-15ce38-kserve-7cdd9457f-76qqg\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") " pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:42.548190 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.548158    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-model-cache\") pod \"rate-test-model-15ce38-kserve-7cdd9457f-76qqg\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") " pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:42.548286 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.548260    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-tmp-dir\") pod \"rate-test-model-15ce38-kserve-7cdd9457f-76qqg\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") " pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:42.549899 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.549878    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-dshm\") pod \"rate-test-model-15ce38-kserve-7cdd9457f-76qqg\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") " pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:42.550129 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.550110    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62c55e6c-60ca-4c63-9b16-e2aa26432077-tls-certs\") pod \"rate-test-model-15ce38-kserve-7cdd9457f-76qqg\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") " pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:42.558463 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.558428    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l689b\" (UniqueName: \"kubernetes.io/projected/62c55e6c-60ca-4c63-9b16-e2aa26432077-kube-api-access-l689b\") pod \"rate-test-model-15ce38-kserve-7cdd9457f-76qqg\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") " pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:42.670502 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.670461    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:42.802299 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:42.802266    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"]
Jul 22 13:39:42.805367 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:39:42.805340    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62c55e6c_60ca_4c63_9b16_e2aa26432077.slice/crio-239ac7ad4f1863bba2008f1976b39c5507411b357fb64d3ea56a935c695488c6 WatchSource:0}: Error finding container 239ac7ad4f1863bba2008f1976b39c5507411b357fb64d3ea56a935c695488c6: Status 404 returned error can't find the container with id 239ac7ad4f1863bba2008f1976b39c5507411b357fb64d3ea56a935c695488c6
Jul 22 13:39:43.756364 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:43.756329    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg" event={"ID":"62c55e6c-60ca-4c63-9b16-e2aa26432077","Type":"ContainerStarted","Data":"bf26079b287fbb474ce7898370419b174b7ce06bb7367a694d37808fd20ee3e8"}
Jul 22 13:39:43.756364 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:43.756370    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg" event={"ID":"62c55e6c-60ca-4c63-9b16-e2aa26432077","Type":"ContainerStarted","Data":"239ac7ad4f1863bba2008f1976b39c5507411b357fb64d3ea56a935c695488c6"}
Jul 22 13:39:43.780314 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:43.780264    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg" podStartSLOduration=1.78024695 podStartE2EDuration="1.78024695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:39:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:39:43.778851124 +0000 UTC m=+2731.543502752" watchObservedRunningTime="2026-07-22 13:39:43.78024695 +0000 UTC m=+2731.544898632"
Jul 22 13:39:45.248184 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:45.248153    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:39:48.998459 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:48.998413    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt" podUID="86588f91-3ea5-4822-8abf-37e9c138a662" containerName="main" containerID="cri-o://b814a188946668d1f56051b2fc74c5a7d933e4875ad40c43ee03e18045584b15" gracePeriod=45
Jul 22 13:39:49.247850 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.247826    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:39:49.307509 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.304966    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86588f91-3ea5-4822-8abf-37e9c138a662-tls-certs\") pod \"86588f91-3ea5-4822-8abf-37e9c138a662\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") "
Jul 22 13:39:49.307509 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.305449    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-home\") pod \"86588f91-3ea5-4822-8abf-37e9c138a662\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") "
Jul 22 13:39:49.307509 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.305601    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-dshm\") pod \"86588f91-3ea5-4822-8abf-37e9c138a662\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") "
Jul 22 13:39:49.307509 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.305684    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-home" (OuterVolumeSpecName: "home") pod "86588f91-3ea5-4822-8abf-37e9c138a662" (UID: "86588f91-3ea5-4822-8abf-37e9c138a662"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:39:49.307509 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.305696    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-model-cache\") pod \"86588f91-3ea5-4822-8abf-37e9c138a662\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") "
Jul 22 13:39:49.307509 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.305757    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9lr4\" (UniqueName: \"kubernetes.io/projected/86588f91-3ea5-4822-8abf-37e9c138a662-kube-api-access-s9lr4\") pod \"86588f91-3ea5-4822-8abf-37e9c138a662\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") "
Jul 22 13:39:49.307509 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.305827    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-tmp-dir\") pod \"86588f91-3ea5-4822-8abf-37e9c138a662\" (UID: \"86588f91-3ea5-4822-8abf-37e9c138a662\") "
Jul 22 13:39:49.307509 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.306276    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-home\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:39:49.307509 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.306508    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "86588f91-3ea5-4822-8abf-37e9c138a662" (UID: "86588f91-3ea5-4822-8abf-37e9c138a662"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:39:49.307509 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.306680    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-model-cache" (OuterVolumeSpecName: "model-cache") pod "86588f91-3ea5-4822-8abf-37e9c138a662" (UID: "86588f91-3ea5-4822-8abf-37e9c138a662"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:39:49.309756 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.308439    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-dshm" (OuterVolumeSpecName: "dshm") pod "86588f91-3ea5-4822-8abf-37e9c138a662" (UID: "86588f91-3ea5-4822-8abf-37e9c138a662"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:39:49.309756 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.308515    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86588f91-3ea5-4822-8abf-37e9c138a662-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "86588f91-3ea5-4822-8abf-37e9c138a662" (UID: "86588f91-3ea5-4822-8abf-37e9c138a662"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:39:49.313043 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.313015    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86588f91-3ea5-4822-8abf-37e9c138a662-kube-api-access-s9lr4" (OuterVolumeSpecName: "kube-api-access-s9lr4") pod "86588f91-3ea5-4822-8abf-37e9c138a662" (UID: "86588f91-3ea5-4822-8abf-37e9c138a662"). InnerVolumeSpecName "kube-api-access-s9lr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:39:49.407591 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.407568    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-tmp-dir\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:39:49.407591 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.407590    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86588f91-3ea5-4822-8abf-37e9c138a662-tls-certs\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:39:49.407751 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.407598    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-dshm\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:39:49.407751 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.407607    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86588f91-3ea5-4822-8abf-37e9c138a662-model-cache\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:39:49.407751 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.407615    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9lr4\" (UniqueName: \"kubernetes.io/projected/86588f91-3ea5-4822-8abf-37e9c138a662-kube-api-access-s9lr4\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:39:49.785188 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.785158    2557 generic.go:356] "Generic (PLEG): container finished" podID="86588f91-3ea5-4822-8abf-37e9c138a662" containerID="b814a188946668d1f56051b2fc74c5a7d933e4875ad40c43ee03e18045584b15" exitCode=0
Jul 22 13:39:49.785344 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.785212    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"
Jul 22 13:39:49.785344 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.785239    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt" event={"ID":"86588f91-3ea5-4822-8abf-37e9c138a662","Type":"ContainerDied","Data":"b814a188946668d1f56051b2fc74c5a7d933e4875ad40c43ee03e18045584b15"}
Jul 22 13:39:49.785344 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.785284    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt" event={"ID":"86588f91-3ea5-4822-8abf-37e9c138a662","Type":"ContainerDied","Data":"707ad5d682fe2fa1f519721a8f075ad8619b9858ca8fd8be37475968cc2253e1"}
Jul 22 13:39:49.785344 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.785305    2557 scope.go:117] "RemoveContainer" containerID="b814a188946668d1f56051b2fc74c5a7d933e4875ad40c43ee03e18045584b15"
Jul 22 13:39:49.793895 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.793879    2557 scope.go:117] "RemoveContainer" containerID="b814a188946668d1f56051b2fc74c5a7d933e4875ad40c43ee03e18045584b15"
Jul 22 13:39:49.794139 ip-10-0-141-162 kubenswrapper[2557]: E0722 13:39:49.794123    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b814a188946668d1f56051b2fc74c5a7d933e4875ad40c43ee03e18045584b15\": container with ID starting with b814a188946668d1f56051b2fc74c5a7d933e4875ad40c43ee03e18045584b15 not found: ID does not exist" containerID="b814a188946668d1f56051b2fc74c5a7d933e4875ad40c43ee03e18045584b15"
Jul 22 13:39:49.794178 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.794146    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b814a188946668d1f56051b2fc74c5a7d933e4875ad40c43ee03e18045584b15"} err="failed to get container status \"b814a188946668d1f56051b2fc74c5a7d933e4875ad40c43ee03e18045584b15\": rpc error: code = NotFound desc = could not find container \"b814a188946668d1f56051b2fc74c5a7d933e4875ad40c43ee03e18045584b15\": container with ID starting with b814a188946668d1f56051b2fc74c5a7d933e4875ad40c43ee03e18045584b15 not found: ID does not exist"
Jul 22 13:39:49.806048 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.806027    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"]
Jul 22 13:39:49.810265 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:49.810247    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-19e216/sub-test-model-19e216-kserve-84df687795-p8bgt"]
Jul 22 13:39:50.808695 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:50.808664    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86588f91-3ea5-4822-8abf-37e9c138a662" path="/var/lib/kubelet/pods/86588f91-3ea5-4822-8abf-37e9c138a662/volumes"
Jul 22 13:39:52.671334 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:52.671294    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:52.671760 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:52.671350    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:52.683879 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:52.683858    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:39:52.810966 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:39:52.810937    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:40:08.858134 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:08.858100    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"]
Jul 22 13:40:08.858631 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:08.858394    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86588f91-3ea5-4822-8abf-37e9c138a662" containerName="main"
Jul 22 13:40:08.858631 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:08.858404    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="86588f91-3ea5-4822-8abf-37e9c138a662" containerName="main"
Jul 22 13:40:08.858631 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:08.858474    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="86588f91-3ea5-4822-8abf-37e9c138a662" containerName="main"
Jul 22 13:40:08.862473 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:08.862454    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:08.864612 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:08.864584    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-19e216\"/\"rate-test-model-19e216-kserve-self-signed-certs\""
Jul 22 13:40:08.865205 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:08.865187    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-19e216\"/\"default-dockercfg-ckwkg\""
Jul 22 13:40:08.865327 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:08.865189    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-19e216\"/\"openshift-service-ca.crt\""
Jul 22 13:40:08.865327 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:08.865239    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-19e216\"/\"kube-root-ca.crt\""
Jul 22 13:40:08.870954 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:08.870935    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"]
Jul 22 13:40:08.962840 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:08.962812    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-model-cache\") pod \"rate-test-model-19e216-kserve-d7655fdf9-vtnmn\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") " pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:08.963015 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:08.962859    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-home\") pod \"rate-test-model-19e216-kserve-d7655fdf9-vtnmn\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") " pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:08.963015 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:08.962880    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-tmp-dir\") pod \"rate-test-model-19e216-kserve-d7655fdf9-vtnmn\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") " pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:08.963015 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:08.962901    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-dshm\") pod \"rate-test-model-19e216-kserve-d7655fdf9-vtnmn\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") " pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:08.963015 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:08.962927    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-tls-certs\") pod \"rate-test-model-19e216-kserve-d7655fdf9-vtnmn\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") " pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:08.963015 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:08.962962    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-599t2\" (UniqueName: \"kubernetes.io/projected/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-kube-api-access-599t2\") pod \"rate-test-model-19e216-kserve-d7655fdf9-vtnmn\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") " pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:09.064005 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:09.063975    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-tls-certs\") pod \"rate-test-model-19e216-kserve-d7655fdf9-vtnmn\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") " pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:09.064196 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:09.064026    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-599t2\" (UniqueName: \"kubernetes.io/projected/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-kube-api-access-599t2\") pod \"rate-test-model-19e216-kserve-d7655fdf9-vtnmn\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") " pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:09.064196 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:09.064069    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-model-cache\") pod \"rate-test-model-19e216-kserve-d7655fdf9-vtnmn\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") " pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:09.064196 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:09.064100    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-home\") pod \"rate-test-model-19e216-kserve-d7655fdf9-vtnmn\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") " pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:09.064196 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:09.064116    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-tmp-dir\") pod \"rate-test-model-19e216-kserve-d7655fdf9-vtnmn\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") " pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:09.064196 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:09.064134    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-dshm\") pod \"rate-test-model-19e216-kserve-d7655fdf9-vtnmn\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") " pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:09.064569 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:09.064543    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-model-cache\") pod \"rate-test-model-19e216-kserve-d7655fdf9-vtnmn\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") " pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:09.064650 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:09.064569    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-home\") pod \"rate-test-model-19e216-kserve-d7655fdf9-vtnmn\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") " pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:09.064689 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:09.064657    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-tmp-dir\") pod \"rate-test-model-19e216-kserve-d7655fdf9-vtnmn\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") " pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:09.066371 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:09.066355    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-dshm\") pod \"rate-test-model-19e216-kserve-d7655fdf9-vtnmn\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") " pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:09.066429 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:09.066376    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-tls-certs\") pod \"rate-test-model-19e216-kserve-d7655fdf9-vtnmn\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") " pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:09.073814 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:09.073784    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-599t2\" (UniqueName: \"kubernetes.io/projected/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-kube-api-access-599t2\") pod \"rate-test-model-19e216-kserve-d7655fdf9-vtnmn\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") " pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:09.172488 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:09.172458    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:09.298392 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:09.298369    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"]
Jul 22 13:40:09.872686 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:09.872650    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn" event={"ID":"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb","Type":"ContainerStarted","Data":"60c1e9ba1a9bcaf7ce7e5acc41c4364bd8c6e290d9c3ba9f85e471bb91a36ac2"}
Jul 22 13:40:09.873180 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:09.872693    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn" event={"ID":"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb","Type":"ContainerStarted","Data":"c2b306b63f187c1ac7a0452c1e6917346a1ae6cbedf67b798535f7923aebe8cf"}
Jul 22 13:40:09.889413 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:09.889365    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn" podStartSLOduration=1.8893486830000001 podStartE2EDuration="1.889348683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:40:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:40:09.888860588 +0000 UTC m=+2757.653512215" watchObservedRunningTime="2026-07-22 13:40:09.889348683 +0000 UTC m=+2757.654000308"
Jul 22 13:40:12.589426 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:12.589392    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:40:19.173147 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:19.173114    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:19.173571 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:19.173387    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:19.185984 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:19.185961    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:19.927569 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:19.927542    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:40:27.147452 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:27.147418    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:40:41.848644 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:41.848553    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:40:48.724798 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:48.724765    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"]
Jul 22 13:40:49.669769 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:49.669738    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"]
Jul 22 13:40:56.750746 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:40:56.750693    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:41:03.745003 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:03.744942    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg" podUID="62c55e6c-60ca-4c63-9b16-e2aa26432077" containerName="main" containerID="cri-o://bf26079b287fbb474ce7898370419b174b7ce06bb7367a694d37808fd20ee3e8" gracePeriod=45
Jul 22 13:41:03.995456 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:03.995396    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:41:04.119680 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.119642    2557 generic.go:356] "Generic (PLEG): container finished" podID="62c55e6c-60ca-4c63-9b16-e2aa26432077" containerID="bf26079b287fbb474ce7898370419b174b7ce06bb7367a694d37808fd20ee3e8" exitCode=0
Jul 22 13:41:04.119869 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.119690    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"
Jul 22 13:41:04.119869 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.119737    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg" event={"ID":"62c55e6c-60ca-4c63-9b16-e2aa26432077","Type":"ContainerDied","Data":"bf26079b287fbb474ce7898370419b174b7ce06bb7367a694d37808fd20ee3e8"}
Jul 22 13:41:04.119869 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.119781    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg" event={"ID":"62c55e6c-60ca-4c63-9b16-e2aa26432077","Type":"ContainerDied","Data":"239ac7ad4f1863bba2008f1976b39c5507411b357fb64d3ea56a935c695488c6"}
Jul 22 13:41:04.119869 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.119798    2557 scope.go:117] "RemoveContainer" containerID="bf26079b287fbb474ce7898370419b174b7ce06bb7367a694d37808fd20ee3e8"
Jul 22 13:41:04.127900 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.127872    2557 scope.go:117] "RemoveContainer" containerID="bf26079b287fbb474ce7898370419b174b7ce06bb7367a694d37808fd20ee3e8"
Jul 22 13:41:04.128170 ip-10-0-141-162 kubenswrapper[2557]: E0722 13:41:04.128148    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf26079b287fbb474ce7898370419b174b7ce06bb7367a694d37808fd20ee3e8\": container with ID starting with bf26079b287fbb474ce7898370419b174b7ce06bb7367a694d37808fd20ee3e8 not found: ID does not exist" containerID="bf26079b287fbb474ce7898370419b174b7ce06bb7367a694d37808fd20ee3e8"
Jul 22 13:41:04.128218 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.128181    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf26079b287fbb474ce7898370419b174b7ce06bb7367a694d37808fd20ee3e8"} err="failed to get container status \"bf26079b287fbb474ce7898370419b174b7ce06bb7367a694d37808fd20ee3e8\": rpc error: code = NotFound desc = could not find container \"bf26079b287fbb474ce7898370419b174b7ce06bb7367a694d37808fd20ee3e8\": container with ID starting with bf26079b287fbb474ce7898370419b174b7ce06bb7367a694d37808fd20ee3e8 not found: ID does not exist"
Jul 22 13:41:04.148494 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.148470    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-tmp-dir\") pod \"62c55e6c-60ca-4c63-9b16-e2aa26432077\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") "
Jul 22 13:41:04.148598 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.148506    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62c55e6c-60ca-4c63-9b16-e2aa26432077-tls-certs\") pod \"62c55e6c-60ca-4c63-9b16-e2aa26432077\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") "
Jul 22 13:41:04.148598 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.148560    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-dshm\") pod \"62c55e6c-60ca-4c63-9b16-e2aa26432077\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") "
Jul 22 13:41:04.148598 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.148578    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l689b\" (UniqueName: \"kubernetes.io/projected/62c55e6c-60ca-4c63-9b16-e2aa26432077-kube-api-access-l689b\") pod \"62c55e6c-60ca-4c63-9b16-e2aa26432077\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") "
Jul 22 13:41:04.148787 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.148614    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-home\") pod \"62c55e6c-60ca-4c63-9b16-e2aa26432077\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") "
Jul 22 13:41:04.148787 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.148682    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-model-cache\") pod \"62c55e6c-60ca-4c63-9b16-e2aa26432077\" (UID: \"62c55e6c-60ca-4c63-9b16-e2aa26432077\") "
Jul 22 13:41:04.148787 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.148757    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "62c55e6c-60ca-4c63-9b16-e2aa26432077" (UID: "62c55e6c-60ca-4c63-9b16-e2aa26432077"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:41:04.148985 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.148953    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-tmp-dir\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:41:04.149102 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.148955    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-home" (OuterVolumeSpecName: "home") pod "62c55e6c-60ca-4c63-9b16-e2aa26432077" (UID: "62c55e6c-60ca-4c63-9b16-e2aa26432077"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:41:04.149102 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.148995    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-model-cache" (OuterVolumeSpecName: "model-cache") pod "62c55e6c-60ca-4c63-9b16-e2aa26432077" (UID: "62c55e6c-60ca-4c63-9b16-e2aa26432077"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:41:04.150749 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.150723    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62c55e6c-60ca-4c63-9b16-e2aa26432077-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "62c55e6c-60ca-4c63-9b16-e2aa26432077" (UID: "62c55e6c-60ca-4c63-9b16-e2aa26432077"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:41:04.150842 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.150764    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-dshm" (OuterVolumeSpecName: "dshm") pod "62c55e6c-60ca-4c63-9b16-e2aa26432077" (UID: "62c55e6c-60ca-4c63-9b16-e2aa26432077"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:41:04.150842 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.150785    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62c55e6c-60ca-4c63-9b16-e2aa26432077-kube-api-access-l689b" (OuterVolumeSpecName: "kube-api-access-l689b") pod "62c55e6c-60ca-4c63-9b16-e2aa26432077" (UID: "62c55e6c-60ca-4c63-9b16-e2aa26432077"). InnerVolumeSpecName "kube-api-access-l689b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:41:04.250454 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.250350    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-model-cache\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:41:04.250454 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.250397    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62c55e6c-60ca-4c63-9b16-e2aa26432077-tls-certs\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:41:04.250454 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.250406    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-dshm\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:41:04.250454 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.250416    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l689b\" (UniqueName: \"kubernetes.io/projected/62c55e6c-60ca-4c63-9b16-e2aa26432077-kube-api-access-l689b\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:41:04.250454 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.250424    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62c55e6c-60ca-4c63-9b16-e2aa26432077-home\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:41:04.444046 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.444015    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"]
Jul 22 13:41:04.446356 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.446335    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-15ce38/rate-test-model-15ce38-kserve-7cdd9457f-76qqg"]
Jul 22 13:41:04.689740 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.689687    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn" podUID="9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb" containerName="main" containerID="cri-o://60c1e9ba1a9bcaf7ce7e5acc41c4364bd8c6e290d9c3ba9f85e471bb91a36ac2" gracePeriod=45
Jul 22 13:41:04.808272 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.808243    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62c55e6c-60ca-4c63-9b16-e2aa26432077" path="/var/lib/kubelet/pods/62c55e6c-60ca-4c63-9b16-e2aa26432077/volumes"
Jul 22 13:41:04.846635 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.846604    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7509-139621252581392"]
Jul 22 13:41:04.847036 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.847019    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62c55e6c-60ca-4c63-9b16-e2aa26432077" containerName="main"
Jul 22 13:41:04.847131 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.847038    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="62c55e6c-60ca-4c63-9b16-e2aa26432077" containerName="main"
Jul 22 13:41:04.847131 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.847127    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="62c55e6c-60ca-4c63-9b16-e2aa26432077" containerName="main"
Jul 22 13:41:04.851798 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.851773    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-139621252581392"
Jul 22 13:41:04.856491 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.856468    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4ljcl\""
Jul 22 13:41:04.857940 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.857841    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7509-139621252581392"]
Jul 22 13:41:04.954958 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.954925    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:41:04.955569 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:04.955546    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlflk\" (UniqueName: \"kubernetes.io/projected/00ee3e53-9f39-4c49-b90d-db405283ff12-kube-api-access-mlflk\") pod \"test-curl-7509-139621252581392\" (UID: \"00ee3e53-9f39-4c49-b90d-db405283ff12\") " pod="opendatahub/test-curl-7509-139621252581392"
Jul 22 13:41:05.056333 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.056287    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-model-cache\") pod \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") "
Jul 22 13:41:05.056549 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.056352    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-599t2\" (UniqueName: \"kubernetes.io/projected/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-kube-api-access-599t2\") pod \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") "
Jul 22 13:41:05.056549 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.056445    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-tmp-dir\") pod \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") "
Jul 22 13:41:05.056549 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.056489    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-dshm\") pod \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") "
Jul 22 13:41:05.056549 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.056522    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-home\") pod \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") "
Jul 22 13:41:05.056789 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.056571    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-tls-certs\") pod \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\" (UID: \"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb\") "
Jul 22 13:41:05.056789 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.056587    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-model-cache" (OuterVolumeSpecName: "model-cache") pod "9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb" (UID: "9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:41:05.056789 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.056690    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb" (UID: "9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:41:05.056946 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.056809    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlflk\" (UniqueName: \"kubernetes.io/projected/00ee3e53-9f39-4c49-b90d-db405283ff12-kube-api-access-mlflk\") pod \"test-curl-7509-139621252581392\" (UID: \"00ee3e53-9f39-4c49-b90d-db405283ff12\") " pod="opendatahub/test-curl-7509-139621252581392"
Jul 22 13:41:05.056946 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.056810    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-home" (OuterVolumeSpecName: "home") pod "9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb" (UID: "9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:41:05.056946 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.056939    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-home\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:41:05.057102 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.056959    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-model-cache\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:41:05.057102 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.056974    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-tmp-dir\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:41:05.058511 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.058486    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-dshm" (OuterVolumeSpecName: "dshm") pod "9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb" (UID: "9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 13:41:05.058623 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.058592    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-kube-api-access-599t2" (OuterVolumeSpecName: "kube-api-access-599t2") pod "9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb" (UID: "9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb"). InnerVolumeSpecName "kube-api-access-599t2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:41:05.058623 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.058602    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb" (UID: "9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 13:41:05.065244 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.065220    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlflk\" (UniqueName: \"kubernetes.io/projected/00ee3e53-9f39-4c49-b90d-db405283ff12-kube-api-access-mlflk\") pod \"test-curl-7509-139621252581392\" (UID: \"00ee3e53-9f39-4c49-b90d-db405283ff12\") " pod="opendatahub/test-curl-7509-139621252581392"
Jul 22 13:41:05.125641 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.125605    2557 generic.go:356] "Generic (PLEG): container finished" podID="9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb" containerID="60c1e9ba1a9bcaf7ce7e5acc41c4364bd8c6e290d9c3ba9f85e471bb91a36ac2" exitCode=0
Jul 22 13:41:05.125848 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.125647    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"
Jul 22 13:41:05.125848 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.125694    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn" event={"ID":"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb","Type":"ContainerDied","Data":"60c1e9ba1a9bcaf7ce7e5acc41c4364bd8c6e290d9c3ba9f85e471bb91a36ac2"}
Jul 22 13:41:05.125848 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.125759    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn" event={"ID":"9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb","Type":"ContainerDied","Data":"c2b306b63f187c1ac7a0452c1e6917346a1ae6cbedf67b798535f7923aebe8cf"}
Jul 22 13:41:05.125848 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.125782    2557 scope.go:117] "RemoveContainer" containerID="60c1e9ba1a9bcaf7ce7e5acc41c4364bd8c6e290d9c3ba9f85e471bb91a36ac2"
Jul 22 13:41:05.134283 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.134258    2557 scope.go:117] "RemoveContainer" containerID="60c1e9ba1a9bcaf7ce7e5acc41c4364bd8c6e290d9c3ba9f85e471bb91a36ac2"
Jul 22 13:41:05.134564 ip-10-0-141-162 kubenswrapper[2557]: E0722 13:41:05.134546    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60c1e9ba1a9bcaf7ce7e5acc41c4364bd8c6e290d9c3ba9f85e471bb91a36ac2\": container with ID starting with 60c1e9ba1a9bcaf7ce7e5acc41c4364bd8c6e290d9c3ba9f85e471bb91a36ac2 not found: ID does not exist" containerID="60c1e9ba1a9bcaf7ce7e5acc41c4364bd8c6e290d9c3ba9f85e471bb91a36ac2"
Jul 22 13:41:05.134606 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.134575    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60c1e9ba1a9bcaf7ce7e5acc41c4364bd8c6e290d9c3ba9f85e471bb91a36ac2"} err="failed to get container status \"60c1e9ba1a9bcaf7ce7e5acc41c4364bd8c6e290d9c3ba9f85e471bb91a36ac2\": rpc error: code = NotFound desc = could not find container \"60c1e9ba1a9bcaf7ce7e5acc41c4364bd8c6e290d9c3ba9f85e471bb91a36ac2\": container with ID starting with 60c1e9ba1a9bcaf7ce7e5acc41c4364bd8c6e290d9c3ba9f85e471bb91a36ac2 not found: ID does not exist"
Jul 22 13:41:05.147981 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.147948    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"]
Jul 22 13:41:05.155242 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.155202    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-19e216/rate-test-model-19e216-kserve-d7655fdf9-vtnmn"]
Jul 22 13:41:05.157751 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.157730    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-tls-certs\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:41:05.157828 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.157756    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-599t2\" (UniqueName: \"kubernetes.io/projected/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-kube-api-access-599t2\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:41:05.157828 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.157765    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb-dshm\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:41:05.163560 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.163540    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-139621252581392"
Jul 22 13:41:05.296805 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.296772    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7509-139621252581392"]
Jul 22 13:41:05.300075 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:41:05.300044    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00ee3e53_9f39_4c49_b90d_db405283ff12.slice/crio-fa28071df3840d4da50ff8768351dc9f8a55db701bebde8ddaea9527f82c25c6 WatchSource:0}: Error finding container fa28071df3840d4da50ff8768351dc9f8a55db701bebde8ddaea9527f82c25c6: Status 404 returned error can't find the container with id fa28071df3840d4da50ff8768351dc9f8a55db701bebde8ddaea9527f82c25c6
Jul 22 13:41:05.301312 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:05.301297    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 13:41:06.133692 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:06.133658    2557 generic.go:356] "Generic (PLEG): container finished" podID="00ee3e53-9f39-4c49-b90d-db405283ff12" containerID="d6d3466cc890f1ebbecf5acb4ca803fbf8f93f4675b1196b960a815227142f1f" exitCode=0
Jul 22 13:41:06.134106 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:06.133702    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7509-139621252581392" event={"ID":"00ee3e53-9f39-4c49-b90d-db405283ff12","Type":"ContainerDied","Data":"d6d3466cc890f1ebbecf5acb4ca803fbf8f93f4675b1196b960a815227142f1f"}
Jul 22 13:41:06.134106 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:06.133751    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7509-139621252581392" event={"ID":"00ee3e53-9f39-4c49-b90d-db405283ff12","Type":"ContainerStarted","Data":"fa28071df3840d4da50ff8768351dc9f8a55db701bebde8ddaea9527f82c25c6"}
Jul 22 13:41:06.809103 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:06.809066    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb" path="/var/lib/kubelet/pods/9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb/volumes"
Jul 22 13:41:07.270610 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:07.270586    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-139621252581392"
Jul 22 13:41:07.310311 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:07.310280    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7509-139621252581392_00ee3e53-9f39-4c49-b90d-db405283ff12/test-curl-7509-139621252581392/0.log"
Jul 22 13:41:07.335612 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:07.335580    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7509-139621252581392"]
Jul 22 13:41:07.340508 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:07.340481    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7509-139621252581392"]
Jul 22 13:41:07.378530 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:07.378496    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlflk\" (UniqueName: \"kubernetes.io/projected/00ee3e53-9f39-4c49-b90d-db405283ff12-kube-api-access-mlflk\") pod \"00ee3e53-9f39-4c49-b90d-db405283ff12\" (UID: \"00ee3e53-9f39-4c49-b90d-db405283ff12\") "
Jul 22 13:41:07.380794 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:07.380767    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00ee3e53-9f39-4c49-b90d-db405283ff12-kube-api-access-mlflk" (OuterVolumeSpecName: "kube-api-access-mlflk") pod "00ee3e53-9f39-4c49-b90d-db405283ff12" (UID: "00ee3e53-9f39-4c49-b90d-db405283ff12"). InnerVolumeSpecName "kube-api-access-mlflk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 13:41:07.479933 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:07.479836    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlflk\" (UniqueName: \"kubernetes.io/projected/00ee3e53-9f39-4c49-b90d-db405283ff12-kube-api-access-mlflk\") on node \"ip-10-0-141-162.ec2.internal\" DevicePath \"\""
Jul 22 13:41:08.144116 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:08.144083    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7509-139621252581392"
Jul 22 13:41:08.144299 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:08.144129    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa28071df3840d4da50ff8768351dc9f8a55db701bebde8ddaea9527f82c25c6"
Jul 22 13:41:08.153228 ip-10-0-141-162 kubenswrapper[2557]: E0722 13:41:08.153203    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7509-139621252581392\" is forbidden: User \"system:node:ip-10-0-141-162.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-162.ec2.internal' and this object" podUID="00ee3e53-9f39-4c49-b90d-db405283ff12" pod="opendatahub/test-curl-7509-139621252581392"
Jul 22 13:41:08.808765 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:08.808705    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00ee3e53-9f39-4c49-b90d-db405283ff12" path="/var/lib/kubelet/pods/00ee3e53-9f39-4c49-b90d-db405283ff12/volumes"
Jul 22 13:41:21.245563 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:21.245526    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:41:43.246137 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:43.246103    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xh9qq"]
Jul 22 13:41:59.201290 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:59.201214    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74989f8477-8nbcd_847a52d1-8843-4647-8367-521aa59baada/copy-manifests/0.log"
Jul 22 13:41:59.216464 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:41:59.216443    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74989f8477-8nbcd_847a52d1-8843-4647-8367-521aa59baada/manager/0.log"
Jul 22 13:42:01.702002 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:01.701968    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-klcmg_c99ef40d-1c69-4cd8-8716-cc0efeef7f72/manager/0.log"
Jul 22 13:42:01.825535 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:01.825510    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6mfdd_0e51d5dc-9a77-4b59-9a0b-c4a4dce78b1f/manager/0.log"
Jul 22 13:42:01.942184 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:01.942157    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-w55d9_514f6fc2-990c-414d-8c2e-035ae9bc9e08/kuadrant-console-plugin/0.log"
Jul 22 13:42:02.067042 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:02.066971    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2zgbl_0389e960-1445-48d7-9b98-27d38287f1bc/registry-server/0.log"
Jul 22 13:42:02.330429 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:02.330364    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-xh9qq_5dc83eba-59e3-40a0-ad71-4e9e14f135e1/limitador/0.log"
Jul 22 13:42:02.838117 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:02.838088    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678r9kqv_80ed3fa8-50b3-46ea-85ed-d090da5369e0/istio-proxy/0.log"
Jul 22 13:42:03.321007 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:03.320976    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-7jglc_1b5193c6-f351-4535-88ed-eca577e6fa2e/istio-proxy/1.log"
Jul 22 13:42:04.397148 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:04.397075    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68flnnv9_f472e569-ca69-44ec-a8df-56bf4cf92586/main/0.log"
Jul 22 13:42:04.630802 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:04.630761    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-lcrwc_3321fa11-007d-4176-a3c2-899a7fab22d5/main/0.log"
Jul 22 13:42:10.051398 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:10.051364    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9zstf/must-gather-jzsmv"]
Jul 22 13:42:10.051790 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:10.051668    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00ee3e53-9f39-4c49-b90d-db405283ff12" containerName="test-curl-7509-139621252581392"
Jul 22 13:42:10.051790 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:10.051679    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="00ee3e53-9f39-4c49-b90d-db405283ff12" containerName="test-curl-7509-139621252581392"
Jul 22 13:42:10.051790 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:10.051691    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb" containerName="main"
Jul 22 13:42:10.051790 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:10.051697    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb" containerName="main"
Jul 22 13:42:10.051790 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:10.051774    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c49b421-97f7-4d31-88fa-6e0cb5b6ebdb" containerName="main"
Jul 22 13:42:10.051790 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:10.051781    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="00ee3e53-9f39-4c49-b90d-db405283ff12" containerName="test-curl-7509-139621252581392"
Jul 22 13:42:10.054966 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:10.054944    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9zstf/must-gather-jzsmv"
Jul 22 13:42:10.056965 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:10.056942    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9zstf\"/\"kube-root-ca.crt\""
Jul 22 13:42:10.057383 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:10.057364    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9zstf\"/\"openshift-service-ca.crt\""
Jul 22 13:42:10.057383 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:10.057378    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9zstf\"/\"default-dockercfg-bnjsf\""
Jul 22 13:42:10.063215 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:10.063195    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9zstf/must-gather-jzsmv"]
Jul 22 13:42:10.094027 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:10.094001    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfqr9\" (UniqueName: \"kubernetes.io/projected/180b0edf-8417-4c42-8041-470e08de473a-kube-api-access-gfqr9\") pod \"must-gather-jzsmv\" (UID: \"180b0edf-8417-4c42-8041-470e08de473a\") " pod="openshift-must-gather-9zstf/must-gather-jzsmv"
Jul 22 13:42:10.094134 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:10.094098    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/180b0edf-8417-4c42-8041-470e08de473a-must-gather-output\") pod \"must-gather-jzsmv\" (UID: \"180b0edf-8417-4c42-8041-470e08de473a\") " pod="openshift-must-gather-9zstf/must-gather-jzsmv"
Jul 22 13:42:10.194682 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:10.194658    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/180b0edf-8417-4c42-8041-470e08de473a-must-gather-output\") pod \"must-gather-jzsmv\" (UID: \"180b0edf-8417-4c42-8041-470e08de473a\") " pod="openshift-must-gather-9zstf/must-gather-jzsmv"
Jul 22 13:42:10.194798 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:10.194699    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfqr9\" (UniqueName: \"kubernetes.io/projected/180b0edf-8417-4c42-8041-470e08de473a-kube-api-access-gfqr9\") pod \"must-gather-jzsmv\" (UID: \"180b0edf-8417-4c42-8041-470e08de473a\") " pod="openshift-must-gather-9zstf/must-gather-jzsmv"
Jul 22 13:42:10.195311 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:10.195278    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/180b0edf-8417-4c42-8041-470e08de473a-must-gather-output\") pod \"must-gather-jzsmv\" (UID: \"180b0edf-8417-4c42-8041-470e08de473a\") " pod="openshift-must-gather-9zstf/must-gather-jzsmv"
Jul 22 13:42:10.206227 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:10.206208    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfqr9\" (UniqueName: \"kubernetes.io/projected/180b0edf-8417-4c42-8041-470e08de473a-kube-api-access-gfqr9\") pod \"must-gather-jzsmv\" (UID: \"180b0edf-8417-4c42-8041-470e08de473a\") " pod="openshift-must-gather-9zstf/must-gather-jzsmv"
Jul 22 13:42:10.364640 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:10.364617    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9zstf/must-gather-jzsmv"
Jul 22 13:42:10.493381 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:10.493356    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9zstf/must-gather-jzsmv"]
Jul 22 13:42:10.495880 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:42:10.495854    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod180b0edf_8417_4c42_8041_470e08de473a.slice/crio-8d37cd69b38870773ef9fbb77ee9a4cf052898d29b7dc34c25bad571c11b42bd WatchSource:0}: Error finding container 8d37cd69b38870773ef9fbb77ee9a4cf052898d29b7dc34c25bad571c11b42bd: Status 404 returned error can't find the container with id 8d37cd69b38870773ef9fbb77ee9a4cf052898d29b7dc34c25bad571c11b42bd
Jul 22 13:42:11.420267 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:11.420232    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9zstf/must-gather-jzsmv" event={"ID":"180b0edf-8417-4c42-8041-470e08de473a","Type":"ContainerStarted","Data":"8d37cd69b38870773ef9fbb77ee9a4cf052898d29b7dc34c25bad571c11b42bd"}
Jul 22 13:42:13.434084 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:13.434045    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9zstf/must-gather-jzsmv" event={"ID":"180b0edf-8417-4c42-8041-470e08de473a","Type":"ContainerStarted","Data":"26ca4dbf1f3625fcc04a4942243d8e0542f8bbe737bd2d87cd4498cfa6008dd3"}
Jul 22 13:42:13.434641 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:13.434616    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9zstf/must-gather-jzsmv" event={"ID":"180b0edf-8417-4c42-8041-470e08de473a","Type":"ContainerStarted","Data":"7912e71d956323b8de2eef164089b722fe3045914278d56d14589686f805eb63"}
Jul 22 13:42:13.451839 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:13.451797    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9zstf/must-gather-jzsmv" podStartSLOduration=1.065831697 podStartE2EDuration="3.451782104s" totalImagesPullingTime="2.385950407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 13:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:42:13.449831723 +0000 UTC m=+2881.214483346" watchObservedRunningTime="2026-07-22 13:42:13.451782104 +0000 UTC m=+2881.216433734"
Jul 22 13:42:14.569141 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:14.569111    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2hjdp_8acd9f4a-3905-4940-9304-9709d2917fcf/global-pull-secret-syncer/0.log"
Jul 22 13:42:14.792135 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:14.792104    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lsw8h_fd75730f-ceb2-4726-9562-d25606150f76/konnectivity-agent/0.log"
Jul 22 13:42:14.878090 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:14.878059    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-162.ec2.internal_a6e375ecd0701850088a8ac8d4843555/haproxy/0.log"
Jul 22 13:42:19.422493 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:19.422453    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-klcmg_c99ef40d-1c69-4cd8-8716-cc0efeef7f72/manager/0.log"
Jul 22 13:42:19.451836 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:19.451806    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-6mfdd_0e51d5dc-9a77-4b59-9a0b-c4a4dce78b1f/manager/0.log"
Jul 22 13:42:19.481273 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:19.481243    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-w55d9_514f6fc2-990c-414d-8c2e-035ae9bc9e08/kuadrant-console-plugin/0.log"
Jul 22 13:42:19.539629 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:19.539595    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2zgbl_0389e960-1445-48d7-9b98-27d38287f1bc/registry-server/0.log"
Jul 22 13:42:19.670835 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:19.670810    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-xh9qq_5dc83eba-59e3-40a0-ad71-4e9e14f135e1/limitador/0.log"
Jul 22 13:42:22.097942 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:22.097912    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfpdx_678ba1fe-592e-4010-b87a-c8c22e64707b/node-exporter/0.log"
Jul 22 13:42:22.139904 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:22.139870    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfpdx_678ba1fe-592e-4010-b87a-c8c22e64707b/kube-rbac-proxy/0.log"
Jul 22 13:42:22.177175 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:22.177155    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfpdx_678ba1fe-592e-4010-b87a-c8c22e64707b/init-textfile/0.log"
Jul 22 13:42:24.097100 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:24.097027    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-5rq77_24304c8d-9d78-419e-b158-e917bb1d20a0/networking-console-plugin/0.log"
Jul 22 13:42:25.318693 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:25.318667    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d7995dc68-jhmqs_fece7a9b-ee0d-4197-89d4-632fb93fbbf3/console/0.log"
Jul 22 13:42:26.584497 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:26.584449    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg"]
Jul 22 13:42:26.593968 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:26.593940    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg"
Jul 22 13:42:26.614539 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:26.613217    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg"]
Jul 22 13:42:26.657232 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:26.657189    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55k2j\" (UniqueName: \"kubernetes.io/projected/8b98fc2b-b87f-4b0c-bf63-7629f2053d3e-kube-api-access-55k2j\") pod \"perf-node-gather-daemonset-484zg\" (UID: \"8b98fc2b-b87f-4b0c-bf63-7629f2053d3e\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg"
Jul 22 13:42:26.657232 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:26.657231    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8b98fc2b-b87f-4b0c-bf63-7629f2053d3e-podres\") pod \"perf-node-gather-daemonset-484zg\" (UID: \"8b98fc2b-b87f-4b0c-bf63-7629f2053d3e\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg"
Jul 22 13:42:26.657429 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:26.657263    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b98fc2b-b87f-4b0c-bf63-7629f2053d3e-lib-modules\") pod \"perf-node-gather-daemonset-484zg\" (UID: \"8b98fc2b-b87f-4b0c-bf63-7629f2053d3e\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg"
Jul 22 13:42:26.657429 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:26.657389    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b98fc2b-b87f-4b0c-bf63-7629f2053d3e-sys\") pod \"perf-node-gather-daemonset-484zg\" (UID: \"8b98fc2b-b87f-4b0c-bf63-7629f2053d3e\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg"
Jul 22 13:42:26.657429 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:26.657420    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8b98fc2b-b87f-4b0c-bf63-7629f2053d3e-proc\") pod \"perf-node-gather-daemonset-484zg\" (UID: \"8b98fc2b-b87f-4b0c-bf63-7629f2053d3e\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg"
Jul 22 13:42:26.758674 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:26.758628    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b98fc2b-b87f-4b0c-bf63-7629f2053d3e-sys\") pod \"perf-node-gather-daemonset-484zg\" (UID: \"8b98fc2b-b87f-4b0c-bf63-7629f2053d3e\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg"
Jul 22 13:42:26.758959 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:26.758938    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8b98fc2b-b87f-4b0c-bf63-7629f2053d3e-proc\") pod \"perf-node-gather-daemonset-484zg\" (UID: \"8b98fc2b-b87f-4b0c-bf63-7629f2053d3e\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg"
Jul 22 13:42:26.759147 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:26.759129    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55k2j\" (UniqueName: \"kubernetes.io/projected/8b98fc2b-b87f-4b0c-bf63-7629f2053d3e-kube-api-access-55k2j\") pod \"perf-node-gather-daemonset-484zg\" (UID: \"8b98fc2b-b87f-4b0c-bf63-7629f2053d3e\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg"
Jul 22 13:42:26.759266 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:26.759251    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8b98fc2b-b87f-4b0c-bf63-7629f2053d3e-podres\") pod \"perf-node-gather-daemonset-484zg\" (UID: \"8b98fc2b-b87f-4b0c-bf63-7629f2053d3e\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg"
Jul 22 13:42:26.759412 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:26.759396    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b98fc2b-b87f-4b0c-bf63-7629f2053d3e-lib-modules\") pod \"perf-node-gather-daemonset-484zg\" (UID: \"8b98fc2b-b87f-4b0c-bf63-7629f2053d3e\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg"
Jul 22 13:42:26.759599 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:26.759544    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8b98fc2b-b87f-4b0c-bf63-7629f2053d3e-podres\") pod \"perf-node-gather-daemonset-484zg\" (UID: \"8b98fc2b-b87f-4b0c-bf63-7629f2053d3e\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg"
Jul 22 13:42:26.759599 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:26.759131    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8b98fc2b-b87f-4b0c-bf63-7629f2053d3e-proc\") pod \"perf-node-gather-daemonset-484zg\" (UID: \"8b98fc2b-b87f-4b0c-bf63-7629f2053d3e\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg"
Jul 22 13:42:26.759599 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:26.758819    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b98fc2b-b87f-4b0c-bf63-7629f2053d3e-sys\") pod \"perf-node-gather-daemonset-484zg\" (UID: \"8b98fc2b-b87f-4b0c-bf63-7629f2053d3e\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg"
Jul 22 13:42:26.759873 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:26.759854    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b98fc2b-b87f-4b0c-bf63-7629f2053d3e-lib-modules\") pod \"perf-node-gather-daemonset-484zg\" (UID: \"8b98fc2b-b87f-4b0c-bf63-7629f2053d3e\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg"
Jul 22 13:42:26.769967 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:26.769939    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55k2j\" (UniqueName: \"kubernetes.io/projected/8b98fc2b-b87f-4b0c-bf63-7629f2053d3e-kube-api-access-55k2j\") pod \"perf-node-gather-daemonset-484zg\" (UID: \"8b98fc2b-b87f-4b0c-bf63-7629f2053d3e\") " pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg"
Jul 22 13:42:26.921254 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:26.921212    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg"
Jul 22 13:42:27.085811 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:27.084921    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg"]
Jul 22 13:42:27.087198 ip-10-0-141-162 kubenswrapper[2557]: W0722 13:42:27.087171    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8b98fc2b_b87f_4b0c_bf63_7629f2053d3e.slice/crio-5c1a69997bd6778c446e18084f2690dd630f49987d14a0d50e6de99fe521157e WatchSource:0}: Error finding container 5c1a69997bd6778c446e18084f2690dd630f49987d14a0d50e6de99fe521157e: Status 404 returned error can't find the container with id 5c1a69997bd6778c446e18084f2690dd630f49987d14a0d50e6de99fe521157e
Jul 22 13:42:27.259654 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:27.259557    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2b9ht_d4b298e8-535d-4f7a-a08b-050e622b9602/dns/0.log"
Jul 22 13:42:27.294340 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:27.294316    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2b9ht_d4b298e8-535d-4f7a-a08b-050e622b9602/kube-rbac-proxy/0.log"
Jul 22 13:42:27.489146 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:27.488997    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bhhst_18f03b5d-d4a0-4198-8775-4eecf35d1ffc/dns-node-resolver/0.log"
Jul 22 13:42:27.522426 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:27.522341    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg" event={"ID":"8b98fc2b-b87f-4b0c-bf63-7629f2053d3e","Type":"ContainerStarted","Data":"85814ac90003d2ff5d409d74d0fb1b18b0fb7a86eb082dc82f8cda50db31c9b7"}
Jul 22 13:42:27.522705 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:27.522658    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg" event={"ID":"8b98fc2b-b87f-4b0c-bf63-7629f2053d3e","Type":"ContainerStarted","Data":"5c1a69997bd6778c446e18084f2690dd630f49987d14a0d50e6de99fe521157e"}
Jul 22 13:42:27.522991 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:27.522968    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg"
Jul 22 13:42:27.539354 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:27.539307    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg" podStartSLOduration=1.53928921 podStartE2EDuration="1.53928921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 13:42:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 13:42:27.538414164 +0000 UTC m=+2895.303065813" watchObservedRunningTime="2026-07-22 13:42:27.53928921 +0000 UTC m=+2895.303940838"
Jul 22 13:42:28.211962 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:28.211935    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wzfng_b7614f14-9ad0-46fa-83a9-2fa3293b9a37/node-ca/0.log"
Jul 22 13:42:29.277018 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:29.276991    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678r9kqv_80ed3fa8-50b3-46ea-85ed-d090da5369e0/istio-proxy/0.log"
Jul 22 13:42:29.493795 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:29.493739    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-7jglc_1b5193c6-f351-4535-88ed-eca577e6fa2e/istio-proxy/0.log"
Jul 22 13:42:29.531128 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:29.531056    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-7jglc_1b5193c6-f351-4535-88ed-eca577e6fa2e/istio-proxy/1.log"
Jul 22 13:42:30.371088 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:30.371057    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g7dkc_f354fe87-0789-4245-a1e3-b4a522296723/serve-healthcheck-canary/0.log"
Jul 22 13:42:30.990116 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:30.990089    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cn9mj_ef4193f1-c592-437c-ad52-3167ecfb8430/kube-rbac-proxy/0.log"
Jul 22 13:42:31.018512 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:31.018483    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cn9mj_ef4193f1-c592-437c-ad52-3167ecfb8430/exporter/0.log"
Jul 22 13:42:31.046545 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:31.046501    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cn9mj_ef4193f1-c592-437c-ad52-3167ecfb8430/extractor/0.log"
Jul 22 13:42:33.828573 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:33.828542    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74989f8477-8nbcd_847a52d1-8843-4647-8367-521aa59baada/manager/0.log"
Jul 22 13:42:33.858323 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:33.858291    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74989f8477-8nbcd_847a52d1-8843-4647-8367-521aa59baada/copy-manifests/0.log"
Jul 22 13:42:34.545479 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:34.545449    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9zstf/perf-node-gather-daemonset-484zg"
Jul 22 13:42:34.689279 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:34.689253    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678r9kqv_80ed3fa8-50b3-46ea-85ed-d090da5369e0/istio-proxy/0.log"
Jul 22 13:42:34.856615 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:34.856530    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-7jglc_1b5193c6-f351-4535-88ed-eca577e6fa2e/istio-proxy/0.log"
Jul 22 13:42:34.893500 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:34.893472    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-7jglc_1b5193c6-f351-4535-88ed-eca577e6fa2e/istio-proxy/1.log"
Jul 22 13:42:35.431401 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:35.431374    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68759d94bb-l4nvg_8ff6f4ed-44eb-42f1-97c2-444f1a2ae6a3/manager/0.log"
Jul 22 13:42:35.490185 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:35.490108    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-787jw_f839a2cb-236d-41aa-b4b1-b483a362c686/openshift-lws-operator/0.log"
Jul 22 13:42:36.328878 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:36.328848    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678r9kqv_80ed3fa8-50b3-46ea-85ed-d090da5369e0/istio-proxy/0.log"
Jul 22 13:42:36.537043 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:36.537012    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-7jglc_1b5193c6-f351-4535-88ed-eca577e6fa2e/istio-proxy/0.log"
Jul 22 13:42:36.571149 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:36.571071    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-7jglc_1b5193c6-f351-4535-88ed-eca577e6fa2e/istio-proxy/1.log"
Jul 22 13:42:42.426920 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:42.426890    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kkn5g_a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4/kube-multus-additional-cni-plugins/0.log"
Jul 22 13:42:42.452149 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:42.452120    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kkn5g_a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4/egress-router-binary-copy/0.log"
Jul 22 13:42:42.478657 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:42.478627    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kkn5g_a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4/cni-plugins/0.log"
Jul 22 13:42:42.501927 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:42.501905    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kkn5g_a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4/bond-cni-plugin/0.log"
Jul 22 13:42:42.524968 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:42.524939    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kkn5g_a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4/routeoverride-cni/0.log"
Jul 22 13:42:42.550080 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:42.550052    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kkn5g_a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4/whereabouts-cni-bincopy/0.log"
Jul 22 13:42:42.576436 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:42.576406    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kkn5g_a48dc7c9-01e8-4ffc-b77a-b1c320c7c5b4/whereabouts-cni/0.log"
Jul 22 13:42:43.060191 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:43.060161    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tmmtf_f7c11e2c-eacc-4764-9ab9-3de705c894ee/kube-multus/0.log"
Jul 22 13:42:43.119253 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:43.119226    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k7tvv_de51b06a-8a46-462a-8e91-e96529e7d461/network-metrics-daemon/0.log"
Jul 22 13:42:43.143247 ip-10-0-141-162 kubenswrapper[2557]: I0722 13:42:43.143222    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k7tvv_de51b06a-8a46-462a-8e91-e96529e7d461/kube-rbac-proxy/0.log"